-- Logs begin at Wed 2022-06-08 11:22:12 UTC, end at Wed 2022-06-08 12:30:03 UTC. -- Jun 08 11:51:36.968681 dv-cinder-797608-30-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 08 11:51:36.977587 dv-cinder-797608-30-iscsi devstack@keystone.service[80205]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 08 11:51:36.980152 dv-cinder-797608-30-iscsi devstack@keystone.service[80205]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 8 11:51:36 2022] *** Jun 08 11:51:36.980307 dv-cinder-797608-30-iscsi devstack@keystone.service[80205]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 08 11:51:36.980424 dv-cinder-797608-30-iscsi devstack@keystone.service[80205]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 08 11:51:36.980526 dv-cinder-797608-30-iscsi devstack@keystone.service[80205]: nodename: dv-cinder-797608-30-iscsi Jun 08 11:51:36.980619 dv-cinder-797608-30-iscsi devstack@keystone.service[80205]: machine: x86_64 Jun 08 11:51:36.980718 dv-cinder-797608-30-iscsi devstack@keystone.service[80205]: clock source: unix Jun 08 11:51:36.980816 dv-cinder-797608-30-iscsi devstack@keystone.service[80205]: pcre jit disabled Jun 08 11:51:36.980914 dv-cinder-797608-30-iscsi devstack@keystone.service[80205]: detected number of CPU cores: 4 Jun 08 11:51:36.981013 dv-cinder-797608-30-iscsi devstack@keystone.service[80205]: current working directory: / Jun 08 11:51:36.981117 dv-cinder-797608-30-iscsi devstack@keystone.service[80205]: detected binary path: /usr/bin/uwsgi-core Jun 08 11:51:36.981222 dv-cinder-797608-30-iscsi devstack@keystone.service[80205]: your processes number limit is 47680 Jun 08 11:51:36.981323 dv-cinder-797608-30-iscsi devstack@keystone.service[80205]: your memory page size is 4096 bytes Jun 08 11:51:36.981418 dv-cinder-797608-30-iscsi devstack@keystone.service[80205]: detected max file descriptor number: 2048 Jun 08 11:51:36.981526 dv-cinder-797608-30-iscsi devstack@keystone.service[80205]: lock engine: pthread robust mutexes Jun 08 11:51:36.981788 dv-cinder-797608-30-iscsi devstack@keystone.service[80205]: thunder lock: enabled Jun 08 11:51:36.982093 dv-cinder-797608-30-iscsi devstack@keystone.service[80205]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 08 11:51:36.982199 dv-cinder-797608-30-iscsi devstack@keystone.service[80205]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 08 11:51:37.026719 dv-cinder-797608-30-iscsi devstack@keystone.service[80205]: Python main interpreter initialized at 0x560cef8b79c0 Jun 08 11:51:37.026719 dv-cinder-797608-30-iscsi devstack@keystone.service[80205]: python threads support enabled Jun 08 11:51:37.026719 dv-cinder-797608-30-iscsi devstack@keystone.service[80205]: your server socket listen backlog is limited to 100 connections Jun 08 11:51:37.026719 dv-cinder-797608-30-iscsi devstack@keystone.service[80205]: your mercy for graceful operations on workers is 90 seconds Jun 08 11:51:37.027068 dv-cinder-797608-30-iscsi devstack@keystone.service[80205]: mapped 403077 bytes (393 KB) for 2 cores Jun 08 11:51:37.027145 dv-cinder-797608-30-iscsi devstack@keystone.service[80205]: *** Operational MODE: preforking *** Jun 08 11:51:37.027402 dv-cinder-797608-30-iscsi devstack@keystone.service[80205]: *** uWSGI is running in multiple interpreter mode *** Jun 08 11:51:37.027402 dv-cinder-797608-30-iscsi devstack@keystone.service[80205]: spawned uWSGI master process (pid: 80205) Jun 08 11:51:37.027623 dv-cinder-797608-30-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 08 11:51:37.029612 dv-cinder-797608-30-iscsi devstack@keystone.service[80205]: spawned uWSGI worker 1 (pid: 80216, cores: 1) Jun 08 11:51:37.029612 dv-cinder-797608-30-iscsi devstack@keystone.service[80205]: spawned uWSGI worker 2 (pid: 80217, cores: 1) Jun 08 11:51:37.029612 dv-cinder-797608-30-iscsi devstack@keystone.service[80205]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 08 11:51:42.756285 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 08 11:51:42.756285 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: from cryptography.utils import int_from_bytes Jun 08 11:51:42.757079 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 08 11:51:42.757079 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: from cryptography.utils import int_from_bytes Jun 08 11:51:42.757520 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 08 11:51:42.757520 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: from cryptography.utils import int_from_bytes Jun 08 11:51:42.757652 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 08 11:51:42.757652 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: from cryptography.utils import int_from_bytes Jun 08 11:51:42.806617 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 08 11:51:42.806760 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 08 11:51:42.806846 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 08 11:51:42.806922 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 08 11:51:42.806989 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] command line args: [] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 08 11:51:42.807127 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] command line args: [] {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 08 11:51:42.807254 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 08 11:51:42.807416 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ================================================================================ {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 08 11:51:42.807514 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 08 11:51:42.807629 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] ================================================================================ {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 08 11:51:42.807715 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] admin_token = **** {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.807882 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] admin_token = **** {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.807967 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] config_dir = [] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.808094 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.808215 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] config_dir = [] {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.808291 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] config_source = [] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.808366 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.808472 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] debug = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.808560 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] config_source = [] {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.808665 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] debug = True {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.808747 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.808921 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.809062 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.809144 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.809205 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.809267 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.809446 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.809532 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.809695 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.809772 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.809924 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] list_limit = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.810001 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] list_limit = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.810113 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] log_config_append = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.810193 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] log_config_append = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.810291 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.810367 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.810470 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] log_dir = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.810545 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] log_dir = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.810615 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] log_file = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.810677 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] log_file = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.810844 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.810945 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.811088 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.811233 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.811349 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.811487 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.811595 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.811700 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.811805 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.812015 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.812203 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.812391 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.812637 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.812928 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.813249 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.813442 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.813624 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.813801 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.813970 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.814142 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.814309 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.814456 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.814630 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.814805 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.814974 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.815141 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.815306 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.815456 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.815629 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.815781 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.815910 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.39/identity {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.816056 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.39/identity {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.816200 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] publish_errors = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.816316 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] publish_errors = False {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.816466 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.816589 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.816711 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.816823 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.816939 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.817050 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.817186 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.817380 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.817505 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.817624 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.817737 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] standard_threads = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.817853 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] standard_threads = False {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.817974 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.818092 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.818204 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.818314 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.818431 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.818571 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.818693 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] use_journal = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.818812 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] use_journal = False {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.818930 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] use_json = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.819047 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] use_json = False {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.819159 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] use_stderr = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.819275 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] use_stderr = False {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.819395 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] use_syslog = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.819513 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] use_syslog = False {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.819632 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.819817 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 11:51:42.820009 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.820134 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.820278 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.820392 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.820504 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.820616 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.820726 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.820837 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.820955 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.821067 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.821204 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.821345 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.821457 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.821643 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.821759 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.821870 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.821981 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.822098 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.822210 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.822329 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.822447 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.822558 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.822675 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.822787 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.822904 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.823024 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.823136 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.823246 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.823357 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.823467 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.823602 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.823719 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.823849 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.823968 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.824086 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.824310 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.824428 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.824552 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.824666 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.824784 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.824896 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.825006 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.825123 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.825243 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.825356 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.825472 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.825584 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.825702 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.825819 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.825940 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.826054 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.826168 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.826279 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.826389 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.826500 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.826619 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.826732 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.826849 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.826967 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.827079 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.827190 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.827375 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.827489 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.827600 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.827716 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.827828 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.827940 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.828058 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.828802 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.829000 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.829190 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.829390 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.829538 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.829661 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.829776 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.829893 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.830005 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.830123 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.830243 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.830243 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.830453 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.830665 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.830781 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.830892 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.831011 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.831125 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.831237 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.831347 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.831464 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.831561 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.831661 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.831762 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.831856 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.831949 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.832042 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.832135 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.832274 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.832374 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.832468 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.843380 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.843514 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.843632 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.843763 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.843887 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.844031 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.844157 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.844304 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.844424 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.844545 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.844659 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.844772 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.844883 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.844995 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.845106 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.845226 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.845339 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.845451 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.845562 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.845710 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.845833 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.845955 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.846077 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.846191 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.846311 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.846431 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.846545 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.846656 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.846776 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.846898 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.847012 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.847123 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.847235 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.847346 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.847458 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.847607 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.848310 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.848438 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.848558 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.848675 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.848792 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.848924 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.849043 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.849160 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.849276 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.849392 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.849508 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.849633 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.849750 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.849866 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.849983 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.850098 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.850214 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.850345 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.850463 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.850586 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.850963 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.851087 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.851205 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.851398 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.851525 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.851643 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.851759 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.851876 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.851992 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.852118 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.852253 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.852380 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.852498 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.852614 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.852738 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.852855 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.852971 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.853087 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.853202 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.853317 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.853440 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.853557 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.853673 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.853789 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.853905 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.854020 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.854149 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.854274 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.854399 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.854516 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.854632 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.854747 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.854863 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.854978 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.855102 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.855220 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.855335 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.855451 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.855566 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.855682 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.855809 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.855927 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.856043 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.856245 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.856367 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.856483 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.856611 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.857105 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.857238 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.857358 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.857475 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.857590 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.857717 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] auth.external = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.857835 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.858036 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.858159 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] auth.external = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.858275 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.858394 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.858541 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.858668 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.858796 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] auth.password = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.858914 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.859031 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] auth.token = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.859153 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] auth.password = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.859279 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.859425 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] auth.token = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.859636 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.859805 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.859927 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.860045 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.860162 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.860321 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.860454 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.860576 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.860693 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.860810 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.860927 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.861063 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.861182 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] credential.caching = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.861299 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.861416 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.861533 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] credential.caching = True {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.861649 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.861774 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.861894 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.862011 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.862128 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.862251 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.862368 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.862493 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.862612 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.862729 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.862846 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.862962 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.863085 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.863211 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.863330 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.863447 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.863563 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.863689 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.863807 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.863933 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.864051 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.864182 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.864301 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.864419 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.864535 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.864665 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.864784 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.864900 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.865016 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] federation.caching = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.865133 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.865256 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.865381 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] federation.caching = True {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.865499 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.865616 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.865733 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.865850 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.865966 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.866166 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.866286 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.866403 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.870487 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.870646 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.870776 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.870908 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.871038 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.871159 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.871336 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.871459 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.871577 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.871703 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.871838 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.871957 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.872081 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] identity.caching = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.872215 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.872335 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.872466 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] identity.caching = True {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.872591 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.872708 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.872824 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.872977 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.873171 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.873383 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.873383 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.873758 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.873758 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.874130 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.874326 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.874532 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.874730 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.874919 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.875112 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.875240 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.875342 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.875453 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.875560 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.875658 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.875755 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.875889 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.876066 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.876227 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.876227 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.876453 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.876570 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.876687 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.876812 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.876930 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.877048 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.877171 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.877291 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.877408 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.877408 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.877639 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.877761 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.877879 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.877995 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.878111 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.878235 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.878354 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.878354 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.878572 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.878702 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.878820 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.878944 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.879062 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.879062 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.879279 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.879397 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.879513 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.879637 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.879754 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.879870 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.879986 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.880101 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.880316 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.880449 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.880611 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.880871 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.881078 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.881280 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.881482 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.881690 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.881895 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.882092 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.882289 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.882485 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.882683 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.882893 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.883096 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.883295 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.883483 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.883673 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.883799 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.883928 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.884047 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.884184 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.884305 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.884422 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.884538 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.884670 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.884789 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.884906 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.885022 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.885139 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.885263 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.885263 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.885494 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.885611 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.885727 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.885842 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.885959 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.886083 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.886201 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.886318 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.886433 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.886549 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.886650 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.user = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.886764 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] ldap.user = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.886881 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.886998 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.887114 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.887114 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.887331 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.887331 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.887559 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.887675 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.887798 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.887914 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.888036 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.888036 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.888280 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.888396 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.888512 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.888627 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.888756 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.888875 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.888990 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.889107 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.889222 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.889337 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.889461 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.889578 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.889694 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.889856 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.889975 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.890092 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.890216 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.890333 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.890448 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.890564 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.891171 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.891275 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.891382 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.891482 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.891597 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.891717 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.891834 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.891951 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.892076 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.892210 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.892329 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.892445 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.892561 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.892561 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.892791 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.892910 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.893028 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.893144 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.893260 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.893375 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.893505 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.893623 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.893739 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.893855 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.893971 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.894087 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.894211 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.894329 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.894445 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.894561 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.894677 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.894792 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.894916 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.895034 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.895150 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.895266 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.895382 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.895497 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.895686 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.895806 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.895922 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] resource.caching = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.896038 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] resource.caching = True {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.896154 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.896319 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.896449 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.896449 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.896669 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.896786 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.896901 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.897017 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.897141 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.897259 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.897374 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.897490 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.897605 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.897720 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.897844 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.897962 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.898078 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.898195 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] role.caching = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.898311 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.898426 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] role.driver = sql {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.898550 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] role.caching = True {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.898550 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] role.driver = sql {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.898769 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.898885 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.899001 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.899116 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.899242 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.899362 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.899479 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.899595 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.899711 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.899826 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.899950 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.900069 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.900205 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.900340 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.900441 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.900556 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.900556 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.900790 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.900907 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.901022 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.901137 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.901253 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.901378 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.901496 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.901612 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.901732 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.901848 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.901973 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.902091 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.902214 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.902331 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.902448 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.902564 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.902688 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.902805 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.902921 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.903036 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.903151 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.903267 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.903390 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.903516 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.903632 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.903748 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.903864 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.903980 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.904103 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.904234 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.904234 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.904453 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.904569 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.904685 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.904813 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.904931 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.905047 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.905162 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.905278 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.905400 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.905525 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.905643 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.905762 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.905892 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.906015 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.906131 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.906258 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.906258 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] token.caching = True {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.907094 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.907212 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.907328 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.907458 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.907589 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] token.caching = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.907709 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.907825 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.907940 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.908057 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.908254 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.908375 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.908492 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.908608 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.908726 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.908842 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.908970 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.909089 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.909213 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.909330 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.909446 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.909562 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.909687 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.909806 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.909922 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.910038 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.910154 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.910269 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.910393 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.910511 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.910628 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.910750 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.910869 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.910984 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.910984 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.911212 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.911328 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.911445 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] database.connection = **** {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.911445 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.911681 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.911803 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.911921 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] database.connection = **** {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.912050 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.912200 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.912321 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.912438 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.912554 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.912669 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.912785 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.912914 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.913033 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.913149 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.913265 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.913381 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.913497 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.913621 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.913762 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.913937 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.914059 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.914176 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.914293 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.914418 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.914537 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.914654 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.914771 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.914887 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.915004 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.915198 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.915319 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.915436 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.915553 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.915669 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.915786 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.915911 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.916030 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 08 11:51:42.916148 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.916148 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 11:51:42.916148 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 08 11:51:42.924924 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:42.925042 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:42.925158 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:42.925243 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:42.925384 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:42.925469 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:42.933767 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:42.933857 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:42.963030 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:42.963260 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:42.963416 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:42.963654 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:43.018650 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:43.018800 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:43.067738 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:43.067861 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:43.068027 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:43.068112 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:43.135678 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:43.135817 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:43.135954 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:43.136035 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:43.136125 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:43.136277 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:43.136363 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:43.136495 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:43.136578 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:43.136709 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:43.136796 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:43.136924 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:43.160529 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:43.160755 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:43.160928 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:43.161014 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:43.161162 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:43.161246 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:43.161390 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:43.161475 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:43.161604 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:43.161689 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:43.161818 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:43.161900 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:43.162034 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:43.162252 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:43.172812 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:43.173242 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:43.185478 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:43.185710 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:43.185864 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:43.185952 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:43.186101 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:43.186185 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:43.186325 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:43.186418 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:43.186544 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:43.186628 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:43.186758 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:43.186841 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:43.186998 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:43.187178 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 08 11:51:43.204853 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.205060 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 08 11:51:43.205326 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.205411 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.205542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 08 11:51:43.205626 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 08 11:51:43.205838 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.205921 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.206064 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 08 11:51:43.206147 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.206332 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.206417 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.206584 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.206664 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.206841 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.207096 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.217312 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.217589 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.217853 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.217935 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.218129 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.218227 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.218427 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.218710 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.227364 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 11:51:43.227756 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80216) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 11:51:43.230706 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 11:51:43.230989 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.231110 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80216) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 11:51:43.231277 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.231396 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.231559 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.231683 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.231842 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.231965 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.232102 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.232268 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.232399 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.232529 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.232670 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.232797 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.232938 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.233067 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.233206 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.233336 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.233470 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.233606 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.233873 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.260619 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.261218 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.262218 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 11:51:43.262499 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.262835 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80216) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 11:51:43.263119 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.267855 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 11:51:43.268135 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.268438 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.268847 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80216) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 11:51:43.269127 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.269407 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.275634 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 11:51:43.275918 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.276761 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80216) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 11:51:43.277055 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.280377 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 11:51:43.280666 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.280948 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.281748 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.282029 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.282126 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80216) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 11:51:43.282346 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.282462 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.282628 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.282734 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.282918 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.283109 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.283192 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.283461 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.283741 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.284126 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.302318 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.302602 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.303437 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.303732 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.307141 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 11:51:43.308369 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80216) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 11:51:43.310882 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.311185 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.312091 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.312411 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.316444 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 11:51:43.317559 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80216) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 11:51:43.320014 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 11:51:43.321176 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80216) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 11:51:43.323627 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.323925 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.324225 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.324506 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.324794 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.324920 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.325085 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.325166 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.325373 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.325658 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.325936 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.326215 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.344977 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 11:51:43.345257 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.345525 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.345787 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.345884 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80216) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 11:51:43.346095 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.346377 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.346639 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.353906 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.354769 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.357145 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.357449 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.358094 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.358371 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.361250 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 11:51:43.361526 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.361804 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.362072 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80216) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 11:51:43.362158 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.362352 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.362443 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.362635 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.362923 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.363206 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.375830 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 11:51:43.376111 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.376419 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.376701 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.376786 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80216) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 11:51:43.376987 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.377080 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.377267 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.377351 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.377544 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.377634 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.377825 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.378099 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.378385 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.395868 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 11:51:43.396609 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80216) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 11:51:43.399053 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 11:51:43.399837 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80216) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 11:51:43.402504 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.403316 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.404085 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.404925 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.405742 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 11:51:43.406020 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.406464 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.406633 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80216) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 11:51:43.406915 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.407209 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.413776 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.414469 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.415359 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 11:51:43.416077 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80216) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 11:51:43.418698 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.418987 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.419266 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.419418 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.419548 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.419708 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.419990 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.420296 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.429182 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 11:51:43.429469 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.429745 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.429886 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80216) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 11:51:43.430174 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.430453 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.438263 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 11:51:43.438541 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.438816 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.439041 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80216) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 08 11:51:43.439126 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.439322 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.439426 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.439648 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.439800 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.439920 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.440049 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.440195 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.440322 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.440470 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.440646 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.440802 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.441009 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.441158 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.441298 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.441436 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.441574 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.441704 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.441852 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.441989 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.442156 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.442501 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.442780 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.443042 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 08 11:51:43.479257 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560cef8b79c0 pid: 80217 (default app) Jun 08 11:51:43.481583 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560cef8b79c0 pid: 80216 (default app) Jun 08 11:51:43.482662 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d24fb3-f355-4ea7-801b-ef77f0d5ca6b None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:51:43.482951 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d24fb3-f355-4ea7-801b-ef77f0d5ca6b None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:51:43.483226 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d24fb3-f355-4ea7-801b-ef77f0d5ca6b None None] PATH_INFO: `/v3` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:51:43.487960 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1/1] 10.222.0.39 () {50 vars in 791 bytes} [Wed Jun 8 11:51:43 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:51:51.500720 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b30ff-da2c-4a15-bcfe-bf9f15269aa7 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:51:51.501280 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b30ff-da2c-4a15-bcfe-bf9f15269aa7 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:51:51.501280 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b30ff-da2c-4a15-bcfe-bf9f15269aa7 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:51:51.505597 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1/2] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:51:51 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 11:51:51.510941 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16678e00-e7fb-40b7-b8ce-1bfab9ec3678 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:51:51.511356 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16678e00-e7fb-40b7-b8ce-1bfab9ec3678 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:51:51.511504 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16678e00-e7fb-40b7-b8ce-1bfab9ec3678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:51:51.582640 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: INFO dbcounter [None req-16678e00-e7fb-40b7-b8ce-1bfab9ec3678 None None] Registered counter for database keystone Jun 08 11:51:51.604368 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG oslo_db.sqlalchemy.engines [None req-16678e00-e7fb-40b7-b8ce-1bfab9ec3678 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80217) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 08 11:51:51.611088 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writer thread running {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 08 11:51:51.897551 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG passlib.handlers.bcrypt [None req-16678e00-e7fb-40b7-b8ce-1bfab9ec3678 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80217) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 08 11:51:51.897973 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG passlib.handlers.bcrypt [None req-16678e00-e7fb-40b7-b8ce-1bfab9ec3678 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80217) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 08 11:51:51.955122 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-16678e00-e7fb-40b7-b8ce-1bfab9ec3678 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:51:51.956773 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-16678e00-e7fb-40b7-b8ce-1bfab9ec3678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:51:52.080759 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 2/3] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:51:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 571 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 08 11:51:52.254336 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b30ff-da2c-4a15-bcfe-bf9f15269aa7 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:51:52.323751 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: INFO dbcounter [None req-473b30ff-da2c-4a15-bcfe-bf9f15269aa7 None None] Registered counter for database keystone Jun 08 11:51:52.344103 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG oslo_db.sqlalchemy.engines [None req-473b30ff-da2c-4a15-bcfe-bf9f15269aa7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80216) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 08 11:51:52.350212 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writer thread running {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 08 11:51:52.583505 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b30ff-da2c-4a15-bcfe-bf9f15269aa7 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:51:52.587782 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d877693a-5607-4d2c-b7bf-9f3dd3b56a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:51:52.588492 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877693a-5607-4d2c-b7bf-9f3dd3b56a42 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:51:52.588787 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877693a-5607-4d2c-b7bf-9f3dd3b56a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:51:52.589067 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877693a-5607-4d2c-b7bf-9f3dd3b56a42 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:51:52.598020 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d877693a-5607-4d2c-b7bf-9f3dd3b56a42 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:51:52.649389 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d877693a-5607-4d2c-b7bf-9f3dd3b56a42 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 08 11:51:52.649726 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d877693a-5607-4d2c-b7bf-9f3dd3b56a42 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:51:52.659885 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 2/4] 10.222.0.39 () {58 vars in 1324 bytes} [Wed Jun 8 11:51:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 08 11:51:52.665809 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16678e00-e7fb-40b7-b8ce-1bfab9ec3678 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:51:52.680065 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16678e00-e7fb-40b7-b8ce-1bfab9ec3678 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:51:52.684448 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d2f5f-1314-47ae-9558-3258fa2a402d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:51:52.685566 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d2f5f-1314-47ae-9558-3258fa2a402d admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:51:52.685852 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d2f5f-1314-47ae-9558-3258fa2a402d admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:51:52.686126 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d2f5f-1314-47ae-9558-3258fa2a402d admin admin] PATH_INFO: `/v3/projects/8f8cde9fd1b644e687e4b80b620e4c44` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:51:52.688333 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d2f5f-1314-47ae-9558-3258fa2a402d admin admin] RBAC: Authorizing `identity:get_project(project_id=8f8cde9fd1b644e687e4b80b620e4c44)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:51:52.738486 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5a6d2f5f-1314-47ae-9558-3258fa2a402d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 08 11:51:52.738825 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d2f5f-1314-47ae-9558-3258fa2a402d admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:51:52.744600 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 3/5] 10.222.0.39 () {56 vars in 1207 bytes} [Wed Jun 8 11:51:52 2022] GET /identity/v3/projects/8f8cde9fd1b644e687e4b80b620e4c44 => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:51:54.992500 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ac88a-6f1a-4c3e-84f5-6df8f916720f None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:51:54.993001 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ac88a-6f1a-4c3e-84f5-6df8f916720f None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:51:54.993001 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ac88a-6f1a-4c3e-84f5-6df8f916720f None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:51:54.997073 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 3/6] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:51:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 11:51:55.003126 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb066a-d6cc-4832-8cbe-a2ab826f98b0 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:51:55.003553 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb066a-d6cc-4832-8cbe-a2ab826f98b0 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:51:55.003688 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb066a-d6cc-4832-8cbe-a2ab826f98b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:51:55.023193 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-4dfb066a-d6cc-4832-8cbe-a2ab826f98b0 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:51:55.024747 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-4dfb066a-d6cc-4832-8cbe-a2ab826f98b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:51:55.032558 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 4/7] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:51:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 08 11:51:55.054688 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ac88a-6f1a-4c3e-84f5-6df8f916720f None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:51:55.067285 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ac88a-6f1a-4c3e-84f5-6df8f916720f None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:51:55.071386 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd9210-e345-433a-87e8-7c816704bea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:51:55.072016 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd9210-e345-433a-87e8-7c816704bea6 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:51:55.072338 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd9210-e345-433a-87e8-7c816704bea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:51:55.072615 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd9210-e345-433a-87e8-7c816704bea6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:51:55.080845 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadd9210-e345-433a-87e8-7c816704bea6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:51:55.082617 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadd9210-e345-433a-87e8-7c816704bea6 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:51:55.091284 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 4/8] 10.222.0.39 () {58 vars in 1324 bytes} [Wed Jun 8 11:51:55 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 11:51:55.096530 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb066a-d6cc-4832-8cbe-a2ab826f98b0 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:51:55.105705 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb066a-d6cc-4832-8cbe-a2ab826f98b0 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:51:55.110110 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27f2fa9-45e1-40f5-9ade-8d0ba57112a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:51:55.110964 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f2fa9-45e1-40f5-9ade-8d0ba57112a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:51:55.111251 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f2fa9-45e1-40f5-9ade-8d0ba57112a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:51:55.111533 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f2fa9-45e1-40f5-9ade-8d0ba57112a0 admin admin] PATH_INFO: `/v3/users/0451f9cd1a224f47a21e570061ffb155` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:51:55.112956 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27f2fa9-45e1-40f5-9ade-8d0ba57112a0 admin admin] RBAC: Authorizing `identity:get_user(user_id=0451f9cd1a224f47a21e570061ffb155)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:51:55.114787 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27f2fa9-45e1-40f5-9ade-8d0ba57112a0 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:51:55.116669 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 5/9] 10.222.0.39 () {56 vars in 1198 bytes} [Wed Jun 8 11:51:55 2022] GET /identity/v3/users/0451f9cd1a224f47a21e570061ffb155 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:51:57.430637 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9245b-24c1-4de7-bc61-de779a22d560 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:51:57.431176 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9245b-24c1-4de7-bc61-de779a22d560 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:51:57.431176 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9245b-24c1-4de7-bc61-de779a22d560 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:51:57.432563 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 5/10] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:51:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:51:57.438262 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deaf010-a03f-4a06-a047-c8745fd8444c None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:51:57.438693 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deaf010-a03f-4a06-a047-c8745fd8444c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:51:57.438855 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deaf010-a03f-4a06-a047-c8745fd8444c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:51:57.449500 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ac5b6-20f7-4a4c-83ae-53fbc92edcdd None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:51:57.449789 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ac5b6-20f7-4a4c-83ae-53fbc92edcdd None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:51:57.450066 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ac5b6-20f7-4a4c-83ae-53fbc92edcdd None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:51:57.451373 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 6/11] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:51:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 11:51:57.456489 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-4deaf010-a03f-4a06-a047-c8745fd8444c None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:51:57.457105 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad0c0d-8e51-484e-b7f9-dfea073975ca None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:51:57.457395 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad0c0d-8e51-484e-b7f9-dfea073975ca None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:51:57.457671 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad0c0d-8e51-484e-b7f9-dfea073975ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:51:57.457756 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-4deaf010-a03f-4a06-a047-c8745fd8444c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:51:57.496681 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG passlib.handlers.bcrypt [None req-58ad0c0d-8e51-484e-b7f9-dfea073975ca None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80216) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 08 11:51:57.497099 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG passlib.handlers.bcrypt [None req-58ad0c0d-8e51-484e-b7f9-dfea073975ca None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80216) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 08 11:51:57.537828 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 6/12] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:51:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:51:57.544054 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-58ad0c0d-8e51-484e-b7f9-dfea073975ca None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:51:57.545667 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-58ad0c0d-8e51-484e-b7f9-dfea073975ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:51:57.561650 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deaf010-a03f-4a06-a047-c8745fd8444c None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:51:57.588969 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:51:57.647786 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 7/13] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:51:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 11:51:57.670534 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad0c0d-8e51-484e-b7f9-dfea073975ca None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:51:57.671921 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deaf010-a03f-4a06-a047-c8745fd8444c None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:51:57.705757 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3cbf64-30ba-465e-ba5f-609ea0bbe33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:51:57.706494 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3cbf64-30ba-465e-ba5f-609ea0bbe33f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:51:57.706781 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3cbf64-30ba-465e-ba5f-609ea0bbe33f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:51:57.707059 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3cbf64-30ba-465e-ba5f-609ea0bbe33f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:51:57.718898 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3cbf64-30ba-465e-ba5f-609ea0bbe33f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:51:57.730383 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-ea3cbf64-30ba-465e-ba5f-609ea0bbe33f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:51:57.730383 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:51:57.730383 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:51:57.730383 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:51:57.730383 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:51:57.730383 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:51:57.730383 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:51:57.730383 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:51:57.730383 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:51:57.730383 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:51:57.730383 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:51:57.730383 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:51:57.730383 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:51:57.730383 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:51:57.730383 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:51:57.730383 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:51:57.731339 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:51:57.731339 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:51:57.731339 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:51:57.731339 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:51:57.731339 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:51:57.731339 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:51:57.731339 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:51:57.731339 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:51:57.731339 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:51:57.731339 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:51:57.731339 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:51:57.731339 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:51:57.731339 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:51:57.731339 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:51:57.731339 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:51:57.731339 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:51:57.732385 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:51:57.732385 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:51:57.732385 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:51:57.732385 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:51:57.732385 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:51:57.732385 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:51:57.732385 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:51:57.732385 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:51:57.732385 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:51:57.732385 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:51:57.732385 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:51:57.732385 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:51:57.732385 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 7/14] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Jun 8 11:51:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 11:51:57.737982 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3cbf64-30ba-465e-ba5f-609ea0bbe33f None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:51:57.772750 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad0c0d-8e51-484e-b7f9-dfea073975ca None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:51:57.775032 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:51:57.809530 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fffad2a-c4b2-417e-8c3f-c624a2702013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:51:57.810430 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fffad2a-c4b2-417e-8c3f-c624a2702013 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:51:57.810720 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fffad2a-c4b2-417e-8c3f-c624a2702013 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:51:57.810997 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fffad2a-c4b2-417e-8c3f-c624a2702013 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:51:57.820104 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:51:57.842748 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3cbf64-30ba-465e-ba5f-609ea0bbe33f None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:51:57.879740 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50162536-b251-4960-afec-b3b1511a8e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:51:57.880448 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50162536-b251-4960-afec-b3b1511a8e98 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:51:57.880739 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50162536-b251-4960-afec-b3b1511a8e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:51:57.881019 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50162536-b251-4960-afec-b3b1511a8e98 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:51:57.881778 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50162536-b251-4960-afec-b3b1511a8e98 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:51:57.882092 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50162536-b251-4960-afec-b3b1511a8e98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:51:57.883506 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50162536-b251-4960-afec-b3b1511a8e98 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:51:57.884504 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fffad2a-c4b2-417e-8c3f-c624a2702013 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:51:57.886051 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fffad2a-c4b2-417e-8c3f-c624a2702013 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:51:57.899126 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 8/15] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:51:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:51:57.904766 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50162536-b251-4960-afec-b3b1511a8e98 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:51:57.987516 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 8/16] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:51:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 08 11:51:57.992981 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fffad2a-c4b2-417e-8c3f-c624a2702013 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:51:57.995662 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:51:58.006547 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50162536-b251-4960-afec-b3b1511a8e98 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:51:58.041503 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9536e-8064-4e7d-8064-654bb41493f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:51:58.042377 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9536e-8064-4e7d-8064-654bb41493f2 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:51:58.042666 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9536e-8064-4e7d-8064-654bb41493f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:51:58.042944 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9536e-8064-4e7d-8064-654bb41493f2 None admin] PATH_INFO: `/v3/users/0451f9cd1a224f47a21e570061ffb155` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:51:58.044152 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e9536e-8064-4e7d-8064-654bb41493f2 None admin] RBAC: Authorizing `identity:get_user(user_id=0451f9cd1a224f47a21e570061ffb155)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:51:58.045963 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e9536e-8064-4e7d-8064-654bb41493f2 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:51:58.048193 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 9/17] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Jun 8 11:51:57 2022] GET /identity/v3/users/0451f9cd1a224f47a21e570061ffb155 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:51:58.053488 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9536e-8064-4e7d-8064-654bb41493f2 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:51:58.067889 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:51:58.094736 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fffad2a-c4b2-417e-8c3f-c624a2702013 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:51:58.128326 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b103f-80e8-4d1c-bdd2-b7c76231d911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:51:58.129128 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b103f-80e8-4d1c-bdd2-b7c76231d911 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:51:58.129413 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b103f-80e8-4d1c-bdd2-b7c76231d911 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:51:58.129700 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b103f-80e8-4d1c-bdd2-b7c76231d911 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:51:58.148160 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27b103f-80e8-4d1c-bdd2-b7c76231d911 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:51:58.149680 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27b103f-80e8-4d1c-bdd2-b7c76231d911 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:51:58.152637 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9536e-8064-4e7d-8064-654bb41493f2 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:51:58.170700 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-d27b103f-80e8-4d1c-bdd2-b7c76231d911 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:51:58.170700 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:51:58.170700 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:51:58.170700 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:51:58.170700 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:51:58.170700 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:51:58.170700 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:51:58.170700 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:51:58.170700 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:51:58.170700 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:51:58.170700 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:51:58.170700 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:51:58.170700 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:51:58.170700 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:51:58.170700 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:51:58.172303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:51:58.172303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:51:58.172303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:51:58.172303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:51:58.172303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:51:58.172303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:51:58.172303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:51:58.172303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:51:58.172303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:51:58.172303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:51:58.172303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:51:58.172303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:51:58.172303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:51:58.172303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:51:58.172303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:51:58.172303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:51:58.172303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:51:58.173104 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:51:58.173104 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:51:58.173104 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:51:58.173104 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:51:58.173104 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 9/18] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:51:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 11:51:58.178883 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b103f-80e8-4d1c-bdd2-b7c76231d911 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:51:58.195616 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de16089-65d8-47b8-a2f3-984243d4276d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:51:58.196779 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de16089-65d8-47b8-a2f3-984243d4276d None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:51:58.197288 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de16089-65d8-47b8-a2f3-984243d4276d None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:51:58.197791 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de16089-65d8-47b8-a2f3-984243d4276d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:51:58.199037 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de16089-65d8-47b8-a2f3-984243d4276d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:51:58.200979 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de16089-65d8-47b8-a2f3-984243d4276d None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:51:58.202716 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 10/19] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:51:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:51:58.210042 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de16089-65d8-47b8-a2f3-984243d4276d None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:51:58.240750 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:51:58.284374 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b103f-80e8-4d1c-bdd2-b7c76231d911 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:51:58.295600 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:51:58.316125 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de16089-65d8-47b8-a2f3-984243d4276d None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:51:58.319161 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062318f1-f056-4a7a-a792-f1a26a856604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:51:58.319836 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062318f1-f056-4a7a-a792-f1a26a856604 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:51:58.320134 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062318f1-f056-4a7a-a792-f1a26a856604 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:51:58.320445 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062318f1-f056-4a7a-a792-f1a26a856604 None admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:51:58.321182 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062318f1-f056-4a7a-a792-f1a26a856604 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:51:58.321493 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062318f1-f056-4a7a-a792-f1a26a856604 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:51:58.322932 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062318f1-f056-4a7a-a792-f1a26a856604 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:51:58.340534 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 10/20] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:51:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:51:58.350589 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d70fde5-d31e-458a-875c-94c6cb8cd468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:51:58.351282 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d70fde5-d31e-458a-875c-94c6cb8cd468 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:51:58.351569 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d70fde5-d31e-458a-875c-94c6cb8cd468 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:51:58.351850 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d70fde5-d31e-458a-875c-94c6cb8cd468 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:51:58.352748 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d70fde5-d31e-458a-875c-94c6cb8cd468 None admin] RBAC: Adding query filter params (role.id=028d4429a4554bbb88b3aec9f6a9d937, scope.domain.id=default, user.id=0451f9cd1a224f47a21e570061ffb155) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:51:58.353075 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d70fde5-d31e-458a-875c-94c6cb8cd468 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:51:58.354597 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d70fde5-d31e-458a-875c-94c6cb8cd468 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:51:58.362877 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 11/21] 10.222.0.39 () {56 vars in 1322 bytes} [Wed Jun 8 11:51:58 2022] GET /identity/v3/role_assignments?user.id=0451f9cd1a224f47a21e570061ffb155&scope.domain.id=default&role.id=028d4429a4554bbb88b3aec9f6a9d937 => generated 233 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:52:01.256397 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04270ee9-0f3b-4063-a21e-bf31ec77558d None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:01.257077 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04270ee9-0f3b-4063-a21e-bf31ec77558d None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:01.257608 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04270ee9-0f3b-4063-a21e-bf31ec77558d None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:01.259183 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 11/22] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:52:01.264433 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3ff48-9cd5-497b-8aa4-298e4c7a98dd None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:01.265727 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3ff48-9cd5-497b-8aa4-298e4c7a98dd None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:01.266290 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3ff48-9cd5-497b-8aa4-298e4c7a98dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:01.293159 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-b4f3ff48-9cd5-497b-8aa4-298e4c7a98dd None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:01.294696 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b4f3ff48-9cd5-497b-8aa4-298e4c7a98dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:01.361566 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab15ad5-713b-41e8-b976-7d788c8edd7f None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:01.362192 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab15ad5-713b-41e8-b976-7d788c8edd7f None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:01.362699 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab15ad5-713b-41e8-b976-7d788c8edd7f None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:01.364282 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 12/23] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 11:52:01.369659 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1d65e-108f-483d-9753-be170090507e None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:01.370186 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1d65e-108f-483d-9753-be170090507e None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:01.370705 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1d65e-108f-483d-9753-be170090507e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:01.388183 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 12/24] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:52:01.392863 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-47a1d65e-108f-483d-9753-be170090507e None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:01.394299 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-47a1d65e-108f-483d-9753-be170090507e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:01.441608 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3ff48-9cd5-497b-8aa4-298e4c7a98dd None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:01.504603 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 13/25] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 11:52:01.505967 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb3eb3-f1d1-4f06-a3ff-5c536ff0e72e None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:01.506262 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb3eb3-f1d1-4f06-a3ff-5c536ff0e72e None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:01.506597 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb3eb3-f1d1-4f06-a3ff-5c536ff0e72e None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:01.507984 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 14/26] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:52:01.517189 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0d387-6247-4f9b-a425-cff002be3fe6 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:01.517472 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0d387-6247-4f9b-a425-cff002be3fe6 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:01.517757 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0d387-6247-4f9b-a425-cff002be3fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:01.551897 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-8ba0d387-6247-4f9b-a425-cff002be3fe6 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:01.553140 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-8ba0d387-6247-4f9b-a425-cff002be3fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:01.583254 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:01.615667 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:01.616795 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3ff48-9cd5-497b-8aa4-298e4c7a98dd None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:01.650805 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 15/27] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:52:01.651972 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba0d387-6247-4f9b-a425-cff002be3fe6 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:01.654883 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7f414-f508-46ff-a88c-e3d15e947495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:01.655912 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7f414-f508-46ff-a88c-e3d15e947495 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:01.656481 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7f414-f508-46ff-a88c-e3d15e947495 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:01.656831 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7f414-f508-46ff-a88c-e3d15e947495 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:01.668254 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f7f414-f508-46ff-a88c-e3d15e947495 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:01.669998 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f7f414-f508-46ff-a88c-e3d15e947495 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:01.690204 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-08f7f414-f508-46ff-a88c-e3d15e947495 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:52:01.690204 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:52:01.690204 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:52:01.690204 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:52:01.690204 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:52:01.690204 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:52:01.690204 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:52:01.690204 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:52:01.690204 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:52:01.690204 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:52:01.690204 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:52:01.690204 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:52:01.690204 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:52:01.690204 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:52:01.690204 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:52:01.691071 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:52:01.691071 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:52:01.691071 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:52:01.691071 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:52:01.691071 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:52:01.691071 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:52:01.691071 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:52:01.691071 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:52:01.691071 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:52:01.691071 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:52:01.691071 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:52:01.691071 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:52:01.691071 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:52:01.691071 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:52:01.691071 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:52:01.691071 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:52:01.691071 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:52:01.691869 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:52:01.691869 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:52:01.691869 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:52:01.691869 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:52:01.693824 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 13/28] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:52:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 11:52:01.695370 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7bd7f-5c75-4fdc-afb7-4b924ba3a3e7 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:01.695910 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7bd7f-5c75-4fdc-afb7-4b924ba3a3e7 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:01.696425 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7bd7f-5c75-4fdc-afb7-4b924ba3a3e7 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:01.698181 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 14/29] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:52:01.703893 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7bd7f-5c75-4fdc-afb7-4b924ba3a3e7 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:01.770779 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba0d387-6247-4f9b-a425-cff002be3fe6 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:01.810700 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea35c888-0a0d-49b5-9193-207499ac0f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:01.811933 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35c888-0a0d-49b5-9193-207499ac0f14 None admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:01.812317 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35c888-0a0d-49b5-9193-207499ac0f14 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:01.812701 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35c888-0a0d-49b5-9193-207499ac0f14 None admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:01.813486 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea35c888-0a0d-49b5-9193-207499ac0f14 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:01.815661 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea35c888-0a0d-49b5-9193-207499ac0f14 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:01.848992 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7bd7f-5c75-4fdc-afb7-4b924ba3a3e7 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:01.876691 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:01.885706 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff3b41-81ad-4913-82f4-fc455cf774a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:01.886780 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff3b41-81ad-4913-82f4-fc455cf774a3 None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:01.887502 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff3b41-81ad-4913-82f4-fc455cf774a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:01.887789 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff3b41-81ad-4913-82f4-fc455cf774a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:01.888583 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bff3b41-81ad-4913-82f4-fc455cf774a3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:01.890341 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bff3b41-81ad-4913-82f4-fc455cf774a3 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:01.957690 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 16/30] 10.222.0.39 () {60 vars in 1131 bytes} [Wed Jun 8 11:52:01 2022] POST /identity/v3/roles => generated 225 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 11:52:01.958995 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea35c888-0a0d-49b5-9193-207499ac0f14 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:02.045026 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:02.081349 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 15/31] 10.222.0.39 () {60 vars in 1131 bytes} [Wed Jun 8 11:52:01 2022] POST /identity/v3/roles => generated 219 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 11:52:02.083437 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b57c22-65e6-4cf6-94c9-4318d4ee1021 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:02.083941 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b57c22-65e6-4cf6-94c9-4318d4ee1021 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:02.084450 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b57c22-65e6-4cf6-94c9-4318d4ee1021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:02.104150 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-07b57c22-65e6-4cf6-94c9-4318d4ee1021 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:02.106116 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-07b57c22-65e6-4cf6-94c9-4318d4ee1021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:02.210200 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 16/32] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:52:02.210929 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea35c888-0a0d-49b5-9193-207499ac0f14 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:02.211423 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f04870-bacb-4d74-a3fc-bdc42009a3c2 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:02.211728 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f04870-bacb-4d74-a3fc-bdc42009a3c2 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:02.212022 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f04870-bacb-4d74-a3fc-bdc42009a3c2 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:02.213451 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 17/33] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:52:02.219448 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af15ad18-3661-487f-ae53-56e3d01bc051 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:02.219737 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af15ad18-3661-487f-ae53-56e3d01bc051 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:02.220029 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af15ad18-3661-487f-ae53-56e3d01bc051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:02.251221 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-af15ad18-3661-487f-ae53-56e3d01bc051 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:02.258741 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-af15ad18-3661-487f-ae53-56e3d01bc051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:02.281065 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2476630-599b-488c-9a12-bc4527780381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:02.281765 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2476630-599b-488c-9a12-bc4527780381 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:02.282338 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2476630-599b-488c-9a12-bc4527780381 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:02.282626 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2476630-599b-488c-9a12-bc4527780381 None admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:02.283386 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2476630-599b-488c-9a12-bc4527780381 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:02.283704 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2476630-599b-488c-9a12-bc4527780381 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:02.285438 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2476630-599b-488c-9a12-bc4527780381 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:02.304514 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 17/34] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:52:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:02.305471 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2476630-599b-488c-9a12-bc4527780381 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:02.363085 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 18/35] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:52:02.364076 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af15ad18-3661-487f-ae53-56e3d01bc051 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:02.420121 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:02.421322 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:02.429710 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2476630-599b-488c-9a12-bc4527780381 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:02.472885 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1ab00-8583-4b99-a13d-b62b6e63646f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:02.473706 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1ab00-8583-4b99-a13d-b62b6e63646f None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:02.473998 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1ab00-8583-4b99-a13d-b62b6e63646f None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:02.474283 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1ab00-8583-4b99-a13d-b62b6e63646f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:02.483516 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af15ad18-3661-487f-ae53-56e3d01bc051 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:02.487549 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a1ab00-8583-4b99-a13d-b62b6e63646f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:52:02.496015 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-b9a1ab00-8583-4b99-a13d-b62b6e63646f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:52:02.496015 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:52:02.496015 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:52:02.496015 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:52:02.496015 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:52:02.496015 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:52:02.496015 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:52:02.496015 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:52:02.496015 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:52:02.496015 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:52:02.496015 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:52:02.496015 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:52:02.496015 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:52:02.496015 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:52:02.496015 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:52:02.496015 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:52:02.496918 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:52:02.496918 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:52:02.496918 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:52:02.496918 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:52:02.496918 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:52:02.496918 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:52:02.496918 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:52:02.496918 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:52:02.496918 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:52:02.496918 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:52:02.496918 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:52:02.496918 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:52:02.496918 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:52:02.496918 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:52:02.496918 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:52:02.496918 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:52:02.497661 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:52:02.497661 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:52:02.497661 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:52:02.497661 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:52:02.497661 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:52:02.497661 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:52:02.497661 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:52:02.497661 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:52:02.497661 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:52:02.497661 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:52:02.497661 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:52:02.497661 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:52:02.497661 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 18/36] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Jun 8 11:52:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:52:02.498306 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1ab00-8583-4b99-a13d-b62b6e63646f None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:02.538553 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f8140-a407-4bda-9407-c51fa81201b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:02.539854 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f8140-a407-4bda-9407-c51fa81201b2 None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:02.540330 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f8140-a407-4bda-9407-c51fa81201b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:02.540619 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f8140-a407-4bda-9407-c51fa81201b2 None admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:02.541431 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720f8140-a407-4bda-9407-c51fa81201b2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:02.544292 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720f8140-a407-4bda-9407-c51fa81201b2 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:02.578044 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 19/37] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Jun 8 11:52:02 2022] POST /identity/v3/projects => generated 301 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 11:52:02.578690 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f8140-a407-4bda-9407-c51fa81201b2 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:02.633678 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1ab00-8583-4b99-a13d-b62b6e63646f None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:02.675022 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13420d48-e22b-455a-b35a-68d6f42c33cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:02.675732 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13420d48-e22b-455a-b35a-68d6f42c33cf None admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:02.676024 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13420d48-e22b-455a-b35a-68d6f42c33cf None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:02.676333 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13420d48-e22b-455a-b35a-68d6f42c33cf None admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:02.677146 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13420d48-e22b-455a-b35a-68d6f42c33cf None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:02.678584 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13420d48-e22b-455a-b35a-68d6f42c33cf None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:02.696638 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 19/38] 10.222.0.39 () {60 vars in 1131 bytes} [Wed Jun 8 11:52:02 2022] POST /identity/v3/roles => generated 223 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 11:52:02.729231 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:02.735125 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f8140-a407-4bda-9407-c51fa81201b2 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:02.778357 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50672d2a-e6dd-4a68-aa35-d3560c90a123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:02.779448 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50672d2a-e6dd-4a68-aa35-d3560c90a123 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:02.779940 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50672d2a-e6dd-4a68-aa35-d3560c90a123 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:02.780991 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50672d2a-e6dd-4a68-aa35-d3560c90a123 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:02.781982 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50672d2a-e6dd-4a68-aa35-d3560c90a123 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:02.782526 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50672d2a-e6dd-4a68-aa35-d3560c90a123 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:02.784197 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50672d2a-e6dd-4a68-aa35-d3560c90a123 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:02.794351 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 20/39] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:52:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:02.801098 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13420d48-e22b-455a-b35a-68d6f42c33cf None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:02.824028 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:02.874288 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46551f1f-2287-468b-ae87-3d1a5ae6db91 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:02.874539 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46551f1f-2287-468b-ae87-3d1a5ae6db91 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:02.874782 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46551f1f-2287-468b-ae87-3d1a5ae6db91 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:02.876244 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 21/40] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 11:52:02.881929 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b071bee-fe9f-4d6c-bcd2-411fcb4c7ff3 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:02.882215 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b071bee-fe9f-4d6c-bcd2-411fcb4c7ff3 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:02.882502 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b071bee-fe9f-4d6c-bcd2-411fcb4c7ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:02.903034 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-4b071bee-fe9f-4d6c-bcd2-411fcb4c7ff3 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:02.904853 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-4b071bee-fe9f-4d6c-bcd2-411fcb4c7ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:02.930204 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13420d48-e22b-455a-b35a-68d6f42c33cf None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:02.969781 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb90ee0d-8834-46c3-92c6-44eb453f82e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:02.970678 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90ee0d-8834-46c3-92c6-44eb453f82e0 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:02.970972 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90ee0d-8834-46c3-92c6-44eb453f82e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:02.971258 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90ee0d-8834-46c3-92c6-44eb453f82e0 None admin] PATH_INFO: `/v3/users/0451f9cd1a224f47a21e570061ffb155` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:02.972921 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb90ee0d-8834-46c3-92c6-44eb453f82e0 None admin] RBAC: Authorizing `identity:get_user(user_id=0451f9cd1a224f47a21e570061ffb155)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:02.974441 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb90ee0d-8834-46c3-92c6-44eb453f82e0 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:02.976373 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 20/41] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Jun 8 11:52:02 2022] GET /identity/v3/users/0451f9cd1a224f47a21e570061ffb155 => generated 247 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:02.980364 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 22/42] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 11:52:02.982328 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb90ee0d-8834-46c3-92c6-44eb453f82e0 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:03.004738 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b071bee-fe9f-4d6c-bcd2-411fcb4c7ff3 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:03.066271 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:03.082672 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb90ee0d-8834-46c3-92c6-44eb453f82e0 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:03.092327 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:03.103332 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b071bee-fe9f-4d6c-bcd2-411fcb4c7ff3 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:03.116749 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8097d-5386-428c-aebc-1e3e6eba9c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:03.117549 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8097d-5386-428c-aebc-1e3e6eba9c68 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:03.117837 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8097d-5386-428c-aebc-1e3e6eba9c68 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:03.118119 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8097d-5386-428c-aebc-1e3e6eba9c68 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:03.119393 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f8097d-5386-428c-aebc-1e3e6eba9c68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:03.120890 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f8097d-5386-428c-aebc-1e3e6eba9c68 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:03.122506 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 21/43] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:52:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:03.128326 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8097d-5386-428c-aebc-1e3e6eba9c68 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:03.142045 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52355e-8505-4631-ab31-3b397ebb3f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:03.142846 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52355e-8505-4631-ab31-3b397ebb3f26 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:03.143135 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52355e-8505-4631-ab31-3b397ebb3f26 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:03.143412 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52355e-8505-4631-ab31-3b397ebb3f26 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:03.144621 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b52355e-8505-4631-ab31-3b397ebb3f26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:03.146067 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b52355e-8505-4631-ab31-3b397ebb3f26 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:03.147672 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 23/44] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:52:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:52:03.153112 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52355e-8505-4631-ab31-3b397ebb3f26 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:03.228422 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8097d-5386-428c-aebc-1e3e6eba9c68 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:03.251504 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52355e-8505-4631-ab31-3b397ebb3f26 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:03.261992 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4070f52-73be-40a1-a8b9-373724e6fbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:03.262938 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4070f52-73be-40a1-a8b9-373724e6fbd3 None admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:03.263224 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4070f52-73be-40a1-a8b9-373724e6fbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:03.263505 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4070f52-73be-40a1-a8b9-373724e6fbd3 None admin] PATH_INFO: `/v3/domains/default/users/0451f9cd1a224f47a21e570061ffb155/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:03.266300 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4070f52-73be-40a1-a8b9-373724e6fbd3 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=0451f9cd1a224f47a21e570061ffb155, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:03.267753 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4070f52-73be-40a1-a8b9-373724e6fbd3 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:03.283077 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 22/45] 10.222.0.39 () {58 vars in 1361 bytes} [Wed Jun 8 11:52:03 2022] PUT /identity/v3/domains/default/users/0451f9cd1a224f47a21e570061ffb155/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 11:52:03.286030 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ded47-2c20-4c5c-958f-e337ff170bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:03.286709 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ded47-2c20-4c5c-958f-e337ff170bb8 None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:03.286998 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ded47-2c20-4c5c-958f-e337ff170bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:03.287273 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ded47-2c20-4c5c-958f-e337ff170bb8 None admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:03.287991 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ded47-2c20-4c5c-958f-e337ff170bb8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:03.289506 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ded47-2c20-4c5c-958f-e337ff170bb8 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:03.317562 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 24/46] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Jun 8 11:52:03 2022] POST /identity/v3/projects => generated 312 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 11:52:05.549125 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6485e-00a3-4b04-af2d-4c5bc4fa590a None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:05.549647 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6485e-00a3-4b04-af2d-4c5bc4fa590a None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:05.549761 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6485e-00a3-4b04-af2d-4c5bc4fa590a None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:05.551056 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 23/47] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:52:05.556275 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d86128-cd0c-4dd0-9dfd-d73f8baa4031 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:05.556693 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d86128-cd0c-4dd0-9dfd-d73f8baa4031 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:05.556962 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d86128-cd0c-4dd0-9dfd-d73f8baa4031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:05.562748 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99fd12c-6461-4b41-ab41-94b5da10fd41 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:05.563042 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99fd12c-6461-4b41-ab41-94b5da10fd41 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:05.563321 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99fd12c-6461-4b41-ab41-94b5da10fd41 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:05.564795 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 24/48] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 11:52:05.569553 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5e8ca-20e6-493c-8847-cb62ff9cf2d9 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:05.569840 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5e8ca-20e6-493c-8847-cb62ff9cf2d9 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:05.570120 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5e8ca-20e6-493c-8847-cb62ff9cf2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:05.574582 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-a8d86128-cd0c-4dd0-9dfd-d73f8baa4031 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:05.576266 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a8d86128-cd0c-4dd0-9dfd-d73f8baa4031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:05.579966 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:05.587971 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-c0c5e8ca-20e6-493c-8847-cb62ff9cf2d9 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:05.591062 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-c0c5e8ca-20e6-493c-8847-cb62ff9cf2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:05.597702 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:05.649307 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 25/49] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:52:05.657930 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 25/50] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 11:52:05.672560 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d86128-cd0c-4dd0-9dfd-d73f8baa4031 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:05.681129 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c5e8ca-20e6-493c-8847-cb62ff9cf2d9 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:05.773056 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d86128-cd0c-4dd0-9dfd-d73f8baa4031 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:05.780415 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c5e8ca-20e6-493c-8847-cb62ff9cf2d9 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:05.806679 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2cd25-1e99-4117-8e0f-b7d8c5197b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:05.807410 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2cd25-1e99-4117-8e0f-b7d8c5197b13 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:05.807693 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2cd25-1e99-4117-8e0f-b7d8c5197b13 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:05.807968 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2cd25-1e99-4117-8e0f-b7d8c5197b13 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:05.813687 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727a4545-05c7-49cc-a75f-1dbce8c3fa92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:05.814599 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a4545-05c7-49cc-a75f-1dbce8c3fa92 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:05.814890 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a4545-05c7-49cc-a75f-1dbce8c3fa92 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:05.815170 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a4545-05c7-49cc-a75f-1dbce8c3fa92 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:05.815800 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:05.816407 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727a4545-05c7-49cc-a75f-1dbce8c3fa92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:05.818003 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727a4545-05c7-49cc-a75f-1dbce8c3fa92 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:05.819267 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d2cd25-1e99-4117-8e0f-b7d8c5197b13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:52:05.819632 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 26/51] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:52:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:52:05.825070 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727a4545-05c7-49cc-a75f-1dbce8c3fa92 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:05.827605 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-e8d2cd25-1e99-4117-8e0f-b7d8c5197b13 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:52:05.827605 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:52:05.827605 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:52:05.827605 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:52:05.827605 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:52:05.827605 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:52:05.827605 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:52:05.827605 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:52:05.827605 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:52:05.827605 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:52:05.827605 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:52:05.827605 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:52:05.827605 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:52:05.827605 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:52:05.827605 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:52:05.827605 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:52:05.828529 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:52:05.828529 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:52:05.828529 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:52:05.828529 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:52:05.828529 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:52:05.828529 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:52:05.828529 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:52:05.828529 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:52:05.828529 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:52:05.828529 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:52:05.828529 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:52:05.828529 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:52:05.828529 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:52:05.828529 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:52:05.828529 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:52:05.828529 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:52:05.829292 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:52:05.829292 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:52:05.829292 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:52:05.829292 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:52:05.829292 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:52:05.829292 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:52:05.829292 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:52:05.829292 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:52:05.829292 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:52:05.829292 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:52:05.829292 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:52:05.829292 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:52:05.829292 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 26/52] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Jun 8 11:52:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:52:05.834443 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2cd25-1e99-4117-8e0f-b7d8c5197b13 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:05.839646 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:05.930214 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727a4545-05c7-49cc-a75f-1dbce8c3fa92 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:05.934413 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2cd25-1e99-4117-8e0f-b7d8c5197b13 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:05.963947 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb0d70b-1696-4633-b39b-2dd5343d2d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:05.964649 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0d70b-1696-4633-b39b-2dd5343d2d1e None admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:05.964937 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0d70b-1696-4633-b39b-2dd5343d2d1e None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:05.965219 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0d70b-1696-4633-b39b-2dd5343d2d1e None admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:05.965935 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb0d70b-1696-4633-b39b-2dd5343d2d1e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:05.967425 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb0d70b-1696-4633-b39b-2dd5343d2d1e None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:05.969352 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c20150-8b3d-4474-83be-0af3cc15ef4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:05.970024 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c20150-8b3d-4474-83be-0af3cc15ef4e None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:05.970309 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c20150-8b3d-4474-83be-0af3cc15ef4e None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:05.970588 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c20150-8b3d-4474-83be-0af3cc15ef4e None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:05.971513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c20150-8b3d-4474-83be-0af3cc15ef4e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:05.972129 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c20150-8b3d-4474-83be-0af3cc15ef4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:05.973546 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c20150-8b3d-4474-83be-0af3cc15ef4e None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:05.981913 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 27/53] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:52:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:52:05.989075 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c20150-8b3d-4474-83be-0af3cc15ef4e None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:05.996395 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 27/54] 10.222.0.39 () {60 vars in 1140 bytes} [Wed Jun 8 11:52:05 2022] POST /identity/v3/projects => generated 298 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 11:52:06.054780 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:06.096724 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c20150-8b3d-4474-83be-0af3cc15ef4e None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:06.132806 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7d05f-5e46-4fa6-8d4a-32e4ea353d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:06.133739 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7d05f-5e46-4fa6-8d4a-32e4ea353d23 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:06.134028 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7d05f-5e46-4fa6-8d4a-32e4ea353d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:06.134312 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7d05f-5e46-4fa6-8d4a-32e4ea353d23 None admin] PATH_INFO: `/v3/users/0451f9cd1a224f47a21e570061ffb155` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:06.135574 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb7d05f-5e46-4fa6-8d4a-32e4ea353d23 None admin] RBAC: Authorizing `identity:get_user(user_id=0451f9cd1a224f47a21e570061ffb155)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:06.137093 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb7d05f-5e46-4fa6-8d4a-32e4ea353d23 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:06.138813 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 28/55] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Jun 8 11:52:05 2022] GET /identity/v3/users/0451f9cd1a224f47a21e570061ffb155 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:06.144504 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb0d70b-1696-4633-b39b-2dd5343d2d1e None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:06.208593 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:06.249810 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb0d70b-1696-4633-b39b-2dd5343d2d1e None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:06.282459 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7dee9-94cc-4b1d-8207-484b7b5693f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:06.283258 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7dee9-94cc-4b1d-8207-484b7b5693f1 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:06.283544 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7dee9-94cc-4b1d-8207-484b7b5693f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:06.283822 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7dee9-94cc-4b1d-8207-484b7b5693f1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:06.285011 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c7dee9-94cc-4b1d-8207-484b7b5693f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:06.286472 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c7dee9-94cc-4b1d-8207-484b7b5693f1 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:06.288078 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 28/56] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:52:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:06.293812 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7d05f-5e46-4fa6-8d4a-32e4ea353d23 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:06.395032 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7d05f-5e46-4fa6-8d4a-32e4ea353d23 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:06.423434 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:06.429767 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb319c-4b0a-43c8-8c88-4112522c660d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:06.430438 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb319c-4b0a-43c8-8c88-4112522c660d None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:06.430726 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb319c-4b0a-43c8-8c88-4112522c660d None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:06.431007 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb319c-4b0a-43c8-8c88-4112522c660d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:06.431843 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bb319c-4b0a-43c8-8c88-4112522c660d None admin] RBAC: Adding query filter params (role.id=028d4429a4554bbb88b3aec9f6a9d937, scope.domain.id=default, user.id=0451f9cd1a224f47a21e570061ffb155) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:06.432160 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bb319c-4b0a-43c8-8c88-4112522c660d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:06.433628 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bb319c-4b0a-43c8-8c88-4112522c660d None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:06.440185 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 29/57] 10.222.0.39 () {56 vars in 1322 bytes} [Wed Jun 8 11:52:06 2022] GET /identity/v3/role_assignments?user.id=0451f9cd1a224f47a21e570061ffb155&scope.domain.id=default&role.id=028d4429a4554bbb88b3aec9f6a9d937 => generated 530 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:08.292580 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db42d6-eba3-466c-9064-4bebb66e72ee None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:08.293128 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db42d6-eba3-466c-9064-4bebb66e72ee None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:08.293128 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db42d6-eba3-466c-9064-4bebb66e72ee None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:08.294490 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 29/58] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:52:08.299749 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754ede4-e8ba-4bec-8846-2a1b0a232b5b None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:08.300152 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754ede4-e8ba-4bec-8846-2a1b0a232b5b None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:08.300329 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754ede4-e8ba-4bec-8846-2a1b0a232b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:08.316754 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-8754ede4-e8ba-4bec-8846-2a1b0a232b5b None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:08.317947 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-8754ede4-e8ba-4bec-8846-2a1b0a232b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:08.382863 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 30/59] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:52:08.408308 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db42d6-eba3-466c-9064-4bebb66e72ee None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:08.525084 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db42d6-eba3-466c-9064-4bebb66e72ee None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:08.553374 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:08.559092 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce7c27e-a3b8-4c2e-b60b-c448a42fcf2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:08.559887 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7c27e-a3b8-4c2e-b60b-c448a42fcf2f None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:08.560190 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7c27e-a3b8-4c2e-b60b-c448a42fcf2f None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:08.560478 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7c27e-a3b8-4c2e-b60b-c448a42fcf2f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:08.561690 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce7c27e-a3b8-4c2e-b60b-c448a42fcf2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:08.563141 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce7c27e-a3b8-4c2e-b60b-c448a42fcf2f None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:08.564775 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 30/60] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:52:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:08.570269 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754ede4-e8ba-4bec-8846-2a1b0a232b5b None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:08.666144 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754ede4-e8ba-4bec-8846-2a1b0a232b5b None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:08.689000 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:08.700020 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c643964-ec34-4a00-ad10-e245f49327ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:08.700723 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c643964-ec34-4a00-ad10-e245f49327ed None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:08.701015 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c643964-ec34-4a00-ad10-e245f49327ed None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:08.701297 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c643964-ec34-4a00-ad10-e245f49327ed None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:08.702083 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c643964-ec34-4a00-ad10-e245f49327ed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:08.703522 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c643964-ec34-4a00-ad10-e245f49327ed None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:08.728220 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 31/61] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Jun 8 11:52:08 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 11:52:11.969503 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192ef32-30e4-4ab3-8ff1-3b21a8c59c4b None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:11.970484 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192ef32-30e4-4ab3-8ff1-3b21a8c59c4b None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:11.970984 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192ef32-30e4-4ab3-8ff1-3b21a8c59c4b None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:11.972596 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 31/62] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:52:11.978263 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63eca48-2275-4c72-9c75-f5430642fef5 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:11.978651 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63eca48-2275-4c72-9c75-f5430642fef5 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:11.978845 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63eca48-2275-4c72-9c75-f5430642fef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:12.008369 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-c63eca48-2275-4c72-9c75-f5430642fef5 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:12.009594 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-c63eca48-2275-4c72-9c75-f5430642fef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:12.109727 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 32/63] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:52:12.148983 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192ef32-30e4-4ab3-8ff1-3b21a8c59c4b None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:12.215447 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1789a2-a337-42ce-9eb0-fd297d1c4bfa None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:12.216081 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1789a2-a337-42ce-9eb0-fd297d1c4bfa None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:12.216595 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1789a2-a337-42ce-9eb0-fd297d1c4bfa None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:12.218829 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 33/64] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:52:12.224666 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c29a2d-00cd-480f-bbc3-86184e4f09d7 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:12.225448 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c29a2d-00cd-480f-bbc3-86184e4f09d7 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:12.225934 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c29a2d-00cd-480f-bbc3-86184e4f09d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:12.255643 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-b1c29a2d-00cd-480f-bbc3-86184e4f09d7 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:12.257779 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b1c29a2d-00cd-480f-bbc3-86184e4f09d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:12.314809 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192ef32-30e4-4ab3-8ff1-3b21a8c59c4b None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:12.353730 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe57bb5-c068-4e85-856d-439b70c2b113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:12.354921 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe57bb5-c068-4e85-856d-439b70c2b113 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:12.355413 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe57bb5-c068-4e85-856d-439b70c2b113 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:12.355647 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 34/65] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 11:52:12.357255 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd47495d-67f4-4c99-84b4-4e5f666f385a None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:12.358386 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd47495d-67f4-4c99-84b4-4e5f666f385a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:12.359013 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd47495d-67f4-4c99-84b4-4e5f666f385a None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:12.360520 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 35/66] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:52:12.360621 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe57bb5-c068-4e85-856d-439b70c2b113 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:12.368190 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d02604-5ae3-4534-a458-14582b022453 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:12.368190 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d02604-5ae3-4534-a458-14582b022453 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:12.368190 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d02604-5ae3-4534-a458-14582b022453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:12.381209 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe57bb5-c068-4e85-856d-439b70c2b113 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:52:12.389696 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-afe57bb5-c068-4e85-856d-439b70c2b113 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 11:52:12.389696 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:52:12.389696 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:52:12.389696 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:52:12.389696 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:52:12.389696 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:52:12.389696 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:52:12.389696 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:52:12.389696 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:52:12.389696 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:52:12.389696 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:52:12.389696 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:52:12.389696 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:52:12.389696 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:52:12.389696 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:52:12.389696 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:52:12.390563 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:52:12.390563 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:52:12.390563 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:52:12.390563 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:52:12.390563 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:52:12.390563 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:52:12.390563 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:52:12.390563 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:52:12.390563 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:52:12.390563 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:52:12.390563 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:52:12.390563 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:52:12.390563 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:52:12.390563 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:52:12.390563 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:52:12.390563 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:52:12.391335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:52:12.391335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:52:12.391335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:52:12.391335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:52:12.391335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:52:12.391335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:52:12.391335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:52:12.391335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:52:12.391335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:52:12.391335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:52:12.391335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 11:52:12.391335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:52:12.394090 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 32/67] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:52:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:52:12.395241 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe57bb5-c068-4e85-856d-439b70c2b113 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:12.396386 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-77d02604-5ae3-4534-a458-14582b022453 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:12.397592 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-77d02604-5ae3-4534-a458-14582b022453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:12.447172 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:12.471003 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:12.501104 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 36/68] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:52:12.502434 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d02604-5ae3-4534-a458-14582b022453 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:12.548963 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe57bb5-c068-4e85-856d-439b70c2b113 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:12.599133 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df1979f-c070-4ed8-b14b-f5fdd1d8d46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:12.600493 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1979f-c070-4ed8-b14b-f5fdd1d8d46c None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:12.600955 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1979f-c070-4ed8-b14b-f5fdd1d8d46c None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:12.601405 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1979f-c070-4ed8-b14b-f5fdd1d8d46c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:12.613904 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df1979f-c070-4ed8-b14b-f5fdd1d8d46c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:52:12.622647 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-7df1979f-c070-4ed8-b14b-f5fdd1d8d46c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 11:52:12.622647 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:52:12.622647 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:52:12.622647 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:52:12.622647 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:52:12.622647 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:52:12.622647 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:52:12.622647 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:52:12.622647 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:52:12.622647 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:52:12.622647 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:52:12.622647 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:52:12.622647 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:52:12.622647 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:52:12.622647 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:52:12.622647 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:52:12.623632 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:52:12.623632 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:52:12.623632 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:52:12.623632 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:52:12.623632 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:52:12.623632 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:52:12.623632 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:52:12.623632 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:52:12.623632 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:52:12.623632 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:52:12.623632 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:52:12.623632 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:52:12.623632 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:52:12.623632 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:52:12.623632 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:52:12.623632 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:52:12.624540 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:52:12.624540 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:52:12.624540 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:52:12.624540 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:52:12.624540 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:52:12.624540 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:52:12.624540 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:52:12.624540 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:52:12.624540 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:52:12.624540 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:52:12.624540 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 11:52:12.624540 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:52:12.634514 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 33/69] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Jun 8 11:52:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:52:12.635732 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df1979f-c070-4ed8-b14b-f5fdd1d8d46c None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:12.637844 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d02604-5ae3-4534-a458-14582b022453 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:12.684254 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e887c3-92e2-4885-98c2-f7ff44f1e3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:12.685849 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e887c3-92e2-4885-98c2-f7ff44f1e3a7 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:12.686397 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e887c3-92e2-4885-98c2-f7ff44f1e3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:12.686827 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e887c3-92e2-4885-98c2-f7ff44f1e3a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:12.687989 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e887c3-92e2-4885-98c2-f7ff44f1e3a7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:12.688476 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e887c3-92e2-4885-98c2-f7ff44f1e3a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:12.690870 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e887c3-92e2-4885-98c2-f7ff44f1e3a7 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:12.703467 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 37/70] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Jun 8 11:52:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:12.704919 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e887c3-92e2-4885-98c2-f7ff44f1e3a7 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:12.747352 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:12.750637 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df1979f-c070-4ed8-b14b-f5fdd1d8d46c None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:12.771544 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:12.796422 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d2eaeb-1a3d-42c9-9dac-fb5e7e5b69eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:12.797748 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d2eaeb-1a3d-42c9-9dac-fb5e7e5b69eb None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:12.798261 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d2eaeb-1a3d-42c9-9dac-fb5e7e5b69eb None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:12.798809 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d2eaeb-1a3d-42c9-9dac-fb5e7e5b69eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:12.810547 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d2eaeb-1a3d-42c9-9dac-fb5e7e5b69eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:52:12.819564 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-21d2eaeb-1a3d-42c9-9dac-fb5e7e5b69eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:52:12.819564 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:52:12.819564 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:52:12.819564 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:52:12.819564 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:52:12.819564 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:52:12.819564 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:52:12.819564 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:52:12.819564 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:52:12.819564 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:52:12.819564 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:52:12.819564 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:52:12.819564 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:52:12.819564 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:52:12.819564 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:52:12.819564 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:52:12.820657 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:52:12.820657 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:52:12.820657 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:52:12.820657 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:52:12.820657 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:52:12.820657 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:52:12.820657 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:52:12.820657 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:52:12.820657 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:52:12.820657 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:52:12.820657 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:52:12.820657 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:52:12.820657 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:52:12.820657 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:52:12.820657 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:52:12.820657 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:52:12.821426 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:52:12.821426 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:52:12.821426 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:52:12.821426 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:52:12.821426 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:52:12.821426 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:52:12.821426 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:52:12.821426 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:52:12.821426 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:52:12.821426 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:52:12.821426 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:52:12.821426 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:52:12.829071 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 34/71] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Jun 8 11:52:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:52:12.829071 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d2eaeb-1a3d-42c9-9dac-fb5e7e5b69eb None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:12.839623 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e887c3-92e2-4885-98c2-f7ff44f1e3a7 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:12.877720 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f35b8be-0768-45b5-864c-17fa379c59dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:12.878458 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35b8be-0768-45b5-864c-17fa379c59dc None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:12.878727 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35b8be-0768-45b5-864c-17fa379c59dc None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:12.879011 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35b8be-0768-45b5-864c-17fa379c59dc None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:12.879769 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f35b8be-0768-45b5-864c-17fa379c59dc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:12.880085 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f35b8be-0768-45b5-864c-17fa379c59dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:12.881514 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f35b8be-0768-45b5-864c-17fa379c59dc None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:12.889566 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 38/72] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Jun 8 11:52:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:12.890789 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a0a98b-e727-4ea8-9d6a-80b6b0a4f320 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:12.891083 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a0a98b-e727-4ea8-9d6a-80b6b0a4f320 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:12.891364 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a0a98b-e727-4ea8-9d6a-80b6b0a4f320 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:12.892631 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 39/73] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:52:12.893328 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a0a98b-e727-4ea8-9d6a-80b6b0a4f320 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:12.935357 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d2eaeb-1a3d-42c9-9dac-fb5e7e5b69eb None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:12.969015 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c51a8b-aba6-45e9-8650-bc86cf9784c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:12.969889 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c51a8b-aba6-45e9-8650-bc86cf9784c5 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:12.970420 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c51a8b-aba6-45e9-8650-bc86cf9784c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:12.970420 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c51a8b-aba6-45e9-8650-bc86cf9784c5 None admin] PATH_INFO: `/v3/users/1541e9b140b0436399c5ed9a4362ef6b` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:12.985692 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c51a8b-aba6-45e9-8650-bc86cf9784c5 None admin] RBAC: Authorizing `identity:get_user(user_id=1541e9b140b0436399c5ed9a4362ef6b)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:12.987163 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c51a8b-aba6-45e9-8650-bc86cf9784c5 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:12.988869 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 35/74] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Jun 8 11:52:12 2022] GET /identity/v3/users/1541e9b140b0436399c5ed9a4362ef6b => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:12.989320 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:12.990180 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf43a2-9a0e-4e75-a284-493088797081 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:12.990472 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf43a2-9a0e-4e75-a284-493088797081 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:12.990763 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf43a2-9a0e-4e75-a284-493088797081 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:12.992147 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 36/75] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:52:12.992877 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf43a2-9a0e-4e75-a284-493088797081 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:13.003300 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a0a98b-e727-4ea8-9d6a-80b6b0a4f320 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:13.028191 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:13.037792 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd3899b-2c49-4b6e-a673-0e4c4e8175ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:13.038467 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd3899b-2c49-4b6e-a673-0e4c4e8175ac None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:13.038752 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd3899b-2c49-4b6e-a673-0e4c4e8175ac None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:13.039028 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd3899b-2c49-4b6e-a673-0e4c4e8175ac None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:13.039776 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd3899b-2c49-4b6e-a673-0e4c4e8175ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:13.040084 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd3899b-2c49-4b6e-a673-0e4c4e8175ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:13.041508 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd3899b-2c49-4b6e-a673-0e4c4e8175ac None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:13.050095 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 40/76] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:52:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:13.051276 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1704f-9d5f-4298-92de-4f40695cbad9 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:13.051565 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1704f-9d5f-4298-92de-4f40695cbad9 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:13.051842 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1704f-9d5f-4298-92de-4f40695cbad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:13.067620 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-beb1704f-9d5f-4298-92de-4f40695cbad9 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:13.068809 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-beb1704f-9d5f-4298-92de-4f40695cbad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:13.100409 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf43a2-9a0e-4e75-a284-493088797081 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:13.134387 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c0046-dcea-46e9-9058-bff802492dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:13.134865 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 41/77] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:52:13.135265 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c0046-dcea-46e9-9058-bff802492dd9 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:13.135554 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c0046-dcea-46e9-9058-bff802492dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:13.135723 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb1704f-9d5f-4298-92de-4f40695cbad9 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:13.135984 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c0046-dcea-46e9-9058-bff802492dd9 None admin] PATH_INFO: `/v3/users/1541e9b140b0436399c5ed9a4362ef6b` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:13.137078 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04c0046-dcea-46e9-9058-bff802492dd9 None admin] RBAC: Authorizing `identity:get_user(user_id=1541e9b140b0436399c5ed9a4362ef6b)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:13.138551 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04c0046-dcea-46e9-9058-bff802492dd9 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:13.140893 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 37/78] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Jun 8 11:52:12 2022] GET /identity/v3/users/1541e9b140b0436399c5ed9a4362ef6b => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:13.145406 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c367dc-35ec-4bde-b94d-07a71936685d None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:13.145695 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c367dc-35ec-4bde-b94d-07a71936685d None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:13.145974 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c367dc-35ec-4bde-b94d-07a71936685d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:13.164000 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-a7c367dc-35ec-4bde-b94d-07a71936685d None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:13.165246 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-a7c367dc-35ec-4bde-b94d-07a71936685d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:13.233266 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 38/79] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:52:13.234093 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c367dc-35ec-4bde-b94d-07a71936685d None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:13.235978 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:13.254559 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb1704f-9d5f-4298-92de-4f40695cbad9 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:13.270399 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:13.289542 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fcfe51-c8eb-42b7-9dc7-00ea677ba07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:13.290133 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fcfe51-c8eb-42b7-9dc7-00ea677ba07c None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:13.290432 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fcfe51-c8eb-42b7-9dc7-00ea677ba07c None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:13.290715 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fcfe51-c8eb-42b7-9dc7-00ea677ba07c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:13.338110 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c367dc-35ec-4bde-b94d-07a71936685d None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:13.360325 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fcfe51-c8eb-42b7-9dc7-00ea677ba07c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:13.361816 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fcfe51-c8eb-42b7-9dc7-00ea677ba07c None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:13.372302 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3fbf9a-3f5d-4505-a49d-157dbc211d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:13.373765 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fbf9a-3f5d-4505-a49d-157dbc211d27 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:13.374059 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fbf9a-3f5d-4505-a49d-157dbc211d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:13.374342 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fbf9a-3f5d-4505-a49d-157dbc211d27 None admin] PATH_INFO: `/v3/users/0451f9cd1a224f47a21e570061ffb155` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:13.375537 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3fbf9a-3f5d-4505-a49d-157dbc211d27 None admin] RBAC: Authorizing `identity:get_user(user_id=0451f9cd1a224f47a21e570061ffb155)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:13.377010 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3fbf9a-3f5d-4505-a49d-157dbc211d27 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:13.378624 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 39/80] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Jun 8 11:52:13 2022] GET /identity/v3/users/0451f9cd1a224f47a21e570061ffb155 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:13.379406 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3fbf9a-3f5d-4505-a49d-157dbc211d27 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:13.449018 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:13.465296 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 42/81] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:52:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 11:52:13.465949 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fcfe51-c8eb-42b7-9dc7-00ea677ba07c None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:13.481608 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3fbf9a-3f5d-4505-a49d-157dbc211d27 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:13.483828 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:13.517396 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc7a73-b9f1-4235-b2d1-466d510ab1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:13.518061 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc7a73-b9f1-4235-b2d1-466d510ab1af None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:13.518349 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc7a73-b9f1-4235-b2d1-466d510ab1af None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:13.518630 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc7a73-b9f1-4235-b2d1-466d510ab1af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:13.570721 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fcfe51-c8eb-42b7-9dc7-00ea677ba07c None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:13.591519 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fc7a73-b9f1-4235-b2d1-466d510ab1af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:13.593960 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fc7a73-b9f1-4235-b2d1-466d510ab1af None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:13.605819 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88edace7-35e2-4fbe-96a2-ccc644c8399a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:13.606625 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88edace7-35e2-4fbe-96a2-ccc644c8399a None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:13.606911 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88edace7-35e2-4fbe-96a2-ccc644c8399a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:13.607197 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88edace7-35e2-4fbe-96a2-ccc644c8399a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:13.617522 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88edace7-35e2-4fbe-96a2-ccc644c8399a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:52:13.625358 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-88edace7-35e2-4fbe-96a2-ccc644c8399a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 11:52:13.625358 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:52:13.625358 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:52:13.625358 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:52:13.625358 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:52:13.625358 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:52:13.625358 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:52:13.625358 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:52:13.625358 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:52:13.625358 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:52:13.625358 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:52:13.625358 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:52:13.625358 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:52:13.625358 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:52:13.625358 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:52:13.625358 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:52:13.626196 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:52:13.626196 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:52:13.626196 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:52:13.626196 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:52:13.626196 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:52:13.626196 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:52:13.626196 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:52:13.626196 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:52:13.626196 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:52:13.626196 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:52:13.626196 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:52:13.626196 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:52:13.626196 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:52:13.626196 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:52:13.626196 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:52:13.626196 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:52:13.627183 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:52:13.627183 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:52:13.627183 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:52:13.627183 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:52:13.627183 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:52:13.627183 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:52:13.627183 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:52:13.627183 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:52:13.627183 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:52:13.627183 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:52:13.627183 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 11:52:13.627183 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:52:13.627183 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 43/82] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:52:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:52:13.628041 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88edace7-35e2-4fbe-96a2-ccc644c8399a None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:13.674298 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:13.699296 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 40/83] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:52:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 11:52:13.700149 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc7a73-b9f1-4235-b2d1-466d510ab1af None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:13.702978 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:13.731458 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88edace7-35e2-4fbe-96a2-ccc644c8399a None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:13.765880 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837417d5-554c-46b6-8cb8-7b3541c01ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:13.766676 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837417d5-554c-46b6-8cb8-7b3541c01ead None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:13.766970 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837417d5-554c-46b6-8cb8-7b3541c01ead None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:13.767255 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837417d5-554c-46b6-8cb8-7b3541c01ead None admin] PATH_INFO: `/v3/domains/default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:13.768461 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837417d5-554c-46b6-8cb8-7b3541c01ead None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:13.769945 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837417d5-554c-46b6-8cb8-7b3541c01ead None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:13.771562 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 44/84] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:52:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:13.772360 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837417d5-554c-46b6-8cb8-7b3541c01ead None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:13.801630 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc7a73-b9f1-4235-b2d1-466d510ab1af None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:13.835895 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd9cf4f-456b-48cc-8906-96187bcea0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:13.836589 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9cf4f-456b-48cc-8906-96187bcea0a9 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:13.836884 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9cf4f-456b-48cc-8906-96187bcea0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:13.837171 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9cf4f-456b-48cc-8906-96187bcea0a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:13.871654 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837417d5-554c-46b6-8cb8-7b3541c01ead None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:13.886454 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:13.906156 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd9cf4f-456b-48cc-8906-96187bcea0a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:13.907656 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c6063c-20a7-4e37-8bfc-a34ce30a0e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:13.907928 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd9cf4f-456b-48cc-8906-96187bcea0a9 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:13.908553 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6063c-20a7-4e37-8bfc-a34ce30a0e66 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:13.908839 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6063c-20a7-4e37-8bfc-a34ce30a0e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:13.909114 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6063c-20a7-4e37-8bfc-a34ce30a0e66 None admin] PATH_INFO: `/v3/projects/8d69c66b67494123b35f0b9eeaf0f02b` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:13.909827 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:13.910276 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c6063c-20a7-4e37-8bfc-a34ce30a0e66 None admin] RBAC: Authorizing `identity:get_project(project_id=8d69c66b67494123b35f0b9eeaf0f02b)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:13.911926 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c6063c-20a7-4e37-8bfc-a34ce30a0e66 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:13.913722 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 45/85] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Jun 8 11:52:13 2022] GET /identity/v3/projects/8d69c66b67494123b35f0b9eeaf0f02b => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:13.914675 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c6063c-20a7-4e37-8bfc-a34ce30a0e66 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:14.010376 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 41/86] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:52:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 11:52:14.011224 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd9cf4f-456b-48cc-8906-96187bcea0a9 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:14.022874 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c6063c-20a7-4e37-8bfc-a34ce30a0e66 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:14.057174 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4f24a-55ec-43fa-9f03-60f1ac3f20b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:14.057845 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4f24a-55ec-43fa-9f03-60f1ac3f20b1 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:14.058134 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4f24a-55ec-43fa-9f03-60f1ac3f20b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:14.058415 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4f24a-55ec-43fa-9f03-60f1ac3f20b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:14.059170 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e4f24a-55ec-43fa-9f03-60f1ac3f20b1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:14.059479 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e4f24a-55ec-43fa-9f03-60f1ac3f20b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:14.060898 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e4f24a-55ec-43fa-9f03-60f1ac3f20b1 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:14.069155 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 46/87] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Jun 8 11:52:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:14.069726 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4f24a-55ec-43fa-9f03-60f1ac3f20b1 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:14.109141 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd9cf4f-456b-48cc-8906-96187bcea0a9 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:14.110572 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:14.115759 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:14.144407 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ee59fe-0938-43cd-abfb-4ee3f7170274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:14.145265 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee59fe-0938-43cd-abfb-4ee3f7170274 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:14.145551 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee59fe-0938-43cd-abfb-4ee3f7170274 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:14.145834 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee59fe-0938-43cd-abfb-4ee3f7170274 None admin] PATH_INFO: `/v3/projects/8d69c66b67494123b35f0b9eeaf0f02b` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:14.147027 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ee59fe-0938-43cd-abfb-4ee3f7170274 None admin] RBAC: Authorizing `identity:get_project(project_id=8d69c66b67494123b35f0b9eeaf0f02b)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:14.148520 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ee59fe-0938-43cd-abfb-4ee3f7170274 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:14.150229 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 42/88] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Jun 8 11:52:14 2022] GET /identity/v3/projects/8d69c66b67494123b35f0b9eeaf0f02b => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:14.150993 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ee59fe-0938-43cd-abfb-4ee3f7170274 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:14.170727 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4f24a-55ec-43fa-9f03-60f1ac3f20b1 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:14.204212 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a9ef1f-d6a7-4b28-90a3-fcc2f67c3f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:14.204893 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9ef1f-d6a7-4b28-90a3-fcc2f67c3f2e None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:14.205183 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9ef1f-d6a7-4b28-90a3-fcc2f67c3f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:14.205456 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9ef1f-d6a7-4b28-90a3-fcc2f67c3f2e None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:14.206168 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a9ef1f-d6a7-4b28-90a3-fcc2f67c3f2e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:14.207596 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a9ef1f-d6a7-4b28-90a3-fcc2f67c3f2e None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:14.227179 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 47/89] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Jun 8 11:52:14 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 11:52:14.227997 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a9ef1f-d6a7-4b28-90a3-fcc2f67c3f2e None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:14.253386 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ee59fe-0938-43cd-abfb-4ee3f7170274 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:14.294808 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24133e1d-0e4d-4fcf-9099-de7356aad395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:14.295594 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24133e1d-0e4d-4fcf-9099-de7356aad395 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:14.296483 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24133e1d-0e4d-4fcf-9099-de7356aad395 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:14.296483 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24133e1d-0e4d-4fcf-9099-de7356aad395 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:14.297053 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24133e1d-0e4d-4fcf-9099-de7356aad395 None admin] RBAC: Adding query filter params (role.id=3682372ab3c145ba87e8baa5c520625f, scope.project.id=8d69c66b67494123b35f0b9eeaf0f02b, user.id=1541e9b140b0436399c5ed9a4362ef6b) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:14.297377 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24133e1d-0e4d-4fcf-9099-de7356aad395 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:14.298889 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24133e1d-0e4d-4fcf-9099-de7356aad395 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:14.307385 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 43/90] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Jun 8 11:52:14 2022] GET /identity/v3/role_assignments?user.id=1541e9b140b0436399c5ed9a4362ef6b&scope.project.id=8d69c66b67494123b35f0b9eeaf0f02b&role.id=3682372ab3c145ba87e8baa5c520625f => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:14.308367 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24133e1d-0e4d-4fcf-9099-de7356aad395 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:14.362057 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:14.372609 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:14.380942 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a9ef1f-d6a7-4b28-90a3-fcc2f67c3f2e None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:14.438401 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f18f7a-520c-4df9-8dbc-32bfc3176620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:14.439732 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f18f7a-520c-4df9-8dbc-32bfc3176620 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:14.440292 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f18f7a-520c-4df9-8dbc-32bfc3176620 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:14.441690 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f18f7a-520c-4df9-8dbc-32bfc3176620 None admin] PATH_INFO: `/v3/projects/8d69c66b67494123b35f0b9eeaf0f02b` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:14.443365 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f18f7a-520c-4df9-8dbc-32bfc3176620 None admin] RBAC: Authorizing `identity:get_project(project_id=8d69c66b67494123b35f0b9eeaf0f02b)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:14.446196 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f18f7a-520c-4df9-8dbc-32bfc3176620 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:14.448501 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 48/91] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Jun 8 11:52:14 2022] GET /identity/v3/projects/8d69c66b67494123b35f0b9eeaf0f02b => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:14.449249 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f18f7a-520c-4df9-8dbc-32bfc3176620 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:14.460453 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24133e1d-0e4d-4fcf-9099-de7356aad395 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:14.504000 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98b8d2-bd03-43b5-8830-44efa1b5c6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:14.505316 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98b8d2-bd03-43b5-8830-44efa1b5c6b3 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:14.505833 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98b8d2-bd03-43b5-8830-44efa1b5c6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:14.506309 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98b8d2-bd03-43b5-8830-44efa1b5c6b3 None admin] PATH_INFO: `/v3/users/1541e9b140b0436399c5ed9a4362ef6b` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:14.508239 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e98b8d2-bd03-43b5-8830-44efa1b5c6b3 None admin] RBAC: Authorizing `identity:get_user(user_id=1541e9b140b0436399c5ed9a4362ef6b)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:14.509997 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e98b8d2-bd03-43b5-8830-44efa1b5c6b3 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:14.512146 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 44/92] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Jun 8 11:52:14 2022] GET /identity/v3/users/1541e9b140b0436399c5ed9a4362ef6b => generated 275 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:14.513214 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98b8d2-bd03-43b5-8830-44efa1b5c6b3 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:14.590636 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f18f7a-520c-4df9-8dbc-32bfc3176620 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:14.636608 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7669bb42-47f3-41b1-aa87-43ebff324d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:14.637660 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669bb42-47f3-41b1-aa87-43ebff324d69 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:14.637946 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669bb42-47f3-41b1-aa87-43ebff324d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:14.638537 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669bb42-47f3-41b1-aa87-43ebff324d69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:14.640541 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7669bb42-47f3-41b1-aa87-43ebff324d69 None admin] RBAC: Adding query filter params (role.id=b3d7a91b614d49a3bc751e1d330a67cf, scope.project.id=8d69c66b67494123b35f0b9eeaf0f02b, user.id=1541e9b140b0436399c5ed9a4362ef6b) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:14.640863 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7669bb42-47f3-41b1-aa87-43ebff324d69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:14.642986 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7669bb42-47f3-41b1-aa87-43ebff324d69 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:14.650767 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 49/93] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Jun 8 11:52:14 2022] GET /identity/v3/role_assignments?user.id=1541e9b140b0436399c5ed9a4362ef6b&scope.project.id=8d69c66b67494123b35f0b9eeaf0f02b&role.id=b3d7a91b614d49a3bc751e1d330a67cf => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:14.651336 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98b8d2-bd03-43b5-8830-44efa1b5c6b3 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:14.651667 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7669bb42-47f3-41b1-aa87-43ebff324d69 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:14.654977 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:14.695091 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4908b-93dd-4007-88ce-4e02b55b7b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:14.695951 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4908b-93dd-4007-88ce-4e02b55b7b41 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:14.696616 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:14.697303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4908b-93dd-4007-88ce-4e02b55b7b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:14.697778 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4908b-93dd-4007-88ce-4e02b55b7b41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:14.698787 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac4908b-93dd-4007-88ce-4e02b55b7b41 None admin] RBAC: Adding query filter params (role.id=028d4429a4554bbb88b3aec9f6a9d937, scope.project.id=8d69c66b67494123b35f0b9eeaf0f02b, user.id=0451f9cd1a224f47a21e570061ffb155) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:14.699129 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac4908b-93dd-4007-88ce-4e02b55b7b41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:14.701681 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac4908b-93dd-4007-88ce-4e02b55b7b41 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:14.708438 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 45/94] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Jun 8 11:52:14 2022] GET /identity/v3/role_assignments?user.id=0451f9cd1a224f47a21e570061ffb155&scope.project.id=8d69c66b67494123b35f0b9eeaf0f02b&role.id=028d4429a4554bbb88b3aec9f6a9d937 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:14.786543 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7669bb42-47f3-41b1-aa87-43ebff324d69 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:14.837113 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d6e39-20d0-4da5-85fb-61869edc6495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:14.837807 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d6e39-20d0-4da5-85fb-61869edc6495 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:14.838093 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d6e39-20d0-4da5-85fb-61869edc6495 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:14.838376 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d6e39-20d0-4da5-85fb-61869edc6495 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:14.932566 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d6e39-20d0-4da5-85fb-61869edc6495 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:14.934107 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d6e39-20d0-4da5-85fb-61869edc6495 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:14.969400 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:15.059428 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 50/95] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:52:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 11:52:15.070057 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4908b-93dd-4007-88ce-4e02b55b7b41 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:15.240507 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4908b-93dd-4007-88ce-4e02b55b7b41 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:15.297373 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262f34c7-e202-47b4-90c5-78bfa590b99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:15.298263 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f34c7-e202-47b4-90c5-78bfa590b99d None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:15.298548 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f34c7-e202-47b4-90c5-78bfa590b99d None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:15.298825 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f34c7-e202-47b4-90c5-78bfa590b99d None admin] PATH_INFO: `/v3/projects/755ef449f1074a058098fd57905ba7ca` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:15.300056 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262f34c7-e202-47b4-90c5-78bfa590b99d None admin] RBAC: Authorizing `identity:get_project(project_id=755ef449f1074a058098fd57905ba7ca)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:15.301569 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262f34c7-e202-47b4-90c5-78bfa590b99d None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:15.303332 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 46/96] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Jun 8 11:52:15 2022] GET /identity/v3/projects/755ef449f1074a058098fd57905ba7ca => generated 312 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:15.313428 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d6e39-20d0-4da5-85fb-61869edc6495 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:15.486170 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d6e39-20d0-4da5-85fb-61869edc6495 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:15.532395 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:15.537908 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1122568f-c38e-44ed-8ca6-667a59408eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:15.539144 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1122568f-c38e-44ed-8ca6-667a59408eb8 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:15.539687 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1122568f-c38e-44ed-8ca6-667a59408eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:15.544136 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1122568f-c38e-44ed-8ca6-667a59408eb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:15.545860 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1122568f-c38e-44ed-8ca6-667a59408eb8 None admin] RBAC: Adding query filter params (role.id=3682372ab3c145ba87e8baa5c520625f, scope.project.id=755ef449f1074a058098fd57905ba7ca, user.id=1541e9b140b0436399c5ed9a4362ef6b) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:15.546416 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1122568f-c38e-44ed-8ca6-667a59408eb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:15.548399 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1122568f-c38e-44ed-8ca6-667a59408eb8 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:15.555667 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 51/97] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Jun 8 11:52:15 2022] GET /identity/v3/role_assignments?user.id=1541e9b140b0436399c5ed9a4362ef6b&scope.project.id=755ef449f1074a058098fd57905ba7ca&role.id=3682372ab3c145ba87e8baa5c520625f => generated 259 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:17.627533 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265439be-fa7c-4271-a702-cca6e7dfd686 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:17.628103 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265439be-fa7c-4271-a702-cca6e7dfd686 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:17.628103 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265439be-fa7c-4271-a702-cca6e7dfd686 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:17.629833 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 47/98] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:52:17.635685 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee586085-7d34-4efe-9dce-51fb4286f6ab None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:17.636286 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee586085-7d34-4efe-9dce-51fb4286f6ab None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:17.636286 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee586085-7d34-4efe-9dce-51fb4286f6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:17.662497 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-ee586085-7d34-4efe-9dce-51fb4286f6ab None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:17.663707 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ee586085-7d34-4efe-9dce-51fb4286f6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:17.683864 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528efcf8-938d-4693-a244-df56fae2d8dc None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:17.684529 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528efcf8-938d-4693-a244-df56fae2d8dc None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:17.685033 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528efcf8-938d-4693-a244-df56fae2d8dc None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:17.687163 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 48/99] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 11:52:17.692521 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca329107-d3ec-49c2-bd4e-56201a4b2c97 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:17.693070 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca329107-d3ec-49c2-bd4e-56201a4b2c97 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:17.693563 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca329107-d3ec-49c2-bd4e-56201a4b2c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:17.724710 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-ca329107-d3ec-49c2-bd4e-56201a4b2c97 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:17.726527 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-ca329107-d3ec-49c2-bd4e-56201a4b2c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:17.772520 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:17.773207 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 52/100] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:52:17.774566 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360ce71-df17-4f22-87d2-b1825d072444 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:17.774868 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360ce71-df17-4f22-87d2-b1825d072444 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:17.775182 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360ce71-df17-4f22-87d2-b1825d072444 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:17.788045 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 53/101] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:17 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:52:17.793167 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f8934-7680-4b91-8d3c-84dc484cdb5c None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:17.793463 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f8934-7680-4b91-8d3c-84dc484cdb5c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:17.793750 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f8934-7680-4b91-8d3c-84dc484cdb5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:17.832333 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-625f8934-7680-4b91-8d3c-84dc484cdb5c None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:17.834429 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-625f8934-7680-4b91-8d3c-84dc484cdb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:17.879740 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 49/102] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 11:52:17.880552 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca329107-d3ec-49c2-bd4e-56201a4b2c97 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:17.969400 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 54/103] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:52:17.970865 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625f8934-7680-4b91-8d3c-84dc484cdb5c None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:18.017266 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca329107-d3ec-49c2-bd4e-56201a4b2c97 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:18.055728 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f3287-9e46-4a9a-beb7-45e143114c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:18.056566 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f3287-9e46-4a9a-beb7-45e143114c02 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:18.056855 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f3287-9e46-4a9a-beb7-45e143114c02 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:18.057137 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f3287-9e46-4a9a-beb7-45e143114c02 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:18.058330 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f3287-9e46-4a9a-beb7-45e143114c02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:18.059791 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f3287-9e46-4a9a-beb7-45e143114c02 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:18.061804 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 50/104] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:52:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:18.063075 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773f215-157c-4500-a006-c9a22e8994a7 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:18.063400 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773f215-157c-4500-a006-c9a22e8994a7 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:18.063683 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773f215-157c-4500-a006-c9a22e8994a7 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:18.064957 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 51/105] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:52:18.065652 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773f215-157c-4500-a006-c9a22e8994a7 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:18.070516 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:18.112054 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:18.123056 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625f8934-7680-4b91-8d3c-84dc484cdb5c None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:18.161262 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aeb12d-2344-473c-a56d-8eaabd99b969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:18.161768 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aeb12d-2344-473c-a56d-8eaabd99b969 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:18.162061 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aeb12d-2344-473c-a56d-8eaabd99b969 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:18.162343 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aeb12d-2344-473c-a56d-8eaabd99b969 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:18.176339 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aeb12d-2344-473c-a56d-8eaabd99b969 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:52:18.184827 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-27aeb12d-2344-473c-a56d-8eaabd99b969 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 11:52:18.184827 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:52:18.184827 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:52:18.184827 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:52:18.184827 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:52:18.184827 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:52:18.184827 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:52:18.184827 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:52:18.184827 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:52:18.184827 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:52:18.184827 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:52:18.184827 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:52:18.184827 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:52:18.184827 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:52:18.184827 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:52:18.184827 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:52:18.186441 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:52:18.186441 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:52:18.186441 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:52:18.186441 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:52:18.186441 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:52:18.186441 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:52:18.186441 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:52:18.186441 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:52:18.186441 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:52:18.186441 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:52:18.186441 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:52:18.186441 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:52:18.186441 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:52:18.186441 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:52:18.186441 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:52:18.186441 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:52:18.187338 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:52:18.187338 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:52:18.187338 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:52:18.187338 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:52:18.187338 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:52:18.187338 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:52:18.187338 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:52:18.187338 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:52:18.187338 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:52:18.187338 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:52:18.187338 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 11:52:18.187338 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:52:18.187338 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 55/106] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:52:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:52:18.188000 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aeb12d-2344-473c-a56d-8eaabd99b969 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:18.223144 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773f215-157c-4500-a006-c9a22e8994a7 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:18.277684 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b8c330-60da-46d8-bad1-3f247aea8258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:18.278757 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8c330-60da-46d8-bad1-3f247aea8258 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:18.279820 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8c330-60da-46d8-bad1-3f247aea8258 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:18.280715 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8c330-60da-46d8-bad1-3f247aea8258 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:18.295625 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b8c330-60da-46d8-bad1-3f247aea8258 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:52:18.305442 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-07b8c330-60da-46d8-bad1-3f247aea8258 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 11:52:18.305442 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:52:18.305442 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:52:18.305442 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:52:18.305442 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:52:18.305442 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:52:18.305442 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:52:18.305442 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:52:18.305442 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:52:18.305442 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:52:18.305442 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:52:18.305442 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:52:18.305442 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:52:18.305442 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:52:18.305442 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:52:18.305442 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:52:18.306487 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:52:18.306487 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:52:18.306487 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:52:18.306487 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:52:18.306487 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:52:18.306487 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:52:18.306487 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:52:18.306487 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:52:18.306487 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:52:18.306487 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:52:18.306487 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:52:18.306487 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:52:18.306487 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:52:18.306487 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:52:18.306487 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:52:18.306487 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:52:18.307443 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:52:18.307443 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:52:18.307443 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:52:18.307443 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:52:18.307443 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:52:18.307443 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:52:18.307443 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:52:18.307443 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:52:18.307443 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:52:18.307443 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:52:18.307443 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 11:52:18.307443 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:52:18.309293 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 52/107] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:52:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:52:18.310732 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ce583-446b-434c-9b81-a42f0350785d None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:18.311126 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ce583-446b-434c-9b81-a42f0350785d None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:18.311506 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ce583-446b-434c-9b81-a42f0350785d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:18.312797 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aeb12d-2344-473c-a56d-8eaabd99b969 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:18.329398 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-181ce583-446b-434c-9b81-a42f0350785d None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:18.330806 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-181ce583-446b-434c-9b81-a42f0350785d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:18.335308 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:18.366810 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3f1c4-7b8b-43b0-9683-a302956ef336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:18.367939 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3f1c4-7b8b-43b0-9683-a302956ef336 None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:18.368407 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3f1c4-7b8b-43b0-9683-a302956ef336 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:18.368842 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3f1c4-7b8b-43b0-9683-a302956ef336 None admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:18.369963 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa3f1c4-7b8b-43b0-9683-a302956ef336 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:18.372533 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa3f1c4-7b8b-43b0-9683-a302956ef336 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:18.406663 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 53/108] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:52:18.407072 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 56/109] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Jun 8 11:52:18 2022] POST /identity/v3/projects => generated 302 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 11:52:18.413360 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3f1c4-7b8b-43b0-9683-a302956ef336 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:18.413530 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ce583-446b-434c-9b81-a42f0350785d None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:18.467542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:18.570352 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ce583-446b-434c-9b81-a42f0350785d None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:18.593720 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3f1c4-7b8b-43b0-9683-a302956ef336 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:18.620871 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e5901-01c7-46a7-86c4-149947bc17d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:18.622187 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e5901-01c7-46a7-86c4-149947bc17d5 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:18.622481 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e5901-01c7-46a7-86c4-149947bc17d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:18.622764 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e5901-01c7-46a7-86c4-149947bc17d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:18.624143 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0e5901-01c7-46a7-86c4-149947bc17d5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:18.624509 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0e5901-01c7-46a7-86c4-149947bc17d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:18.626175 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0e5901-01c7-46a7-86c4-149947bc17d5 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:18.640779 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 54/110] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Jun 8 11:52:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:18.641465 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb7c1c-60e7-42f8-8046-2692a9edd4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:18.641998 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb7c1c-60e7-42f8-8046-2692a9edd4ea None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:18.642090 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb7c1c-60e7-42f8-8046-2692a9edd4ea None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:18.642381 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb7c1c-60e7-42f8-8046-2692a9edd4ea None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:18.643153 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccb7c1c-60e7-42f8-8046-2692a9edd4ea None admin] RBAC: Adding query filter params (name=member) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:18.643467 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccb7c1c-60e7-42f8-8046-2692a9edd4ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:18.643805 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e5901-01c7-46a7-86c4-149947bc17d5 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:18.644909 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccb7c1c-60e7-42f8-8046-2692a9edd4ea None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:18.657563 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 57/111] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Jun 8 11:52:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:18.659519 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad87d06-578d-4720-a020-beb7822c1fe9 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:18.659818 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad87d06-578d-4720-a020-beb7822c1fe9 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:18.660550 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad87d06-578d-4720-a020-beb7822c1fe9 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:18.663850 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 58/112] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:52:18.668655 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad87d06-578d-4720-a020-beb7822c1fe9 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:18.704919 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:18.758860 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:18.780908 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e5901-01c7-46a7-86c4-149947bc17d5 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:18.800773 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad87d06-578d-4720-a020-beb7822c1fe9 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:18.823162 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ab736-cdf9-4763-bd34-fea6541e4f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:18.824637 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ab736-cdf9-4763-bd34-fea6541e4f51 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:18.825312 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ab736-cdf9-4763-bd34-fea6541e4f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:18.825794 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ab736-cdf9-4763-bd34-fea6541e4f51 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:18.839023 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c255bcc-5e98-487e-ac8f-c80279aa9b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:18.840349 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c255bcc-5e98-487e-ac8f-c80279aa9b79 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:18.840838 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c255bcc-5e98-487e-ac8f-c80279aa9b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:18.841363 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c255bcc-5e98-487e-ac8f-c80279aa9b79 None admin] PATH_INFO: `/v3/users/258fc748181243419d25225e41460a9e` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:18.842722 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774ab736-cdf9-4763-bd34-fea6541e4f51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:52:18.852536 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-774ab736-cdf9-4763-bd34-fea6541e4f51 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:52:18.852536 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:52:18.852536 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:52:18.852536 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:52:18.852536 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:52:18.852536 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:52:18.852536 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:52:18.852536 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:52:18.852536 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:52:18.852536 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:52:18.852536 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:52:18.852536 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:52:18.852536 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:52:18.852536 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:52:18.852536 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:52:18.852536 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:52:18.853518 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:52:18.853518 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:52:18.853518 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:52:18.853518 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:52:18.853518 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:52:18.853518 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:52:18.853518 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:52:18.853518 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:52:18.853518 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:52:18.853518 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:52:18.853518 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:52:18.853518 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:52:18.853518 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:52:18.853518 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:52:18.853518 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:52:18.853518 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:52:18.854263 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:52:18.854263 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:52:18.854263 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:52:18.854263 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:52:18.854263 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:52:18.854263 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:52:18.854263 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:52:18.854263 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:52:18.854263 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:52:18.854263 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:52:18.854263 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:52:18.854263 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:52:18.854907 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 55/113] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Jun 8 11:52:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:52:18.860841 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ab736-cdf9-4763-bd34-fea6541e4f51 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:18.866240 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c255bcc-5e98-487e-ac8f-c80279aa9b79 None admin] RBAC: Authorizing `identity:get_user(user_id=258fc748181243419d25225e41460a9e)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:18.868153 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c255bcc-5e98-487e-ac8f-c80279aa9b79 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:18.870251 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 59/114] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Jun 8 11:52:18 2022] GET /identity/v3/users/258fc748181243419d25225e41460a9e => generated 289 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:18.876491 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce5f9c-97ad-4e3a-b6c2-370b557b5c2a None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:18.877181 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce5f9c-97ad-4e3a-b6c2-370b557b5c2a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:18.877688 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce5f9c-97ad-4e3a-b6c2-370b557b5c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:18.895915 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-e0ce5f9c-97ad-4e3a-b6c2-370b557b5c2a None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:18.897521 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-e0ce5f9c-97ad-4e3a-b6c2-370b557b5c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:18.970034 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 60/115] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:52:18.971232 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ce5f9c-97ad-4e3a-b6c2-370b557b5c2a None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:18.971360 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ab736-cdf9-4763-bd34-fea6541e4f51 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:18.990818 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:19.008581 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70664c38-8b88-457f-b824-59f118080545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:19.010057 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70664c38-8b88-457f-b824-59f118080545 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:19.010057 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70664c38-8b88-457f-b824-59f118080545 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:19.010246 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70664c38-8b88-457f-b824-59f118080545 None admin] PATH_INFO: `/v3/users/1541e9b140b0436399c5ed9a4362ef6b` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:19.011333 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70664c38-8b88-457f-b824-59f118080545 None admin] RBAC: Authorizing `identity:get_user(user_id=1541e9b140b0436399c5ed9a4362ef6b)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:19.012839 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70664c38-8b88-457f-b824-59f118080545 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:19.015148 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 56/116] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Jun 8 11:52:18 2022] GET /identity/v3/users/1541e9b140b0436399c5ed9a4362ef6b => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:19.016010 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70664c38-8b88-457f-b824-59f118080545 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:19.048596 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:19.081378 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ce5f9c-97ad-4e3a-b6c2-370b557b5c2a None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:19.121724 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f6cd3-7ae6-462c-94f4-4a24b6595780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:19.122474 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f6cd3-7ae6-462c-94f4-4a24b6595780 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:19.123305 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f6cd3-7ae6-462c-94f4-4a24b6595780 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:19.123641 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f6cd3-7ae6-462c-94f4-4a24b6595780 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:19.124433 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f6cd3-7ae6-462c-94f4-4a24b6595780 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:19.124843 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f6cd3-7ae6-462c-94f4-4a24b6595780 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:19.126362 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f6cd3-7ae6-462c-94f4-4a24b6595780 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:19.131251 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70664c38-8b88-457f-b824-59f118080545 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:19.135793 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 61/117] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:52:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:19.141232 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f6cd3-7ae6-462c-94f4-4a24b6595780 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:19.167296 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5840a0-c3fa-4451-a566-ebe153e3b78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:19.168009 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5840a0-c3fa-4451-a566-ebe153e3b78b None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:19.168347 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5840a0-c3fa-4451-a566-ebe153e3b78b None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:19.168632 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5840a0-c3fa-4451-a566-ebe153e3b78b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:19.229225 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:19.247910 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5840a0-c3fa-4451-a566-ebe153e3b78b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:19.249543 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5840a0-c3fa-4451-a566-ebe153e3b78b None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:19.250124 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f6cd3-7ae6-462c-94f4-4a24b6595780 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:19.263558 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:19.288248 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a1b16-131f-435a-a0ed-caa69ba84ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:19.289074 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a1b16-131f-435a-a0ed-caa69ba84ead None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:19.289362 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a1b16-131f-435a-a0ed-caa69ba84ead None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:19.289640 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a1b16-131f-435a-a0ed-caa69ba84ead None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:19.300938 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71a1b16-131f-435a-a0ed-caa69ba84ead None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:52:19.308888 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-c71a1b16-131f-435a-a0ed-caa69ba84ead None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 11:52:19.308888 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:52:19.308888 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:52:19.308888 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:52:19.308888 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:52:19.308888 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:52:19.308888 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:52:19.308888 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:52:19.308888 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:52:19.308888 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:52:19.308888 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:52:19.308888 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:52:19.308888 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:52:19.308888 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:52:19.308888 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:52:19.308888 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:52:19.309724 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:52:19.309724 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:52:19.309724 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:52:19.309724 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:52:19.309724 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:52:19.309724 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:52:19.309724 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:52:19.309724 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:52:19.309724 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:52:19.309724 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:52:19.309724 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:52:19.309724 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:52:19.309724 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:52:19.309724 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:52:19.309724 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:52:19.309724 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:52:19.315636 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:52:19.315636 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:52:19.315636 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:52:19.315636 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:52:19.315636 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:52:19.315636 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:52:19.315636 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:52:19.315636 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:52:19.315636 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:52:19.315636 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:52:19.315636 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 11:52:19.315636 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:52:19.315636 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 62/118] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Jun 8 11:52:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:52:19.315636 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a1b16-131f-435a-a0ed-caa69ba84ead None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:19.364397 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 57/119] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:52:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 11:52:19.365856 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5840a0-c3fa-4451-a566-ebe153e3b78b None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:19.422253 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a1b16-131f-435a-a0ed-caa69ba84ead None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:19.457729 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fde580-7e14-4d3f-b85b-e602bc6ce688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:19.458622 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fde580-7e14-4d3f-b85b-e602bc6ce688 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:19.458910 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fde580-7e14-4d3f-b85b-e602bc6ce688 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:19.459188 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fde580-7e14-4d3f-b85b-e602bc6ce688 None admin] PATH_INFO: `/v3/projects/8d69c66b67494123b35f0b9eeaf0f02b` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:19.460431 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fde580-7e14-4d3f-b85b-e602bc6ce688 None admin] RBAC: Authorizing `identity:get_project(project_id=8d69c66b67494123b35f0b9eeaf0f02b)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:19.461951 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fde580-7e14-4d3f-b85b-e602bc6ce688 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:19.463641 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 63/120] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Jun 8 11:52:19 2022] GET /identity/v3/projects/8d69c66b67494123b35f0b9eeaf0f02b => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:19.464915 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6fd1bc-d678-4dcb-a826-67e9fe10a8ed None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:19.465206 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6fd1bc-d678-4dcb-a826-67e9fe10a8ed None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:19.465483 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6fd1bc-d678-4dcb-a826-67e9fe10a8ed None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:19.467024 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 64/121] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:52:19.467622 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6fd1bc-d678-4dcb-a826-67e9fe10a8ed None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:19.481009 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:19.483349 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5840a0-c3fa-4451-a566-ebe153e3b78b None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:19.496904 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:19.519023 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c4df0-c4b8-49ea-a56a-8e2a4c43004b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:19.519855 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c4df0-c4b8-49ea-a56a-8e2a4c43004b None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:19.520181 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c4df0-c4b8-49ea-a56a-8e2a4c43004b None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:19.520452 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c4df0-c4b8-49ea-a56a-8e2a4c43004b None admin] PATH_INFO: `/v3/users/0451f9cd1a224f47a21e570061ffb155` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:19.521782 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3c4df0-c4b8-49ea-a56a-8e2a4c43004b None admin] RBAC: Authorizing `identity:get_user(user_id=0451f9cd1a224f47a21e570061ffb155)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:19.523102 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3c4df0-c4b8-49ea-a56a-8e2a4c43004b None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:19.529299 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 58/122] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Jun 8 11:52:19 2022] GET /identity/v3/users/0451f9cd1a224f47a21e570061ffb155 => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:19.529299 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c4df0-c4b8-49ea-a56a-8e2a4c43004b None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:19.589684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6fd1bc-d678-4dcb-a826-67e9fe10a8ed None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:19.625940 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa19566-1967-45b2-95d4-4d43a5614823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:19.626618 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa19566-1967-45b2-95d4-4d43a5614823 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:19.626913 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa19566-1967-45b2-95d4-4d43a5614823 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:19.627189 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa19566-1967-45b2-95d4-4d43a5614823 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:19.627941 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa19566-1967-45b2-95d4-4d43a5614823 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:19.628282 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa19566-1967-45b2-95d4-4d43a5614823 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:19.629666 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa19566-1967-45b2-95d4-4d43a5614823 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:19.637538 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 65/123] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Jun 8 11:52:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:19.637884 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c4df0-c4b8-49ea-a56a-8e2a4c43004b None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:19.638301 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa19566-1967-45b2-95d4-4d43a5614823 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:19.684768 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936df7f-b8ac-4e0e-8aab-6a4a279749fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:19.686953 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936df7f-b8ac-4e0e-8aab-6a4a279749fa None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:19.687299 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936df7f-b8ac-4e0e-8aab-6a4a279749fa None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:19.687586 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936df7f-b8ac-4e0e-8aab-6a4a279749fa None admin] PATH_INFO: `/v3/projects/8d69c66b67494123b35f0b9eeaf0f02b` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:19.688822 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3936df7f-b8ac-4e0e-8aab-6a4a279749fa None admin] RBAC: Authorizing `identity:get_project(project_id=8d69c66b67494123b35f0b9eeaf0f02b)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:19.690265 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3936df7f-b8ac-4e0e-8aab-6a4a279749fa None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:19.692162 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 59/124] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Jun 8 11:52:19 2022] GET /identity/v3/projects/8d69c66b67494123b35f0b9eeaf0f02b => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:19.698295 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83de51e-3bc5-43a2-8a03-b61b13539919 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:19.698743 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83de51e-3bc5-43a2-8a03-b61b13539919 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:19.699031 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83de51e-3bc5-43a2-8a03-b61b13539919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:19.715775 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-b83de51e-3bc5-43a2-8a03-b61b13539919 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:19.717534 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-b83de51e-3bc5-43a2-8a03-b61b13539919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:19.720122 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:19.758553 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa19566-1967-45b2-95d4-4d43a5614823 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:19.767435 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:19.793670 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 60/125] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:52:19.794058 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa98ecf-b69e-445c-b39d-7501c2c42950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:19.795234 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa98ecf-b69e-445c-b39d-7501c2c42950 None admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:19.795527 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa98ecf-b69e-445c-b39d-7501c2c42950 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:19.795807 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa98ecf-b69e-445c-b39d-7501c2c42950 None admin] PATH_INFO: `/v3/projects/8d69c66b67494123b35f0b9eeaf0f02b/users/1541e9b140b0436399c5ed9a4362ef6b/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:19.797813 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa98ecf-b69e-445c-b39d-7501c2c42950 None admin] RBAC: Authorizing `identity:create_grant(project_id=8d69c66b67494123b35f0b9eeaf0f02b, user_id=1541e9b140b0436399c5ed9a4362ef6b, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:19.799303 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa98ecf-b69e-445c-b39d-7501c2c42950 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:19.801078 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83de51e-3bc5-43a2-8a03-b61b13539919 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:19.818833 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 66/126] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Jun 8 11:52:19 2022] PUT /identity/v3/projects/8d69c66b67494123b35f0b9eeaf0f02b/users/1541e9b140b0436399c5ed9a4362ef6b/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 11:52:19.819793 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa98ecf-b69e-445c-b39d-7501c2c42950 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:19.921010 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83de51e-3bc5-43a2-8a03-b61b13539919 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:19.934195 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa98ecf-b69e-445c-b39d-7501c2c42950 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:19.964949 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeeaa0c-afbb-48b0-af67-5ccb9f7d34dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:19.966447 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeeaa0c-afbb-48b0-af67-5ccb9f7d34dc None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:19.968138 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeeaa0c-afbb-48b0-af67-5ccb9f7d34dc None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:19.968913 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeeaa0c-afbb-48b0-af67-5ccb9f7d34dc None admin] PATH_INFO: `/v3/projects/8d69c66b67494123b35f0b9eeaf0f02b` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:19.970079 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:19.972504 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeeaa0c-afbb-48b0-af67-5ccb9f7d34dc None admin] RBAC: Authorizing `identity:get_project(project_id=8d69c66b67494123b35f0b9eeaf0f02b)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:19.974631 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeeaa0c-afbb-48b0-af67-5ccb9f7d34dc None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:19.977702 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b13b2-7c90-4bf7-b26d-769d2228d58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:19.978945 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 61/127] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Jun 8 11:52:19 2022] GET /identity/v3/projects/8d69c66b67494123b35f0b9eeaf0f02b => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:19.979344 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b13b2-7c90-4bf7-b26d-769d2228d58b None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:19.980094 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b13b2-7c90-4bf7-b26d-769d2228d58b None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:19.980553 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b13b2-7c90-4bf7-b26d-769d2228d58b None admin] PATH_INFO: `/v3/users/1541e9b140b0436399c5ed9a4362ef6b` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:19.984850 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958b13b2-7c90-4bf7-b26d-769d2228d58b None admin] RBAC: Authorizing `identity:get_user(user_id=1541e9b140b0436399c5ed9a4362ef6b)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:19.985097 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeeaa0c-afbb-48b0-af67-5ccb9f7d34dc None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:19.986803 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958b13b2-7c90-4bf7-b26d-769d2228d58b None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:19.993490 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 67/128] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Jun 8 11:52:19 2022] GET /identity/v3/users/1541e9b140b0436399c5ed9a4362ef6b => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:19.994742 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b13b2-7c90-4bf7-b26d-769d2228d58b None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:20.050028 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:20.114377 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeeaa0c-afbb-48b0-af67-5ccb9f7d34dc None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:20.120254 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b13b2-7c90-4bf7-b26d-769d2228d58b None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:20.156058 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93abd475-b804-40b3-b507-ea7973db031c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:20.156761 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93abd475-b804-40b3-b507-ea7973db031c None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:20.157049 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93abd475-b804-40b3-b507-ea7973db031c None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:20.157174 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd69a8a6-3ee1-4223-8fb1-0dbe58493ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:20.157369 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93abd475-b804-40b3-b507-ea7973db031c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:20.157953 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69a8a6-3ee1-4223-8fb1-0dbe58493ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:20.158162 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93abd475-b804-40b3-b507-ea7973db031c None admin] RBAC: Adding query filter params (role.id=0615a114184d403c8ee7d5c22d6630a9, scope.project.id=8d69c66b67494123b35f0b9eeaf0f02b, user.id=258fc748181243419d25225e41460a9e) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:20.158271 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69a8a6-3ee1-4223-8fb1-0dbe58493ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:20.158480 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93abd475-b804-40b3-b507-ea7973db031c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:20.158578 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69a8a6-3ee1-4223-8fb1-0dbe58493ed0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:20.159950 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93abd475-b804-40b3-b507-ea7973db031c None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:20.166608 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 62/129] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Jun 8 11:52:19 2022] GET /identity/v3/role_assignments?user.id=258fc748181243419d25225e41460a9e&scope.project.id=8d69c66b67494123b35f0b9eeaf0f02b&role.id=0615a114184d403c8ee7d5c22d6630a9 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:20.167627 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93abd475-b804-40b3-b507-ea7973db031c None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:20.169557 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd69a8a6-3ee1-4223-8fb1-0dbe58493ed0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:52:20.178284 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-fd69a8a6-3ee1-4223-8fb1-0dbe58493ed0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 11:52:20.178284 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:52:20.178284 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:52:20.178284 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:52:20.178284 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:52:20.178284 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:52:20.178284 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:52:20.178284 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:52:20.178284 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:52:20.178284 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:52:20.178284 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:52:20.178284 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:52:20.178284 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:52:20.178284 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:52:20.178284 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:52:20.178284 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:52:20.179199 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:52:20.179199 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:52:20.179199 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:52:20.179199 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:52:20.179199 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:52:20.179199 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:52:20.179199 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:52:20.179199 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:52:20.179199 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:52:20.179199 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:52:20.179199 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:52:20.179199 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:52:20.179199 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:52:20.179199 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:52:20.179199 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:52:20.179199 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:52:20.180593 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:52:20.180593 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:52:20.180593 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:52:20.180593 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:52:20.180593 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:52:20.180593 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:52:20.180593 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:52:20.180593 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:52:20.180593 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:52:20.180593 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:52:20.180593 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 11:52:20.180593 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:52:20.180593 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 68/130] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:52:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:52:20.180593 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd69a8a6-3ee1-4223-8fb1-0dbe58493ed0 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:20.290845 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93abd475-b804-40b3-b507-ea7973db031c None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:20.304154 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:20.307561 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:20.337601 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf093e5-c239-4ba8-9d2a-8cc15e55045c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:20.338524 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf093e5-c239-4ba8-9d2a-8cc15e55045c None admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:20.338814 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf093e5-c239-4ba8-9d2a-8cc15e55045c None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:20.339097 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf093e5-c239-4ba8-9d2a-8cc15e55045c None admin] PATH_INFO: `/v3/projects/8d69c66b67494123b35f0b9eeaf0f02b/users/0451f9cd1a224f47a21e570061ffb155/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:20.341357 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf093e5-c239-4ba8-9d2a-8cc15e55045c None admin] RBAC: Authorizing `identity:create_grant(project_id=8d69c66b67494123b35f0b9eeaf0f02b, user_id=0451f9cd1a224f47a21e570061ffb155, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:20.342974 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf093e5-c239-4ba8-9d2a-8cc15e55045c None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:20.369266 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 63/131] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Jun 8 11:52:20 2022] PUT /identity/v3/projects/8d69c66b67494123b35f0b9eeaf0f02b/users/0451f9cd1a224f47a21e570061ffb155/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 11:52:20.370633 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf093e5-c239-4ba8-9d2a-8cc15e55045c None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:20.408731 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd69a8a6-3ee1-4223-8fb1-0dbe58493ed0 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:20.491740 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cbcd37-e344-4681-b5ea-44e2a6eddf88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:20.492719 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cbcd37-e344-4681-b5ea-44e2a6eddf88 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:20.493005 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cbcd37-e344-4681-b5ea-44e2a6eddf88 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:20.493279 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cbcd37-e344-4681-b5ea-44e2a6eddf88 None admin] PATH_INFO: `/v3/projects/8d69c66b67494123b35f0b9eeaf0f02b` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:20.494774 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cbcd37-e344-4681-b5ea-44e2a6eddf88 None admin] RBAC: Authorizing `identity:get_project(project_id=8d69c66b67494123b35f0b9eeaf0f02b)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:20.499945 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cbcd37-e344-4681-b5ea-44e2a6eddf88 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:20.501809 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 69/132] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Jun 8 11:52:20 2022] GET /identity/v3/projects/8d69c66b67494123b35f0b9eeaf0f02b => generated 298 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:20.508765 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cbcd37-e344-4681-b5ea-44e2a6eddf88 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:20.583221 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf093e5-c239-4ba8-9d2a-8cc15e55045c None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:20.665909 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40486104-d862-4cbe-bc7f-e8f1018dfe3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:20.666625 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40486104-d862-4cbe-bc7f-e8f1018dfe3b None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:20.666909 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40486104-d862-4cbe-bc7f-e8f1018dfe3b None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:20.667187 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40486104-d862-4cbe-bc7f-e8f1018dfe3b None admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:20.667965 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40486104-d862-4cbe-bc7f-e8f1018dfe3b None admin] RBAC: Adding query filter params (name=member) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:20.668310 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40486104-d862-4cbe-bc7f-e8f1018dfe3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:20.673680 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40486104-d862-4cbe-bc7f-e8f1018dfe3b None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:20.694091 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 64/133] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Jun 8 11:52:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:20.716190 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cbcd37-e344-4681-b5ea-44e2a6eddf88 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:20.722352 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40486104-d862-4cbe-bc7f-e8f1018dfe3b None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:20.777109 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:20.778461 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:20.797246 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e67be5-3bca-4a4e-9a79-3832bbd99baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:20.798653 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e67be5-3bca-4a4e-9a79-3832bbd99baa None admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:20.799493 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e67be5-3bca-4a4e-9a79-3832bbd99baa None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:20.801530 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e67be5-3bca-4a4e-9a79-3832bbd99baa None admin] PATH_INFO: `/v3/projects/8d69c66b67494123b35f0b9eeaf0f02b/users/1541e9b140b0436399c5ed9a4362ef6b/roles/b3d7a91b614d49a3bc751e1d330a67cf` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:20.807350 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e67be5-3bca-4a4e-9a79-3832bbd99baa None admin] RBAC: Authorizing `identity:create_grant(project_id=8d69c66b67494123b35f0b9eeaf0f02b, user_id=1541e9b140b0436399c5ed9a4362ef6b, role_id=b3d7a91b614d49a3bc751e1d330a67cf)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:20.809950 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e67be5-3bca-4a4e-9a79-3832bbd99baa None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:20.835947 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 70/134] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Jun 8 11:52:20 2022] PUT /identity/v3/projects/8d69c66b67494123b35f0b9eeaf0f02b/users/1541e9b140b0436399c5ed9a4362ef6b/roles/b3d7a91b614d49a3bc751e1d330a67cf => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 11:52:20.875256 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40486104-d862-4cbe-bc7f-e8f1018dfe3b None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:20.918044 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64deaf-7fad-4b77-9bae-068fe09d4891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:20.918947 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64deaf-7fad-4b77-9bae-068fe09d4891 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:20.919286 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64deaf-7fad-4b77-9bae-068fe09d4891 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:20.920145 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64deaf-7fad-4b77-9bae-068fe09d4891 None admin] PATH_INFO: `/v3/users/1541e9b140b0436399c5ed9a4362ef6b` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:20.922261 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba64deaf-7fad-4b77-9bae-068fe09d4891 None admin] RBAC: Authorizing `identity:get_user(user_id=1541e9b140b0436399c5ed9a4362ef6b)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:20.923795 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba64deaf-7fad-4b77-9bae-068fe09d4891 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:20.925537 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 65/135] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Jun 8 11:52:20 2022] GET /identity/v3/users/1541e9b140b0436399c5ed9a4362ef6b => generated 275 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:20.931166 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e67be5-3bca-4a4e-9a79-3832bbd99baa None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:21.051376 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e67be5-3bca-4a4e-9a79-3832bbd99baa None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:21.090583 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa0085-9e24-420d-8e3a-4fb98555b32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:21.091515 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa0085-9e24-420d-8e3a-4fb98555b32b None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:21.092412 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa0085-9e24-420d-8e3a-4fb98555b32b None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:21.092719 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa0085-9e24-420d-8e3a-4fb98555b32b None admin] PATH_INFO: `/v3/projects/755ef449f1074a058098fd57905ba7ca` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:21.093939 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aa0085-9e24-420d-8e3a-4fb98555b32b None admin] RBAC: Authorizing `identity:get_project(project_id=755ef449f1074a058098fd57905ba7ca)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:21.095412 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aa0085-9e24-420d-8e3a-4fb98555b32b None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:21.097255 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 71/136] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Jun 8 11:52:20 2022] GET /identity/v3/projects/755ef449f1074a058098fd57905ba7ca => generated 312 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:21.103117 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64deaf-7fad-4b77-9bae-068fe09d4891 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:21.220318 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:21.225096 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64deaf-7fad-4b77-9bae-068fe09d4891 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:21.252996 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846bbdf-5471-4d17-b085-2e66f57013c4 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:21.253293 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846bbdf-5471-4d17-b085-2e66f57013c4 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:21.253564 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846bbdf-5471-4d17-b085-2e66f57013c4 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:21.255071 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 72/137] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:52:21.261194 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfaedbc-f574-4b9d-8850-8f17eaa2f831 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:21.261493 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfaedbc-f574-4b9d-8850-8f17eaa2f831 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:21.261757 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfaedbc-f574-4b9d-8850-8f17eaa2f831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:21.280769 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a4f177-b7ed-495a-9ccb-be7deb5d0dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:21.281310 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-3cfaedbc-f574-4b9d-8850-8f17eaa2f831 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:21.281682 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4f177-b7ed-495a-9ccb-be7deb5d0dff None admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:21.281971 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4f177-b7ed-495a-9ccb-be7deb5d0dff None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:21.282252 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4f177-b7ed-495a-9ccb-be7deb5d0dff None admin] PATH_INFO: `/v3/projects/755ef449f1074a058098fd57905ba7ca/users/1541e9b140b0436399c5ed9a4362ef6b/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:21.282579 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-3cfaedbc-f574-4b9d-8850-8f17eaa2f831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:21.284302 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a4f177-b7ed-495a-9ccb-be7deb5d0dff None admin] RBAC: Authorizing `identity:create_grant(project_id=755ef449f1074a058098fd57905ba7ca, user_id=1541e9b140b0436399c5ed9a4362ef6b, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:21.285998 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a4f177-b7ed-495a-9ccb-be7deb5d0dff None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:21.304235 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 66/138] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Jun 8 11:52:21 2022] PUT /identity/v3/projects/755ef449f1074a058098fd57905ba7ca/users/1541e9b140b0436399c5ed9a4362ef6b/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 11:52:21.349433 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:21.370536 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 73/139] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 11:52:21.396318 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a4f177-b7ed-495a-9ccb-be7deb5d0dff None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:21.520428 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a4f177-b7ed-495a-9ccb-be7deb5d0dff None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:21.563456 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8782e0a5-e43e-49cc-9a6b-22788e6c6d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:21.564307 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782e0a5-e43e-49cc-9a6b-22788e6c6d2f None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:21.564600 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782e0a5-e43e-49cc-9a6b-22788e6c6d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:21.564883 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782e0a5-e43e-49cc-9a6b-22788e6c6d2f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:21.566126 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8782e0a5-e43e-49cc-9a6b-22788e6c6d2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:21.567644 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8782e0a5-e43e-49cc-9a6b-22788e6c6d2f None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:21.574112 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 67/140] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:52:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:21.578421 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfaedbc-f574-4b9d-8850-8f17eaa2f831 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:21.692475 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfaedbc-f574-4b9d-8850-8f17eaa2f831 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:21.730827 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9de31-ccde-492e-904e-e110ee61aa1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:21.731519 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9de31-ccde-492e-904e-e110ee61aa1d None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:21.731804 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9de31-ccde-492e-904e-e110ee61aa1d None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:21.732627 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9de31-ccde-492e-904e-e110ee61aa1d None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:21.733351 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff9de31-ccde-492e-904e-e110ee61aa1d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:21.735026 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff9de31-ccde-492e-904e-e110ee61aa1d None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:21.758328 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 74/141] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Jun 8 11:52:21 2022] POST /identity/v3/users => generated 283 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 11:52:22.623729 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6376042-557c-49b4-b790-6bcbac1445d5 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:22.624709 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6376042-557c-49b4-b790-6bcbac1445d5 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:22.625184 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6376042-557c-49b4-b790-6bcbac1445d5 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:22.626768 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 68/142] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:52:22.633226 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480937a8-cf2b-4ca4-8197-8ac68d661d5d None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:22.634175 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480937a8-cf2b-4ca4-8197-8ac68d661d5d None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:22.634657 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480937a8-cf2b-4ca4-8197-8ac68d661d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:22.655100 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-480937a8-cf2b-4ca4-8197-8ac68d661d5d None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:22.656679 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-480937a8-cf2b-4ca4-8197-8ac68d661d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:22.698626 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:22.738153 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 75/143] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:52:22.761707 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6376042-557c-49b4-b790-6bcbac1445d5 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:22.804105 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:22.900887 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6376042-557c-49b4-b790-6bcbac1445d5 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:22.945730 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88babd-017a-4e94-b86e-da96c5a185f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:22.946548 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88babd-017a-4e94-b86e-da96c5a185f2 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:22.947029 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88babd-017a-4e94-b86e-da96c5a185f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:22.947312 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88babd-017a-4e94-b86e-da96c5a185f2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:22.968893 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88babd-017a-4e94-b86e-da96c5a185f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:52:22.976993 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-9f88babd-017a-4e94-b86e-da96c5a185f2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 11:52:22.976993 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:52:22.976993 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:52:22.976993 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:52:22.976993 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:52:22.976993 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:52:22.976993 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:52:22.976993 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:52:22.976993 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:52:22.976993 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:52:22.976993 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:52:22.976993 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:52:22.976993 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:52:22.976993 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:52:22.976993 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:52:22.976993 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:52:22.977864 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:52:22.977864 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:52:22.977864 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:52:22.977864 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:52:22.977864 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:52:22.977864 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:52:22.977864 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:52:22.977864 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:52:22.977864 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:52:22.977864 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:52:22.977864 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:52:22.977864 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:52:22.977864 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:52:22.977864 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:52:22.977864 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:52:22.977864 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:52:22.979053 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:52:22.979053 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:52:22.979053 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:52:22.979053 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:52:22.979053 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:52:22.979053 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:52:22.979053 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:52:22.979053 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:52:22.979053 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:52:22.979053 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:52:22.979053 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 11:52:22.979053 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:52:22.979053 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 69/144] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:52:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:52:22.984902 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480937a8-cf2b-4ca4-8197-8ac68d661d5d None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:23.112827 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480937a8-cf2b-4ca4-8197-8ac68d661d5d None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:23.159326 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0cc7a1-92b1-40db-9798-36e4c0fbc8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:23.159934 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0cc7a1-92b1-40db-9798-36e4c0fbc8f0 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:23.160236 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0cc7a1-92b1-40db-9798-36e4c0fbc8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:23.160515 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0cc7a1-92b1-40db-9798-36e4c0fbc8f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:23.161273 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0cc7a1-92b1-40db-9798-36e4c0fbc8f0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:23.161578 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0cc7a1-92b1-40db-9798-36e4c0fbc8f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:23.162979 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0cc7a1-92b1-40db-9798-36e4c0fbc8f0 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:23.175516 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 76/145] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Jun 8 11:52:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:23.180982 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88babd-017a-4e94-b86e-da96c5a185f2 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:23.292853 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:23.306244 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88babd-017a-4e94-b86e-da96c5a185f2 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:23.349397 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce3ab7d-262b-472c-ab86-6e859aee5c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:23.350547 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3ab7d-262b-472c-ab86-6e859aee5c5c None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:23.350837 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3ab7d-262b-472c-ab86-6e859aee5c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:23.351117 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3ab7d-262b-472c-ab86-6e859aee5c5c None admin] PATH_INFO: `/v3/users/1541e9b140b0436399c5ed9a4362ef6b` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:23.352372 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce3ab7d-262b-472c-ab86-6e859aee5c5c None admin] RBAC: Authorizing `identity:get_user(user_id=1541e9b140b0436399c5ed9a4362ef6b)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:23.353846 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce3ab7d-262b-472c-ab86-6e859aee5c5c None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:23.355654 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 70/146] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Jun 8 11:52:23 2022] GET /identity/v3/users/1541e9b140b0436399c5ed9a4362ef6b => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:23.361685 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0cc7a1-92b1-40db-9798-36e4c0fbc8f0 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:23.413705 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ce931-8cf2-4a7f-a1e4-7ee78ab8dd9e None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:23.414046 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ce931-8cf2-4a7f-a1e4-7ee78ab8dd9e None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:23.414207 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ce931-8cf2-4a7f-a1e4-7ee78ab8dd9e None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:23.415561 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:23.416118 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 71/147] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 11:52:23.431189 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df23ee0-be26-48a7-81ff-11c71be7d882 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:23.431479 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df23ee0-be26-48a7-81ff-11c71be7d882 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:23.432060 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df23ee0-be26-48a7-81ff-11c71be7d882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:23.461476 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-6df23ee0-be26-48a7-81ff-11c71be7d882 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:23.462862 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-6df23ee0-be26-48a7-81ff-11c71be7d882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:23.567038 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0cc7a1-92b1-40db-9798-36e4c0fbc8f0 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:23.578737 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 72/148] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 11:52:23.630332 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df23ee0-be26-48a7-81ff-11c71be7d882 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:23.636378 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5d69f-40e4-4803-a313-f7a647505036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:23.637052 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5d69f-40e4-4803-a313-f7a647505036 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:23.637336 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5d69f-40e4-4803-a313-f7a647505036 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:23.637613 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5d69f-40e4-4803-a313-f7a647505036 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:23.764292 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f5d69f-40e4-4803-a313-f7a647505036 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:23.765470 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f5d69f-40e4-4803-a313-f7a647505036 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:23.786485 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:23.817836 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df23ee0-be26-48a7-81ff-11c71be7d882 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:23.821282 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:23.891648 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c08717e-d8b4-45f9-a906-68100e4b25ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:23.893032 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08717e-d8b4-45f9-a906-68100e4b25ac None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:23.893478 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08717e-d8b4-45f9-a906-68100e4b25ac None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:23.893924 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08717e-d8b4-45f9-a906-68100e4b25ac None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:23.924205 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c08717e-d8b4-45f9-a906-68100e4b25ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:52:23.931746 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-2c08717e-d8b4-45f9-a906-68100e4b25ac None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 11:52:23.931746 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:52:23.931746 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:52:23.931746 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:52:23.931746 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:52:23.931746 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:52:23.931746 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:52:23.931746 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:52:23.931746 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:52:23.931746 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:52:23.931746 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:52:23.931746 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:52:23.931746 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:52:23.931746 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:52:23.931746 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:52:23.931746 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:52:23.932676 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:52:23.932676 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:52:23.932676 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:52:23.932676 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:52:23.932676 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:52:23.932676 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:52:23.932676 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:52:23.932676 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:52:23.932676 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:52:23.932676 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:52:23.932676 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:52:23.932676 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:52:23.932676 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:52:23.932676 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:52:23.932676 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:52:23.932676 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:52:23.933519 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:52:23.933519 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:52:23.933519 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:52:23.933519 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:52:23.933519 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:52:23.933519 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:52:23.933519 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:52:23.933519 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:52:23.933519 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:52:23.933519 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:52:23.933519 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 11:52:23.933519 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:52:23.938272 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 73/149] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:52:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:52:23.946705 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c08717e-d8b4-45f9-a906-68100e4b25ac None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:23.972614 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 77/150] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:52:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 11:52:23.978634 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5d69f-40e4-4803-a313-f7a647505036 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:24.114708 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c08717e-d8b4-45f9-a906-68100e4b25ac None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:24.166256 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5d69f-40e4-4803-a313-f7a647505036 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:24.172429 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc402375-f062-416d-8b29-d785338913a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:24.173112 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc402375-f062-416d-8b29-d785338913a2 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:24.173395 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc402375-f062-416d-8b29-d785338913a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:24.173667 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc402375-f062-416d-8b29-d785338913a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:24.174422 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc402375-f062-416d-8b29-d785338913a2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:24.174729 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc402375-f062-416d-8b29-d785338913a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:24.176136 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc402375-f062-416d-8b29-d785338913a2 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:24.193783 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 74/151] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Jun 8 11:52:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:52:24.200148 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc402375-f062-416d-8b29-d785338913a2 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:24.229043 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:24.246391 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:24.257256 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e657b-35ba-4a0d-a9f0-76c6e5c95adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:24.258128 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e657b-35ba-4a0d-a9f0-76c6e5c95adf None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:24.258408 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e657b-35ba-4a0d-a9f0-76c6e5c95adf None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:24.258679 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e657b-35ba-4a0d-a9f0-76c6e5c95adf None admin] PATH_INFO: `/v3/projects/8d69c66b67494123b35f0b9eeaf0f02b` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:24.262843 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35e657b-35ba-4a0d-a9f0-76c6e5c95adf None admin] RBAC: Authorizing `identity:get_project(project_id=8d69c66b67494123b35f0b9eeaf0f02b)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:24.267459 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35e657b-35ba-4a0d-a9f0-76c6e5c95adf None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:24.269813 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 78/152] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Jun 8 11:52:23 2022] GET /identity/v3/projects/8d69c66b67494123b35f0b9eeaf0f02b => generated 298 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:52:24.275835 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e657b-35ba-4a0d-a9f0-76c6e5c95adf None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:24.446211 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc402375-f062-416d-8b29-d785338913a2 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:24.480927 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e657b-35ba-4a0d-a9f0-76c6e5c95adf None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:24.550218 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c346169-942a-4854-b726-e6529511c163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:24.551123 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c346169-942a-4854-b726-e6529511c163 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:24.551409 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c346169-942a-4854-b726-e6529511c163 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:24.551681 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c346169-942a-4854-b726-e6529511c163 None admin] PATH_INFO: `/v3/users/258fc748181243419d25225e41460a9e` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:24.554910 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c346169-942a-4854-b726-e6529511c163 None admin] RBAC: Authorizing `identity:get_user(user_id=258fc748181243419d25225e41460a9e)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:24.556502 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c346169-942a-4854-b726-e6529511c163 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:24.558267 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 75/153] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Jun 8 11:52:24 2022] GET /identity/v3/users/258fc748181243419d25225e41460a9e => generated 289 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:24.558883 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c221fb-c4ee-4561-8eea-ed588a4811db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:24.559777 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c221fb-c4ee-4561-8eea-ed588a4811db None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:24.560538 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c221fb-c4ee-4561-8eea-ed588a4811db None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:24.561009 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c221fb-c4ee-4561-8eea-ed588a4811db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:24.562042 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c221fb-c4ee-4561-8eea-ed588a4811db None admin] RBAC: Adding query filter params (role.id=3682372ab3c145ba87e8baa5c520625f, scope.project.id=8d69c66b67494123b35f0b9eeaf0f02b, user.id=1541e9b140b0436399c5ed9a4362ef6b) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:24.562545 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c221fb-c4ee-4561-8eea-ed588a4811db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:24.563813 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c346169-942a-4854-b726-e6529511c163 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:24.564455 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c221fb-c4ee-4561-8eea-ed588a4811db None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:24.586497 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 79/154] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Jun 8 11:52:24 2022] GET /identity/v3/role_assignments?user.id=1541e9b140b0436399c5ed9a4362ef6b&scope.project.id=8d69c66b67494123b35f0b9eeaf0f02b&role.id=3682372ab3c145ba87e8baa5c520625f => generated 608 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:24.709282 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:24.737934 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c346169-942a-4854-b726-e6529511c163 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:24.783660 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bb3f13-a3d5-442e-90d2-5165a7b9361c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:24.784599 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb3f13-a3d5-442e-90d2-5165a7b9361c None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:24.784898 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb3f13-a3d5-442e-90d2-5165a7b9361c None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:24.785179 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb3f13-a3d5-442e-90d2-5165a7b9361c None admin] PATH_INFO: `/v3/projects/8d69c66b67494123b35f0b9eeaf0f02b` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:24.786501 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bb3f13-a3d5-442e-90d2-5165a7b9361c None admin] RBAC: Authorizing `identity:get_project(project_id=8d69c66b67494123b35f0b9eeaf0f02b)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:24.788019 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bb3f13-a3d5-442e-90d2-5165a7b9361c None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:24.789901 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 76/155] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Jun 8 11:52:24 2022] GET /identity/v3/projects/8d69c66b67494123b35f0b9eeaf0f02b => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:24.796340 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c221fb-c4ee-4561-8eea-ed588a4811db None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:24.915633 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:24.968697 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c221fb-c4ee-4561-8eea-ed588a4811db None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:25.018238 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf5cc2-e11d-4ea0-afd1-bf57e8b6078f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:25.019502 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf5cc2-e11d-4ea0-afd1-bf57e8b6078f None admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:25.019973 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf5cc2-e11d-4ea0-afd1-bf57e8b6078f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:25.020455 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf5cc2-e11d-4ea0-afd1-bf57e8b6078f None admin] PATH_INFO: `/v3/projects/8d69c66b67494123b35f0b9eeaf0f02b/users/258fc748181243419d25225e41460a9e/roles/0615a114184d403c8ee7d5c22d6630a9` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:25.025446 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf5cc2-e11d-4ea0-afd1-bf57e8b6078f None admin] RBAC: Authorizing `identity:create_grant(project_id=8d69c66b67494123b35f0b9eeaf0f02b, user_id=258fc748181243419d25225e41460a9e, role_id=0615a114184d403c8ee7d5c22d6630a9)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:25.027263 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf5cc2-e11d-4ea0-afd1-bf57e8b6078f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:25.053054 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 80/156] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Jun 8 11:52:24 2022] PUT /identity/v3/projects/8d69c66b67494123b35f0b9eeaf0f02b/users/258fc748181243419d25225e41460a9e/roles/0615a114184d403c8ee7d5c22d6630a9 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 11:52:25.054168 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e579eee-538a-4bb5-98de-7a1282ca9f46 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:25.054476 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e579eee-538a-4bb5-98de-7a1282ca9f46 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:25.054776 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e579eee-538a-4bb5-98de-7a1282ca9f46 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:25.056300 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 77/157] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:52:25.070001 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f9505-b821-467d-b7ff-d7d08aaa8122 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:25.070623 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f9505-b821-467d-b7ff-d7d08aaa8122 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:25.071152 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f9505-b821-467d-b7ff-d7d08aaa8122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:25.094236 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-ec1f9505-b821-467d-b7ff-d7d08aaa8122 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:25.096064 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ec1f9505-b821-467d-b7ff-d7d08aaa8122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:25.161762 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1aa68d-a863-4bfb-885b-ac9e161a5354 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:25.162117 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1aa68d-a863-4bfb-885b-ac9e161a5354 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:25.162335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1aa68d-a863-4bfb-885b-ac9e161a5354 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:25.163755 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 78/158] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 11:52:25.169676 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687adbf-ab57-4c7d-80d5-ee85f12d0ad1 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:25.170124 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687adbf-ab57-4c7d-80d5-ee85f12d0ad1 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:25.170309 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687adbf-ab57-4c7d-80d5-ee85f12d0ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:25.184465 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 81/159] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:52:25.202119 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-6687adbf-ab57-4c7d-80d5-ee85f12d0ad1 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:25.203360 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-6687adbf-ab57-4c7d-80d5-ee85f12d0ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:25.304535 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f9505-b821-467d-b7ff-d7d08aaa8122 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:25.322722 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 79/160] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:52:25.368116 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6687adbf-ab57-4c7d-80d5-ee85f12d0ad1 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:25.390254 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:25.446812 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f9505-b821-467d-b7ff-d7d08aaa8122 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:25.481465 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:25.494589 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7501d604-f3b3-44b8-ae25-334459f90fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:25.495433 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7501d604-f3b3-44b8-ae25-334459f90fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:25.495693 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7501d604-f3b3-44b8-ae25-334459f90fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:25.495959 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7501d604-f3b3-44b8-ae25-334459f90fd6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:25.514963 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7501d604-f3b3-44b8-ae25-334459f90fd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:52:25.519410 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6687adbf-ab57-4c7d-80d5-ee85f12d0ad1 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:25.526523 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-7501d604-f3b3-44b8-ae25-334459f90fd6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 11:52:25.526523 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:52:25.526523 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:52:25.526523 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:52:25.526523 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:52:25.526523 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:52:25.526523 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:52:25.526523 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:52:25.526523 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:52:25.526523 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:52:25.526523 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:52:25.526523 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:52:25.526523 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:52:25.526523 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:52:25.526523 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:52:25.526523 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:52:25.527438 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:52:25.527438 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:52:25.527438 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:52:25.527438 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:52:25.527438 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:52:25.527438 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:52:25.527438 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:52:25.527438 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:52:25.527438 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:52:25.527438 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:52:25.527438 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:52:25.527438 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:52:25.527438 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:52:25.527438 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:52:25.527438 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:52:25.527438 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:52:25.528209 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:52:25.528209 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:52:25.528209 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:52:25.528209 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:52:25.528209 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:52:25.528209 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:52:25.528209 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:52:25.528209 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:52:25.528209 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:52:25.528209 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:52:25.528209 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 11:52:25.528209 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:52:25.528209 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 82/161] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Jun 8 11:52:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 11:52:25.543718 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7501d604-f3b3-44b8-ae25-334459f90fd6 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:25.568084 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0f23e-be0a-4940-ac63-542dac16456c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:25.568851 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0f23e-be0a-4940-ac63-542dac16456c None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:25.569136 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0f23e-be0a-4940-ac63-542dac16456c None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:25.569414 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0f23e-be0a-4940-ac63-542dac16456c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:25.580778 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c0f23e-be0a-4940-ac63-542dac16456c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:52:25.588580 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-b4c0f23e-be0a-4940-ac63-542dac16456c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:52:25.588580 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:52:25.588580 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:52:25.588580 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:52:25.588580 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:52:25.588580 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:52:25.588580 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:52:25.588580 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:52:25.588580 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:52:25.588580 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:52:25.588580 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:52:25.588580 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:52:25.588580 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:52:25.588580 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:52:25.588580 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:52:25.588580 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:52:25.589516 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:52:25.589516 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:52:25.589516 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:52:25.589516 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:52:25.589516 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:52:25.589516 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:52:25.589516 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:52:25.589516 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:52:25.589516 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:52:25.589516 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:52:25.589516 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:52:25.589516 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:52:25.589516 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:52:25.589516 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:52:25.589516 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:52:25.589516 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:52:25.590335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:52:25.590335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:52:25.590335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:52:25.590335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:52:25.590335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:52:25.590335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:52:25.590335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:52:25.590335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:52:25.590335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:52:25.590335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:52:25.590335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:52:25.590335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:52:25.590335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 80/162] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Jun 8 11:52:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:52:25.596341 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0f23e-be0a-4940-ac63-542dac16456c None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:25.720655 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0f23e-be0a-4940-ac63-542dac16456c None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:25.760026 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb910fd9-bcaf-4947-a4f9-3f22dc184dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:25.761101 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb910fd9-bcaf-4947-a4f9-3f22dc184dc4 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:25.761591 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb910fd9-bcaf-4947-a4f9-3f22dc184dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:25.762150 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb910fd9-bcaf-4947-a4f9-3f22dc184dc4 None admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:25.763315 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb910fd9-bcaf-4947-a4f9-3f22dc184dc4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:25.763834 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb910fd9-bcaf-4947-a4f9-3f22dc184dc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:25.765693 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb910fd9-bcaf-4947-a4f9-3f22dc184dc4 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:25.765809 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7501d604-f3b3-44b8-ae25-334459f90fd6 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:25.775464 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 81/163] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:52:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:52:25.776504 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:25.781437 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb910fd9-bcaf-4947-a4f9-3f22dc184dc4 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:25.789946 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:25.849441 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c66895-dd4a-4efe-b930-b3c931927a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:25.850486 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c66895-dd4a-4efe-b930-b3c931927a55 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:25.850673 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c66895-dd4a-4efe-b930-b3c931927a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:25.850943 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c66895-dd4a-4efe-b930-b3c931927a55 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:25.851707 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c66895-dd4a-4efe-b930-b3c931927a55 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:25.852017 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c66895-dd4a-4efe-b930-b3c931927a55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:25.853456 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c66895-dd4a-4efe-b930-b3c931927a55 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:25.882166 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 83/164] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Jun 8 11:52:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:25.896361 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb910fd9-bcaf-4947-a4f9-3f22dc184dc4 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:25.905802 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c66895-dd4a-4efe-b930-b3c931927a55 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:25.933069 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb3a46-172f-4086-9047-1f613a642ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:25.934382 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb3a46-172f-4086-9047-1f613a642ae0 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:25.935386 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb3a46-172f-4086-9047-1f613a642ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:25.936101 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb3a46-172f-4086-9047-1f613a642ae0 None admin] PATH_INFO: `/v3/users/0451f9cd1a224f47a21e570061ffb155` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:25.937647 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eb3a46-172f-4086-9047-1f613a642ae0 None admin] RBAC: Authorizing `identity:get_user(user_id=0451f9cd1a224f47a21e570061ffb155)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:25.939441 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eb3a46-172f-4086-9047-1f613a642ae0 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:25.941339 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 82/165] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Jun 8 11:52:25 2022] GET /identity/v3/users/0451f9cd1a224f47a21e570061ffb155 => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:52:25.948974 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb3a46-172f-4086-9047-1f613a642ae0 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:26.028072 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:26.098850 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb3a46-172f-4086-9047-1f613a642ae0 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:26.131605 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c66895-dd4a-4efe-b930-b3c931927a55 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:26.156021 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82d462-ee29-4131-9506-85c505199bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:26.156725 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82d462-ee29-4131-9506-85c505199bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:26.157013 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82d462-ee29-4131-9506-85c505199bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:26.157292 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82d462-ee29-4131-9506-85c505199bf8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:26.181609 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16090489-b4f7-4e24-a595-591e5379961b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:26.182493 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16090489-b4f7-4e24-a595-591e5379961b None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:26.182776 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16090489-b4f7-4e24-a595-591e5379961b None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:26.183054 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16090489-b4f7-4e24-a595-591e5379961b None admin] PATH_INFO: `/v3/users/1541e9b140b0436399c5ed9a4362ef6b` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:26.184371 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16090489-b4f7-4e24-a595-591e5379961b None admin] RBAC: Authorizing `identity:get_user(user_id=1541e9b140b0436399c5ed9a4362ef6b)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:26.185889 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16090489-b4f7-4e24-a595-591e5379961b None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:26.187529 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 84/166] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Jun 8 11:52:25 2022] GET /identity/v3/users/1541e9b140b0436399c5ed9a4362ef6b => generated 275 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:26.193246 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16090489-b4f7-4e24-a595-591e5379961b None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:26.282218 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:26.301057 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa82d462-ee29-4131-9506-85c505199bf8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:26.302552 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa82d462-ee29-4131-9506-85c505199bf8 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:26.401967 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16090489-b4f7-4e24-a595-591e5379961b None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:26.424857 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:26.485161 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5323b99-6ef5-4574-a85b-6e474a299f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:26.485833 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5323b99-6ef5-4574-a85b-6e474a299f3a None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:26.486119 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5323b99-6ef5-4574-a85b-6e474a299f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:26.486402 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5323b99-6ef5-4574-a85b-6e474a299f3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:26.492957 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 83/167] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:52:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 11:52:26.506003 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82d462-ee29-4131-9506-85c505199bf8 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:26.632114 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5323b99-6ef5-4574-a85b-6e474a299f3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:26.633638 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5323b99-6ef5-4574-a85b-6e474a299f3a None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:26.710098 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82d462-ee29-4131-9506-85c505199bf8 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:26.733587 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:26.783053 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9cade3-7212-4cb7-a091-f1495ed5cf3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:26.783932 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9cade3-7212-4cb7-a091-f1495ed5cf3e None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:26.784236 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9cade3-7212-4cb7-a091-f1495ed5cf3e None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:26.784515 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9cade3-7212-4cb7-a091-f1495ed5cf3e None admin] PATH_INFO: `/v3/projects/8d69c66b67494123b35f0b9eeaf0f02b` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:26.786642 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9cade3-7212-4cb7-a091-f1495ed5cf3e None admin] RBAC: Authorizing `identity:get_project(project_id=8d69c66b67494123b35f0b9eeaf0f02b)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:26.788105 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9cade3-7212-4cb7-a091-f1495ed5cf3e None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:26.795314 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 84/168] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Jun 8 11:52:26 2022] GET /identity/v3/projects/8d69c66b67494123b35f0b9eeaf0f02b => generated 298 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:26.804551 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b798f27-9529-42b0-a183-8fe99ebfc706 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:26.808742 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b798f27-9529-42b0-a183-8fe99ebfc706 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:26.809036 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b798f27-9529-42b0-a183-8fe99ebfc706 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:26.812732 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 85/169] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:26 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:52:26.815468 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b798f27-9529-42b0-a183-8fe99ebfc706 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:26.879727 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 85/170] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:52:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 687 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 11:52:26.881009 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfefc5f4-c353-4c6c-bcac-ef42be4a14b8 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:26.881301 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfefc5f4-c353-4c6c-bcac-ef42be4a14b8 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:26.881604 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfefc5f4-c353-4c6c-bcac-ef42be4a14b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:26.896116 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:26.917844 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-cfefc5f4-c353-4c6c-bcac-ef42be4a14b8 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:26.919058 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-cfefc5f4-c353-4c6c-bcac-ef42be4a14b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:27.054333 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b798f27-9529-42b0-a183-8fe99ebfc706 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:27.087005 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 86/171] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:52:27.088048 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfefc5f4-c353-4c6c-bcac-ef42be4a14b8 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:27.115362 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03125f70-5c8d-4a81-9ea8-d8881dd31448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:27.116416 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03125f70-5c8d-4a81-9ea8-d8881dd31448 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:27.116908 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03125f70-5c8d-4a81-9ea8-d8881dd31448 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:27.117401 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03125f70-5c8d-4a81-9ea8-d8881dd31448 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:27.118447 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03125f70-5c8d-4a81-9ea8-d8881dd31448 None admin] RBAC: Adding query filter params (role.id=028d4429a4554bbb88b3aec9f6a9d937, scope.project.id=8d69c66b67494123b35f0b9eeaf0f02b, user.id=0451f9cd1a224f47a21e570061ffb155) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:27.118965 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03125f70-5c8d-4a81-9ea8-d8881dd31448 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:27.120694 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03125f70-5c8d-4a81-9ea8-d8881dd31448 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:27.142233 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 86/172] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Jun 8 11:52:26 2022] GET /identity/v3/role_assignments?user.id=0451f9cd1a224f47a21e570061ffb155&scope.project.id=8d69c66b67494123b35f0b9eeaf0f02b&role.id=028d4429a4554bbb88b3aec9f6a9d937 => generated 608 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:27.143913 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c3c91-4eb7-4aed-ae1a-d5b7b2dab564 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:27.144437 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c3c91-4eb7-4aed-ae1a-d5b7b2dab564 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:27.144920 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c3c91-4eb7-4aed-ae1a-d5b7b2dab564 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:27.146402 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 87/173] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:52:27.158094 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd9912-4ccd-41ef-80a1-8108429ab43e None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:27.158739 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd9912-4ccd-41ef-80a1-8108429ab43e None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:27.159221 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd9912-4ccd-41ef-80a1-8108429ab43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:27.200162 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-59dd9912-4ccd-41ef-80a1-8108429ab43e None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:27.202070 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-59dd9912-4ccd-41ef-80a1-8108429ab43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:27.228410 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:27.314245 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfefc5f4-c353-4c6c-bcac-ef42be4a14b8 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:27.330609 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 88/174] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:52:27.331859 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd9912-4ccd-41ef-80a1-8108429ab43e None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:27.363629 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:27.402685 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94952ccc-259f-46eb-98e0-876276342ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:27.404541 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94952ccc-259f-46eb-98e0-876276342ce1 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:27.405036 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94952ccc-259f-46eb-98e0-876276342ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:27.407046 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94952ccc-259f-46eb-98e0-876276342ce1 None admin] PATH_INFO: `/v3/projects/8d69c66b67494123b35f0b9eeaf0f02b` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:27.409795 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94952ccc-259f-46eb-98e0-876276342ce1 None admin] RBAC: Authorizing `identity:get_project(project_id=8d69c66b67494123b35f0b9eeaf0f02b)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:27.411542 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94952ccc-259f-46eb-98e0-876276342ce1 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:27.415685 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 87/175] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Jun 8 11:52:27 2022] GET /identity/v3/projects/8d69c66b67494123b35f0b9eeaf0f02b => generated 298 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:27.417394 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94952ccc-259f-46eb-98e0-876276342ce1 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:27.462188 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd9912-4ccd-41ef-80a1-8108429ab43e None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:27.506855 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f4516-1add-4065-9a60-978acc7f74da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:27.508051 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f4516-1add-4065-9a60-978acc7f74da None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:27.508552 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f4516-1add-4065-9a60-978acc7f74da None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:27.509083 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f4516-1add-4065-9a60-978acc7f74da None admin] PATH_INFO: `/v3/roles/member` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:27.521940 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329f4516-1add-4065-9a60-978acc7f74da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:52:27.532408 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-329f4516-1add-4065-9a60-978acc7f74da None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 11:52:27.532408 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:52:27.532408 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:52:27.532408 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:52:27.532408 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:52:27.532408 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:52:27.532408 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:52:27.532408 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:52:27.532408 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:52:27.532408 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:52:27.532408 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:52:27.532408 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:52:27.532408 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:52:27.532408 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:52:27.532408 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:52:27.532408 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:52:27.533315 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:52:27.533315 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:52:27.533315 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:52:27.533315 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:52:27.533315 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:52:27.533315 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:52:27.533315 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:52:27.533315 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:52:27.533315 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:52:27.533315 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:52:27.533315 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:52:27.533315 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:52:27.533315 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:52:27.533315 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:52:27.533315 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:52:27.533315 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:52:27.534092 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:52:27.534092 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:52:27.534092 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:52:27.534092 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:52:27.534092 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:52:27.534092 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:52:27.534092 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:52:27.534092 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:52:27.534092 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:52:27.534092 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:52:27.534092 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 11:52:27.534092 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:52:27.536609 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 89/176] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:52:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:52:27.537565 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f4516-1add-4065-9a60-978acc7f74da None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:27.546320 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94952ccc-259f-46eb-98e0-876276342ce1 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:27.592241 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9074a68-6297-431b-a0cf-e0e403ca9c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:27.593521 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9074a68-6297-431b-a0cf-e0e403ca9c15 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:27.593951 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9074a68-6297-431b-a0cf-e0e403ca9c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:27.594437 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9074a68-6297-431b-a0cf-e0e403ca9c15 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:27.605927 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9074a68-6297-431b-a0cf-e0e403ca9c15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:52:27.617061 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-f9074a68-6297-431b-a0cf-e0e403ca9c15 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 11:52:27.617061 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:52:27.617061 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:52:27.617061 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:52:27.617061 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:52:27.617061 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:52:27.617061 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:52:27.617061 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:52:27.617061 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:52:27.617061 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:52:27.617061 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:52:27.617061 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:52:27.617061 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:52:27.617061 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:52:27.617061 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:52:27.617061 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:52:27.617986 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:52:27.617986 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:52:27.617986 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:52:27.617986 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:52:27.617986 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:52:27.617986 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:52:27.617986 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:52:27.617986 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:52:27.617986 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:52:27.617986 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:52:27.617986 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:52:27.617986 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:52:27.617986 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:52:27.617986 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:52:27.617986 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:52:27.617986 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:52:27.618781 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:52:27.618781 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:52:27.618781 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:52:27.618781 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:52:27.618781 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:52:27.618781 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:52:27.618781 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:52:27.618781 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:52:27.618781 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:52:27.618781 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:52:27.618781 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 11:52:27.618781 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:52:27.621226 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 88/177] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Jun 8 11:52:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:52:27.623024 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9074a68-6297-431b-a0cf-e0e403ca9c15 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:27.626679 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:27.678872 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:27.698378 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f4516-1add-4065-9a60-978acc7f74da None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:27.739026 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597984e3-5d71-4142-9efc-593b5a11385a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:27.739695 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597984e3-5d71-4142-9efc-593b5a11385a None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:27.739986 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597984e3-5d71-4142-9efc-593b5a11385a None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:27.740323 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597984e3-5d71-4142-9efc-593b5a11385a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:27.741168 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597984e3-5d71-4142-9efc-593b5a11385a None admin] RBAC: Adding query filter params (role.id=b3d7a91b614d49a3bc751e1d330a67cf, scope.project.id=8d69c66b67494123b35f0b9eeaf0f02b, user.id=1541e9b140b0436399c5ed9a4362ef6b) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:27.741486 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597984e3-5d71-4142-9efc-593b5a11385a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:27.742929 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597984e3-5d71-4142-9efc-593b5a11385a None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:27.753608 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 90/178] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Jun 8 11:52:27 2022] GET /identity/v3/role_assignments?user.id=1541e9b140b0436399c5ed9a4362ef6b&scope.project.id=8d69c66b67494123b35f0b9eeaf0f02b&role.id=b3d7a91b614d49a3bc751e1d330a67cf => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:27.753608 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0e598-34c1-4036-bd63-d71f548a2b42 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:27.753608 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0e598-34c1-4036-bd63-d71f548a2b42 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:27.753608 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0e598-34c1-4036-bd63-d71f548a2b42 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:27.754258 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 91/179] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:52:27.756207 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0e598-34c1-4036-bd63-d71f548a2b42 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:27.778858 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9074a68-6297-431b-a0cf-e0e403ca9c15 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:27.831194 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dacb7c-8d95-4c9e-bde4-b116dd58fd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:27.832431 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dacb7c-8d95-4c9e-bde4-b116dd58fd01 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:27.833295 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dacb7c-8d95-4c9e-bde4-b116dd58fd01 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:27.833730 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dacb7c-8d95-4c9e-bde4-b116dd58fd01 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:27.834963 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dacb7c-8d95-4c9e-bde4-b116dd58fd01 None admin] RBAC: Adding query filter params (name=member) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:27.835427 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dacb7c-8d95-4c9e-bde4-b116dd58fd01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:27.838106 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dacb7c-8d95-4c9e-bde4-b116dd58fd01 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:27.855776 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 89/180] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Jun 8 11:52:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:27.858249 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf2b3de-9739-41de-ae4a-403b60289a1b None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:27.859309 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf2b3de-9739-41de-ae4a-403b60289a1b None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:27.859774 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf2b3de-9739-41de-ae4a-403b60289a1b None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:27.862222 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 90/181] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:52:27.864060 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333a1c4-8712-48f4-9c68-25d134d450b9 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:27.864545 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333a1c4-8712-48f4-9c68-25d134d450b9 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:27.864965 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333a1c4-8712-48f4-9c68-25d134d450b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:27.889782 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-d333a1c4-8712-48f4-9c68-25d134d450b9 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:27.891273 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-d333a1c4-8712-48f4-9c68-25d134d450b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:27.896485 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0e598-34c1-4036-bd63-d71f548a2b42 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:27.948234 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb59d72-0561-4fcc-9ff8-a6a3e5d88c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:27.949239 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb59d72-0561-4fcc-9ff8-a6a3e5d88c07 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:27.949673 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb59d72-0561-4fcc-9ff8-a6a3e5d88c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:27.950290 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb59d72-0561-4fcc-9ff8-a6a3e5d88c07 None admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:27.951762 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb59d72-0561-4fcc-9ff8-a6a3e5d88c07 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:27.952268 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb59d72-0561-4fcc-9ff8-a6a3e5d88c07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:27.954156 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb59d72-0561-4fcc-9ff8-a6a3e5d88c07 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:27.963635 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 92/182] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Jun 8 11:52:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:27.965423 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2e041-b5e3-4938-848c-eeff668c3ed1 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:27.965921 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2e041-b5e3-4938-848c-eeff668c3ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:27.966959 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2e041-b5e3-4938-848c-eeff668c3ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:27.972046 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:27.985501 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 91/183] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:52:27.986574 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d333a1c4-8712-48f4-9c68-25d134d450b9 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:27.987903 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-65a2e041-b5e3-4938-848c-eeff668c3ed1 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:27.989144 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-65a2e041-b5e3-4938-848c-eeff668c3ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:27.996950 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:28.079104 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 93/184] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:52:28.080031 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a2e041-b5e3-4938-848c-eeff668c3ed1 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:28.112752 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d333a1c4-8712-48f4-9c68-25d134d450b9 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:28.150523 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7761b37-2eda-44f1-a3d7-44142cb8eb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:28.151398 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7761b37-2eda-44f1-a3d7-44142cb8eb61 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:28.151685 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7761b37-2eda-44f1-a3d7-44142cb8eb61 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:28.152004 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7761b37-2eda-44f1-a3d7-44142cb8eb61 None admin] PATH_INFO: `/v3/users/1541e9b140b0436399c5ed9a4362ef6b` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:28.153205 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7761b37-2eda-44f1-a3d7-44142cb8eb61 None admin] RBAC: Authorizing `identity:get_user(user_id=1541e9b140b0436399c5ed9a4362ef6b)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:28.154784 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7761b37-2eda-44f1-a3d7-44142cb8eb61 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:28.156460 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 92/185] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Jun 8 11:52:27 2022] GET /identity/v3/users/1541e9b140b0436399c5ed9a4362ef6b => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:28.156460 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7761b37-2eda-44f1-a3d7-44142cb8eb61 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:28.197286 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a2e041-b5e3-4938-848c-eeff668c3ed1 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:28.223954 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:28.240036 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58734496-a1d3-486d-98d5-e14091d70423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:28.240960 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58734496-a1d3-486d-98d5-e14091d70423 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:28.241246 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58734496-a1d3-486d-98d5-e14091d70423 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:28.241524 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58734496-a1d3-486d-98d5-e14091d70423 None admin] PATH_INFO: `/v3/users/3838de79983a43f68a00c8dcfc770bf3` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:28.253745 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:28.256461 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58734496-a1d3-486d-98d5-e14091d70423 None admin] RBAC: Authorizing `identity:get_user(user_id=3838de79983a43f68a00c8dcfc770bf3)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:28.258460 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58734496-a1d3-486d-98d5-e14091d70423 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:28.264844 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 94/186] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Jun 8 11:52:28 2022] GET /identity/v3/users/3838de79983a43f68a00c8dcfc770bf3 => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:28.265435 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58734496-a1d3-486d-98d5-e14091d70423 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:28.269757 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7761b37-2eda-44f1-a3d7-44142cb8eb61 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:28.307402 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30488e20-1a82-4908-bece-930a383544a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:28.308226 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30488e20-1a82-4908-bece-930a383544a9 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:28.308510 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30488e20-1a82-4908-bece-930a383544a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:28.308779 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30488e20-1a82-4908-bece-930a383544a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:28.319167 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30488e20-1a82-4908-bece-930a383544a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:52:28.327684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-30488e20-1a82-4908-bece-930a383544a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:52:28.327684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:52:28.327684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:52:28.327684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:52:28.327684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:52:28.327684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:52:28.327684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:52:28.327684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:52:28.327684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:52:28.327684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:52:28.327684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:52:28.327684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:52:28.327684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:52:28.327684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:52:28.327684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:52:28.327684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:52:28.328715 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:52:28.328715 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:52:28.328715 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:52:28.328715 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:52:28.328715 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:52:28.328715 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:52:28.328715 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:52:28.328715 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:52:28.328715 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:52:28.328715 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:52:28.328715 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:52:28.328715 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:52:28.328715 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:52:28.328715 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:52:28.328715 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:52:28.328715 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:52:28.329494 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:52:28.329494 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:52:28.329494 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:52:28.329494 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:52:28.329494 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:52:28.329494 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:52:28.329494 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:52:28.329494 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:52:28.329494 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:52:28.329494 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:52:28.329494 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:52:28.329494 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:52:28.329494 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 93/187] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Jun 8 11:52:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:52:28.330177 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30488e20-1a82-4908-bece-930a383544a9 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:28.376444 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58734496-a1d3-486d-98d5-e14091d70423 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:28.410678 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e57218-e0b0-45b3-bb2c-527736ed0ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:28.411469 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e57218-e0b0-45b3-bb2c-527736ed0ecf None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:28.411750 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e57218-e0b0-45b3-bb2c-527736ed0ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:28.412033 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e57218-e0b0-45b3-bb2c-527736ed0ecf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:28.413227 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e57218-e0b0-45b3-bb2c-527736ed0ecf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:28.414678 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e57218-e0b0-45b3-bb2c-527736ed0ecf None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:28.416461 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 95/188] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:52:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:28.417061 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e57218-e0b0-45b3-bb2c-527736ed0ecf None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:28.433999 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30488e20-1a82-4908-bece-930a383544a9 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:28.456618 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:28.469232 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca74bf6-0ff0-45e5-b045-d65471086bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:28.469884 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca74bf6-0ff0-45e5-b045-d65471086bc4 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:28.470166 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca74bf6-0ff0-45e5-b045-d65471086bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:28.470449 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca74bf6-0ff0-45e5-b045-d65471086bc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:28.486785 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:28.519689 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e57218-e0b0-45b3-bb2c-527736ed0ecf None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:28.539195 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca74bf6-0ff0-45e5-b045-d65471086bc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:28.540706 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca74bf6-0ff0-45e5-b045-d65471086bc4 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:28.553169 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b12ed8e-48c5-47af-8eaa-ef23c6fa3de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:28.553819 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12ed8e-48c5-47af-8eaa-ef23c6fa3de5 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:28.554105 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12ed8e-48c5-47af-8eaa-ef23c6fa3de5 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:28.554380 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12ed8e-48c5-47af-8eaa-ef23c6fa3de5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:28.621277 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b12ed8e-48c5-47af-8eaa-ef23c6fa3de5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:28.623480 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b12ed8e-48c5-47af-8eaa-ef23c6fa3de5 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:28.645959 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 94/189] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:52:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 11:52:28.648667 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11a6c9-06fa-4bc1-ab98-2653683b2bac None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:28.648972 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11a6c9-06fa-4bc1-ab98-2653683b2bac None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:28.649580 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11a6c9-06fa-4bc1-ab98-2653683b2bac None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:28.651086 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 95/190] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:52:28.651814 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb11a6c9-06fa-4bc1-ab98-2653683b2bac None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:28.679486 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:28.694494 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:28.730692 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 96/191] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:52:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 11:52:28.731516 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b12ed8e-48c5-47af-8eaa-ef23c6fa3de5 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:28.761682 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb11a6c9-06fa-4bc1-ab98-2653683b2bac None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:28.797175 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e5e6d7-7841-44c8-aa50-8542328553d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:28.797842 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5e6d7-7841-44c8-aa50-8542328553d8 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:28.798132 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5e6d7-7841-44c8-aa50-8542328553d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:28.798408 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5e6d7-7841-44c8-aa50-8542328553d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:28.799157 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e5e6d7-7841-44c8-aa50-8542328553d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:28.799465 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e5e6d7-7841-44c8-aa50-8542328553d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:28.800880 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e5e6d7-7841-44c8-aa50-8542328553d8 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:28.809091 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 96/192] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:52:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:28.810021 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e5e6d7-7841-44c8-aa50-8542328553d8 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:28.833836 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b12ed8e-48c5-47af-8eaa-ef23c6fa3de5 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:28.868874 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d7acd-96f8-42b9-99be-8871497ac297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:28.869540 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d7acd-96f8-42b9-99be-8871497ac297 None admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:28.869825 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d7acd-96f8-42b9-99be-8871497ac297 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:28.870102 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d7acd-96f8-42b9-99be-8871497ac297 None admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:28.870808 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d7acd-96f8-42b9-99be-8871497ac297 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:28.872341 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d7acd-96f8-42b9-99be-8871497ac297 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:28.894623 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:28.898187 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 97/193] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Jun 8 11:52:28 2022] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 11:52:28.899349 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6d9c0-903c-4911-aa6f-edf32fda01ad None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:28.899649 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6d9c0-903c-4911-aa6f-edf32fda01ad None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:28.899981 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6d9c0-903c-4911-aa6f-edf32fda01ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:28.912743 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e5e6d7-7841-44c8-aa50-8542328553d8 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:28.922835 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-27c6d9c0-903c-4911-aa6f-edf32fda01ad None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:28.924427 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-27c6d9c0-903c-4911-aa6f-edf32fda01ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:28.950884 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:28.987881 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220fbff-8123-420c-9450-ae4dad42e056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:28.987881 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220fbff-8123-420c-9450-ae4dad42e056 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:28.987881 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220fbff-8123-420c-9450-ae4dad42e056 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:28.987881 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220fbff-8123-420c-9450-ae4dad42e056 None admin] PATH_INFO: `/v3/projects/755ef449f1074a058098fd57905ba7ca` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:28.996206 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9220fbff-8123-420c-9450-ae4dad42e056 None admin] RBAC: Authorizing `identity:get_project(project_id=755ef449f1074a058098fd57905ba7ca)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:28.996206 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9220fbff-8123-420c-9450-ae4dad42e056 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:29.004561 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 97/194] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Jun 8 11:52:28 2022] GET /identity/v3/projects/755ef449f1074a058098fd57905ba7ca => generated 312 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:29.004561 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220fbff-8123-420c-9450-ae4dad42e056 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:29.044232 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 98/195] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:52:29.044232 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c6d9c0-903c-4911-aa6f-edf32fda01ad None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:29.149894 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220fbff-8123-420c-9450-ae4dad42e056 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:29.170153 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c6d9c0-903c-4911-aa6f-edf32fda01ad None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:29.198476 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c17da2-3092-4a2c-a548-f865f63c77d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:29.199364 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c17da2-3092-4a2c-a548-f865f63c77d7 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:29.200023 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c17da2-3092-4a2c-a548-f865f63c77d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:29.200023 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c17da2-3092-4a2c-a548-f865f63c77d7 None admin] PATH_INFO: `/v3/projects/226a798c297d4f20b3999a94a6dbe9d5` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:29.202446 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c17da2-3092-4a2c-a548-f865f63c77d7 None admin] RBAC: Authorizing `identity:get_project(project_id=226a798c297d4f20b3999a94a6dbe9d5)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:29.204889 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c17da2-3092-4a2c-a548-f865f63c77d7 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:29.207226 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 98/196] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Jun 8 11:52:29 2022] GET /identity/v3/projects/226a798c297d4f20b3999a94a6dbe9d5 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:29.207226 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c17da2-3092-4a2c-a548-f865f63c77d7 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:29.226759 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a046f-4a06-40c0-94a3-c93098388766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:29.227656 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a046f-4a06-40c0-94a3-c93098388766 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:29.227942 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a046f-4a06-40c0-94a3-c93098388766 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:29.228651 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a046f-4a06-40c0-94a3-c93098388766 None admin] PATH_INFO: `/v3/users/3838de79983a43f68a00c8dcfc770bf3` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:29.230839 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a046f-4a06-40c0-94a3-c93098388766 None admin] RBAC: Authorizing `identity:get_user(user_id=3838de79983a43f68a00c8dcfc770bf3)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:29.232047 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a046f-4a06-40c0-94a3-c93098388766 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:29.234733 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 99/197] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Jun 8 11:52:29 2022] GET /identity/v3/users/3838de79983a43f68a00c8dcfc770bf3 => generated 283 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:29.235288 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a046f-4a06-40c0-94a3-c93098388766 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:29.258628 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:29.285214 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:29.409994 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a046f-4a06-40c0-94a3-c93098388766 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:29.433474 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c17da2-3092-4a2c-a548-f865f63c77d7 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:29.449251 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab95c0b-a79f-49aa-9534-f12db9a7c6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:29.450237 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab95c0b-a79f-49aa-9534-f12db9a7c6b2 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:29.451823 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab95c0b-a79f-49aa-9534-f12db9a7c6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:29.452229 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab95c0b-a79f-49aa-9534-f12db9a7c6b2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:29.463629 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab95c0b-a79f-49aa-9534-f12db9a7c6b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:52:29.472874 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-eab95c0b-a79f-49aa-9534-f12db9a7c6b2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 11:52:29.472874 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:52:29.472874 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:52:29.472874 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:52:29.472874 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:52:29.472874 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:52:29.472874 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:52:29.472874 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:52:29.472874 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:52:29.472874 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:52:29.472874 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:52:29.472874 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:52:29.472874 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:52:29.472874 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:52:29.472874 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:52:29.472874 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:52:29.473919 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:52:29.473919 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:52:29.473919 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:52:29.473919 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:52:29.473919 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:52:29.473919 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:52:29.473919 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:52:29.473919 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:52:29.473919 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:52:29.473919 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:52:29.473919 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:52:29.473919 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:52:29.473919 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:52:29.473919 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:52:29.473919 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:52:29.473919 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:52:29.475533 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:52:29.475533 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:52:29.475533 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:52:29.475533 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:52:29.475533 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:52:29.475533 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:52:29.475533 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:52:29.475533 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:52:29.475533 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:52:29.475533 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:52:29.475533 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 11:52:29.475533 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:52:29.475533 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 100/198] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:52:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:52:29.477240 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab95c0b-a79f-49aa-9534-f12db9a7c6b2 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:29.483325 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadfcf6a-6d24-4797-a354-477d005fd6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:29.483998 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadfcf6a-6d24-4797-a354-477d005fd6e8 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:29.484313 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadfcf6a-6d24-4797-a354-477d005fd6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:29.484587 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadfcf6a-6d24-4797-a354-477d005fd6e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:29.485432 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadfcf6a-6d24-4797-a354-477d005fd6e8 None admin] RBAC: Adding query filter params (role.id=3682372ab3c145ba87e8baa5c520625f, scope.project.id=755ef449f1074a058098fd57905ba7ca, user.id=1541e9b140b0436399c5ed9a4362ef6b) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:29.485743 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadfcf6a-6d24-4797-a354-477d005fd6e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:29.487196 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadfcf6a-6d24-4797-a354-477d005fd6e8 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:29.496668 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 99/199] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Jun 8 11:52:29 2022] GET /identity/v3/role_assignments?user.id=1541e9b140b0436399c5ed9a4362ef6b&scope.project.id=755ef449f1074a058098fd57905ba7ca&role.id=3682372ab3c145ba87e8baa5c520625f => generated 608 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:29.497832 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadfcf6a-6d24-4797-a354-477d005fd6e8 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:29.634989 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:29.654027 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadfcf6a-6d24-4797-a354-477d005fd6e8 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:29.690256 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:29.716898 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab95c0b-a79f-49aa-9534-f12db9a7c6b2 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:29.719927 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c2444-7cda-4f75-b451-6a615e103cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:29.720625 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c2444-7cda-4f75-b451-6a615e103cf8 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:29.720911 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c2444-7cda-4f75-b451-6a615e103cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:29.721183 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c2444-7cda-4f75-b451-6a615e103cf8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:29.766520 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51e55d-2525-4aa9-b378-1ad00b648aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:29.767182 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51e55d-2525-4aa9-b378-1ad00b648aed None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:29.767466 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51e55d-2525-4aa9-b378-1ad00b648aed None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:29.767739 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51e55d-2525-4aa9-b378-1ad00b648aed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:29.768632 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51e55d-2525-4aa9-b378-1ad00b648aed None admin] RBAC: Adding query filter params (role.id=b3d7a91b614d49a3bc751e1d330a67cf, scope.project.id=226a798c297d4f20b3999a94a6dbe9d5, user.id=3838de79983a43f68a00c8dcfc770bf3) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:29.768943 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51e55d-2525-4aa9-b378-1ad00b648aed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:29.770396 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51e55d-2525-4aa9-b378-1ad00b648aed None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:29.781128 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 101/200] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Jun 8 11:52:29 2022] GET /identity/v3/role_assignments?user.id=3838de79983a43f68a00c8dcfc770bf3&scope.project.id=226a798c297d4f20b3999a94a6dbe9d5&role.id=b3d7a91b614d49a3bc751e1d330a67cf => generated 259 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:29.782034 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51e55d-2525-4aa9-b378-1ad00b648aed None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:29.797715 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23c2444-7cda-4f75-b451-6a615e103cf8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:29.799221 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23c2444-7cda-4f75-b451-6a615e103cf8 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:29.914050 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51e55d-2525-4aa9-b378-1ad00b648aed None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:29.941726 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:29.966085 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371939e-cbb3-406c-b3c1-da8b87673bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:29.966804 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371939e-cbb3-406c-b3c1-da8b87673bbc None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:29.967182 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371939e-cbb3-406c-b3c1-da8b87673bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:29.967460 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371939e-cbb3-406c-b3c1-da8b87673bbc None admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:29.968265 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4371939e-cbb3-406c-b3c1-da8b87673bbc None admin] RBAC: Adding query filter params (name=reader) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:29.968571 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4371939e-cbb3-406c-b3c1-da8b87673bbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:29.970008 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4371939e-cbb3-406c-b3c1-da8b87673bbc None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:29.976731 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 100/201] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:52:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 11:52:29.983292 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c2444-7cda-4f75-b451-6a615e103cf8 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:29.994277 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 102/202] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Jun 8 11:52:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:30.009383 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371939e-cbb3-406c-b3c1-da8b87673bbc None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:30.025747 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:30.167554 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371939e-cbb3-406c-b3c1-da8b87673bbc None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:30.180127 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c2444-7cda-4f75-b451-6a615e103cf8 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:30.207334 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d405b8e6-23f2-4afa-a4c1-56c06e00e1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:30.208149 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405b8e6-23f2-4afa-a4c1-56c06e00e1ac None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:30.208452 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405b8e6-23f2-4afa-a4c1-56c06e00e1ac None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:30.208722 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405b8e6-23f2-4afa-a4c1-56c06e00e1ac None admin] PATH_INFO: `/v3/users/258fc748181243419d25225e41460a9e` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:30.213318 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d405b8e6-23f2-4afa-a4c1-56c06e00e1ac None admin] RBAC: Authorizing `identity:get_user(user_id=258fc748181243419d25225e41460a9e)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:30.214778 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d405b8e6-23f2-4afa-a4c1-56c06e00e1ac None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:30.217469 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 103/203] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Jun 8 11:52:30 2022] GET /identity/v3/users/258fc748181243419d25225e41460a9e => generated 289 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:52:30.224911 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d405b8e6-23f2-4afa-a4c1-56c06e00e1ac None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:30.256883 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddebff50-5cf5-42ac-8336-c132482ecf8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:30.257755 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebff50-5cf5-42ac-8336-c132482ecf8b None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:30.258892 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebff50-5cf5-42ac-8336-c132482ecf8b None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:30.259169 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebff50-5cf5-42ac-8336-c132482ecf8b None admin] PATH_INFO: `/v3/projects/226a798c297d4f20b3999a94a6dbe9d5` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:30.261808 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddebff50-5cf5-42ac-8336-c132482ecf8b None admin] RBAC: Authorizing `identity:get_project(project_id=226a798c297d4f20b3999a94a6dbe9d5)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:30.263709 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddebff50-5cf5-42ac-8336-c132482ecf8b None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:30.265661 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 101/204] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Jun 8 11:52:29 2022] GET /identity/v3/projects/226a798c297d4f20b3999a94a6dbe9d5 => generated 302 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:52:30.271588 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddebff50-5cf5-42ac-8336-c132482ecf8b None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:30.336682 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:30.379630 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:30.410239 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d405b8e6-23f2-4afa-a4c1-56c06e00e1ac None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:30.440603 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddebff50-5cf5-42ac-8336-c132482ecf8b None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:30.465044 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e7eb6c-c9c0-4696-831b-04d630cb3a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:30.465571 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7eb6c-c9c0-4696-831b-04d630cb3a13 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:30.465895 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7eb6c-c9c0-4696-831b-04d630cb3a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:30.466161 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7eb6c-c9c0-4696-831b-04d630cb3a13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:30.486136 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac519e-7b70-4e4a-9aa5-41eb1bb651df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:30.487215 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac519e-7b70-4e4a-9aa5-41eb1bb651df None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:30.487705 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac519e-7b70-4e4a-9aa5-41eb1bb651df None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:30.488207 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac519e-7b70-4e4a-9aa5-41eb1bb651df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:30.489257 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ac519e-7b70-4e4a-9aa5-41eb1bb651df None admin] RBAC: Adding query filter params (role.id=028d4429a4554bbb88b3aec9f6a9d937, scope.project.id=226a798c297d4f20b3999a94a6dbe9d5, user.id=3838de79983a43f68a00c8dcfc770bf3) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:30.489814 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ac519e-7b70-4e4a-9aa5-41eb1bb651df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:30.491537 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ac519e-7b70-4e4a-9aa5-41eb1bb651df None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:30.498765 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 102/205] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Jun 8 11:52:30 2022] GET /identity/v3/role_assignments?user.id=3838de79983a43f68a00c8dcfc770bf3&scope.project.id=226a798c297d4f20b3999a94a6dbe9d5&role.id=028d4429a4554bbb88b3aec9f6a9d937 => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:30.622840 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e7eb6c-c9c0-4696-831b-04d630cb3a13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:30.624344 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e7eb6c-c9c0-4696-831b-04d630cb3a13 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:30.714784 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:30.748747 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 104/206] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:52:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 11:52:30.754374 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac519e-7b70-4e4a-9aa5-41eb1bb651df None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:30.909045 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac519e-7b70-4e4a-9aa5-41eb1bb651df None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:30.928122 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:30.951959 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47399f3c-de49-42ac-8b5d-e60e41da2280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:30.953651 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47399f3c-de49-42ac-8b5d-e60e41da2280 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:30.954188 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47399f3c-de49-42ac-8b5d-e60e41da2280 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:30.954664 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47399f3c-de49-42ac-8b5d-e60e41da2280 None admin] PATH_INFO: `/v3/projects/8d69c66b67494123b35f0b9eeaf0f02b` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:30.958062 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47399f3c-de49-42ac-8b5d-e60e41da2280 None admin] RBAC: Authorizing `identity:get_project(project_id=8d69c66b67494123b35f0b9eeaf0f02b)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:30.959762 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47399f3c-de49-42ac-8b5d-e60e41da2280 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:30.961744 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 103/207] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Jun 8 11:52:30 2022] GET /identity/v3/projects/8d69c66b67494123b35f0b9eeaf0f02b => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:30.968565 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e7eb6c-c9c0-4696-831b-04d630cb3a13 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:31.116788 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e7eb6c-c9c0-4696-831b-04d630cb3a13 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:31.166123 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35800268-f5e0-4f26-a3f3-94990372e2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:31.166790 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35800268-f5e0-4f26-a3f3-94990372e2bd None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:31.167075 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35800268-f5e0-4f26-a3f3-94990372e2bd None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:31.167351 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35800268-f5e0-4f26-a3f3-94990372e2bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:31.168199 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35800268-f5e0-4f26-a3f3-94990372e2bd None admin] RBAC: Adding query filter params (role.id=0615a114184d403c8ee7d5c22d6630a9, scope.project.id=8d69c66b67494123b35f0b9eeaf0f02b, user.id=258fc748181243419d25225e41460a9e) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:31.168519 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35800268-f5e0-4f26-a3f3-94990372e2bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:31.170204 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35800268-f5e0-4f26-a3f3-94990372e2bd None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:31.181157 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 105/208] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Jun 8 11:52:30 2022] GET /identity/v3/role_assignments?user.id=258fc748181243419d25225e41460a9e&scope.project.id=8d69c66b67494123b35f0b9eeaf0f02b&role.id=0615a114184d403c8ee7d5c22d6630a9 => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:31.770936 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd827bc4-5c42-4089-b1d0-104271ca282b None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:31.771639 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd827bc4-5c42-4089-b1d0-104271ca282b None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:31.772132 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd827bc4-5c42-4089-b1d0-104271ca282b None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:31.773773 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 104/209] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:52:31.779735 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314d442-1797-4173-9650-411400bcec16 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:31.780299 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314d442-1797-4173-9650-411400bcec16 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:31.780801 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314d442-1797-4173-9650-411400bcec16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:31.799363 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-6314d442-1797-4173-9650-411400bcec16 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:31.800995 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-6314d442-1797-4173-9650-411400bcec16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:31.826615 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa21d1a-ad4e-4f49-884e-42a0d3125e31 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:31.826926 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa21d1a-ad4e-4f49-884e-42a0d3125e31 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:31.827180 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa21d1a-ad4e-4f49-884e-42a0d3125e31 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:31.828852 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 105/210] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:52:31.833837 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4b8bb-ce8e-426a-b8d3-06cdeb8cdfa1 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:31.834141 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4b8bb-ce8e-426a-b8d3-06cdeb8cdfa1 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:31.834417 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4b8bb-ce8e-426a-b8d3-06cdeb8cdfa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:31.843952 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:31.861393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-1aa4b8bb-ce8e-426a-b8d3-06cdeb8cdfa1 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:31.862590 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-1aa4b8bb-ce8e-426a-b8d3-06cdeb8cdfa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:31.885818 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 106/211] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:52:31.919958 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314d442-1797-4173-9650-411400bcec16 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:31.938818 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 106/212] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:52:31.965470 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4b8bb-ce8e-426a-b8d3-06cdeb8cdfa1 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:32.036715 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314d442-1797-4173-9650-411400bcec16 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:32.066443 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4b8bb-ce8e-426a-b8d3-06cdeb8cdfa1 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:32.073973 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a5337-ea16-4d41-a4e2-b34f90eee762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:32.074801 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a5337-ea16-4d41-a4e2-b34f90eee762 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:32.075079 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a5337-ea16-4d41-a4e2-b34f90eee762 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:32.077629 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a5337-ea16-4d41-a4e2-b34f90eee762 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:32.078880 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a5337-ea16-4d41-a4e2-b34f90eee762 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:32.080402 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a5337-ea16-4d41-a4e2-b34f90eee762 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:32.082201 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 107/213] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:52:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:52:32.082310 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:32.087519 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a5337-ea16-4d41-a4e2-b34f90eee762 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:32.106191 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d40f40b-57d1-4d45-8806-853d1bb4d514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:32.107156 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40f40b-57d1-4d45-8806-853d1bb4d514 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:32.107443 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40f40b-57d1-4d45-8806-853d1bb4d514 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:32.107717 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40f40b-57d1-4d45-8806-853d1bb4d514 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:32.119793 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d40f40b-57d1-4d45-8806-853d1bb4d514 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:52:32.129505 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-4d40f40b-57d1-4d45-8806-853d1bb4d514 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 11:52:32.129505 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:52:32.129505 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:52:32.129505 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:52:32.129505 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:52:32.129505 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:52:32.129505 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:52:32.129505 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:52:32.129505 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:52:32.129505 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:52:32.129505 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:52:32.129505 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:52:32.129505 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:52:32.129505 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:52:32.129505 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:52:32.129505 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:52:32.130387 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:52:32.130387 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:52:32.130387 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:52:32.130387 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:52:32.130387 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:52:32.130387 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:52:32.130387 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:52:32.130387 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:52:32.130387 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:52:32.130387 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:52:32.130387 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:52:32.130387 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:52:32.130387 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:52:32.130387 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:52:32.130387 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:52:32.130387 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:52:32.131171 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:52:32.131171 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:52:32.131171 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:52:32.131171 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:52:32.131171 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:52:32.131171 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:52:32.131171 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:52:32.131171 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:52:32.131171 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:52:32.131171 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:52:32.131171 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 11:52:32.131171 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:52:32.131756 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:32.136298 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 107/214] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:52:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:52:32.138258 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d40f40b-57d1-4d45-8806-853d1bb4d514 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:32.218241 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a5337-ea16-4d41-a4e2-b34f90eee762 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:32.254838 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713180f3-1805-44e8-94a8-131f367409d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:32.255618 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713180f3-1805-44e8-94a8-131f367409d1 None admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:32.255951 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713180f3-1805-44e8-94a8-131f367409d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:32.256258 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713180f3-1805-44e8-94a8-131f367409d1 None admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:32.256982 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713180f3-1805-44e8-94a8-131f367409d1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:32.257615 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d40f40b-57d1-4d45-8806-853d1bb4d514 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:32.258425 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713180f3-1805-44e8-94a8-131f367409d1 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:32.287023 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 108/215] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Jun 8 11:52:32 2022] POST /identity/v3/users => generated 297 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 11:52:32.311335 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474bbb4-c882-43ee-801f-ccee118b4dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:32.312046 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474bbb4-c882-43ee-801f-ccee118b4dfe None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:32.312360 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474bbb4-c882-43ee-801f-ccee118b4dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:32.312686 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474bbb4-c882-43ee-801f-ccee118b4dfe None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:32.313474 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5474bbb4-c882-43ee-801f-ccee118b4dfe None admin] RBAC: Adding query filter params (name=member) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:32.313923 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5474bbb4-c882-43ee-801f-ccee118b4dfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:32.315376 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5474bbb4-c882-43ee-801f-ccee118b4dfe None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:32.328088 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 108/216] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Jun 8 11:52:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:52:32.334019 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713180f3-1805-44e8-94a8-131f367409d1 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:32.451164 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:32.461156 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713180f3-1805-44e8-94a8-131f367409d1 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:32.501133 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca92ae-4acc-4232-a2cf-49434372becd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:32.502043 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca92ae-4acc-4232-a2cf-49434372becd None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:32.502322 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca92ae-4acc-4232-a2cf-49434372becd None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:32.502599 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca92ae-4acc-4232-a2cf-49434372becd None admin] PATH_INFO: `/v3/users/22d0ea2c89284635a3514899d9ac52eb` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:32.517592 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ca92ae-4acc-4232-a2cf-49434372becd None admin] RBAC: Authorizing `identity:get_user(user_id=22d0ea2c89284635a3514899d9ac52eb)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:32.519082 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ca92ae-4acc-4232-a2cf-49434372becd None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:32.520863 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 109/217] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Jun 8 11:52:32 2022] GET /identity/v3/users/22d0ea2c89284635a3514899d9ac52eb => generated 297 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:32.526436 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474bbb4-c882-43ee-801f-ccee118b4dfe None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:32.546296 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9798133-fe1e-4765-9608-0c17691b8f22 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:32.546296 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9798133-fe1e-4765-9608-0c17691b8f22 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:32.546296 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9798133-fe1e-4765-9608-0c17691b8f22 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:32.547712 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 110/218] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 11:52:32.553234 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ca06f-850f-4eb8-8fbb-11e4cc725fc8 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:32.553522 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ca06f-850f-4eb8-8fbb-11e4cc725fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:32.553858 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ca06f-850f-4eb8-8fbb-11e4cc725fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:32.575138 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-812ca06f-850f-4eb8-8fbb-11e4cc725fc8 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:32.576388 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-812ca06f-850f-4eb8-8fbb-11e4cc725fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:32.579621 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:32.665068 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474bbb4-c882-43ee-801f-ccee118b4dfe None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:32.667544 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 111/219] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 11:52:32.690607 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ca06f-850f-4eb8-8fbb-11e4cc725fc8 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:32.705797 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f9817-4f3d-4e9a-8dda-7e0774c93fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:32.706486 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f9817-4f3d-4e9a-8dda-7e0774c93fd2 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:32.706865 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f9817-4f3d-4e9a-8dda-7e0774c93fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:32.707281 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f9817-4f3d-4e9a-8dda-7e0774c93fd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:32.787430 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31f9817-4f3d-4e9a-8dda-7e0774c93fd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:32.789021 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31f9817-4f3d-4e9a-8dda-7e0774c93fd2 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:32.795683 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:32.819587 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ca06f-850f-4eb8-8fbb-11e4cc725fc8 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:32.836507 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:32.865594 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4c9dc-10b6-4468-86b6-f2b7daadda24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:32.866417 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4c9dc-10b6-4468-86b6-f2b7daadda24 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:32.866705 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4c9dc-10b6-4468-86b6-f2b7daadda24 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:32.867749 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4c9dc-10b6-4468-86b6-f2b7daadda24 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:32.882538 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd4c9dc-10b6-4468-86b6-f2b7daadda24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:52:32.892817 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-4dd4c9dc-10b6-4468-86b6-f2b7daadda24 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 11:52:32.892817 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:52:32.892817 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:52:32.892817 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:52:32.892817 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:52:32.892817 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:52:32.892817 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:52:32.892817 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:52:32.892817 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:52:32.892817 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:52:32.892817 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:52:32.892817 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:52:32.892817 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:52:32.892817 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:52:32.892817 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:52:32.892817 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:52:32.893725 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:52:32.893725 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:52:32.893725 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:52:32.893725 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:52:32.893725 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:52:32.893725 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:52:32.893725 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:52:32.893725 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:52:32.893725 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:52:32.893725 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:52:32.893725 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:52:32.893725 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:52:32.893725 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:52:32.893725 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:52:32.893725 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:52:32.893725 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:52:32.894492 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:52:32.894492 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:52:32.894492 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:52:32.894492 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:52:32.894492 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:52:32.894492 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:52:32.894492 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:52:32.894492 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:52:32.894492 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:52:32.894492 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:52:32.894492 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 11:52:32.894492 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:52:32.894492 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 112/220] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Jun 8 11:52:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 11:52:32.899635 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4c9dc-10b6-4468-86b6-f2b7daadda24 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:32.930087 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 109/221] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:52:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 11:52:32.935957 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f9817-4f3d-4e9a-8dda-7e0774c93fd2 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:33.007574 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4c9dc-10b6-4468-86b6-f2b7daadda24 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:33.042887 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac240a-e622-402c-84d4-5fcd83f8b33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:33.043620 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac240a-e622-402c-84d4-5fcd83f8b33c None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:33.044476 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac240a-e622-402c-84d4-5fcd83f8b33c None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:33.044761 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac240a-e622-402c-84d4-5fcd83f8b33c None admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:33.045535 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efac240a-e622-402c-84d4-5fcd83f8b33c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:33.045831 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efac240a-e622-402c-84d4-5fcd83f8b33c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:33.047301 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efac240a-e622-402c-84d4-5fcd83f8b33c None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:33.055789 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 113/222] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Jun 8 11:52:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:52:33.061870 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f91bcc-fa87-4df7-96df-f0600f478eb3 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:33.062163 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f91bcc-fa87-4df7-96df-f0600f478eb3 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:33.062448 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f91bcc-fa87-4df7-96df-f0600f478eb3 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:33.064081 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 114/223] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:52:33.064636 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f91bcc-fa87-4df7-96df-f0600f478eb3 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:33.068640 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:33.071663 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f9817-4f3d-4e9a-8dda-7e0774c93fd2 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:33.112507 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618516e8-60c8-4222-af6c-2d0f015fc089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:33.113755 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618516e8-60c8-4222-af6c-2d0f015fc089 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:33.114235 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618516e8-60c8-4222-af6c-2d0f015fc089 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:33.114728 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618516e8-60c8-4222-af6c-2d0f015fc089 None admin] PATH_INFO: `/v3/projects/226a798c297d4f20b3999a94a6dbe9d5` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:33.116079 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618516e8-60c8-4222-af6c-2d0f015fc089 None admin] RBAC: Authorizing `identity:get_project(project_id=226a798c297d4f20b3999a94a6dbe9d5)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:33.117851 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618516e8-60c8-4222-af6c-2d0f015fc089 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:33.119812 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 110/224] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Jun 8 11:52:32 2022] GET /identity/v3/projects/226a798c297d4f20b3999a94a6dbe9d5 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:52:33.121329 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f006d07-16f3-4a8d-b93d-8fbbc00156a7 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:33.121848 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f006d07-16f3-4a8d-b93d-8fbbc00156a7 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:33.122453 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f006d07-16f3-4a8d-b93d-8fbbc00156a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:33.129028 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:33.142937 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-6f006d07-16f3-4a8d-b93d-8fbbc00156a7 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:33.144511 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-6f006d07-16f3-4a8d-b93d-8fbbc00156a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:33.175997 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f91bcc-fa87-4df7-96df-f0600f478eb3 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:33.211189 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a31da6-3082-4874-b7e1-05ca1c02dd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:33.212070 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a31da6-3082-4874-b7e1-05ca1c02dd9d None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:33.212394 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a31da6-3082-4874-b7e1-05ca1c02dd9d None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:33.212668 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a31da6-3082-4874-b7e1-05ca1c02dd9d None admin] PATH_INFO: `/v3/users/3838de79983a43f68a00c8dcfc770bf3` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:33.213912 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a31da6-3082-4874-b7e1-05ca1c02dd9d None admin] RBAC: Authorizing `identity:get_user(user_id=3838de79983a43f68a00c8dcfc770bf3)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:33.215433 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a31da6-3082-4874-b7e1-05ca1c02dd9d None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:33.217898 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 115/225] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Jun 8 11:52:33 2022] GET /identity/v3/users/3838de79983a43f68a00c8dcfc770bf3 => generated 283 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:33.220294 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a31da6-3082-4874-b7e1-05ca1c02dd9d None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:33.223993 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 111/226] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:52:33.225617 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f006d07-16f3-4a8d-b93d-8fbbc00156a7 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:33.298493 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:33.330559 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a31da6-3082-4874-b7e1-05ca1c02dd9d None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:33.336276 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f006d07-16f3-4a8d-b93d-8fbbc00156a7 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:33.366111 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05372fd3-10f7-433b-8a95-99637bd10294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:33.366780 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05372fd3-10f7-433b-8a95-99637bd10294 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:33.367062 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05372fd3-10f7-433b-8a95-99637bd10294 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:33.367561 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05372fd3-10f7-433b-8a95-99637bd10294 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:33.368186 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05372fd3-10f7-433b-8a95-99637bd10294 None admin] RBAC: Adding query filter params (role.id=3682372ab3c145ba87e8baa5c520625f, scope.project.id=226a798c297d4f20b3999a94a6dbe9d5, user.id=22d0ea2c89284635a3514899d9ac52eb) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:33.368508 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05372fd3-10f7-433b-8a95-99637bd10294 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:33.369945 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05372fd3-10f7-433b-8a95-99637bd10294 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:33.376938 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df241f1-fc3e-48a9-bc44-2ffdb40657af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:33.377079 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 116/227] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Jun 8 11:52:33 2022] GET /identity/v3/role_assignments?user.id=22d0ea2c89284635a3514899d9ac52eb&scope.project.id=226a798c297d4f20b3999a94a6dbe9d5&role.id=3682372ab3c145ba87e8baa5c520625f => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:33.377964 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05372fd3-10f7-433b-8a95-99637bd10294 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:33.378715 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df241f1-fc3e-48a9-bc44-2ffdb40657af None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:33.379192 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df241f1-fc3e-48a9-bc44-2ffdb40657af None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:33.379677 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df241f1-fc3e-48a9-bc44-2ffdb40657af None admin] PATH_INFO: `/v3/projects/226a798c297d4f20b3999a94a6dbe9d5` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:33.381316 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df241f1-fc3e-48a9-bc44-2ffdb40657af None admin] RBAC: Authorizing `identity:get_project(project_id=226a798c297d4f20b3999a94a6dbe9d5)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:33.383111 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df241f1-fc3e-48a9-bc44-2ffdb40657af None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:33.385277 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 112/228] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Jun 8 11:52:33 2022] GET /identity/v3/projects/226a798c297d4f20b3999a94a6dbe9d5 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:33.397327 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df241f1-fc3e-48a9-bc44-2ffdb40657af None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:33.400679 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:33.491934 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05372fd3-10f7-433b-8a95-99637bd10294 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:33.538890 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bfe151-473a-4a6c-8aac-132787131189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:33.539706 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bfe151-473a-4a6c-8aac-132787131189 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:33.539992 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bfe151-473a-4a6c-8aac-132787131189 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:33.540298 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bfe151-473a-4a6c-8aac-132787131189 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:33.543245 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:33.553312 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bfe151-473a-4a6c-8aac-132787131189 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:52:33.568631 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-f1bfe151-473a-4a6c-8aac-132787131189 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:52:33.568631 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:52:33.568631 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:52:33.568631 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:52:33.568631 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:52:33.568631 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:52:33.568631 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:52:33.568631 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:52:33.568631 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:52:33.568631 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:52:33.568631 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:52:33.568631 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:52:33.568631 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:52:33.568631 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:52:33.568631 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:52:33.568631 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:52:33.569586 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:52:33.569586 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:52:33.569586 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:52:33.569586 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:52:33.569586 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:52:33.569586 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:52:33.569586 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:52:33.569586 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:52:33.569586 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:52:33.569586 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:52:33.569586 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:52:33.569586 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:52:33.569586 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:52:33.569586 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:52:33.569586 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:52:33.569586 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:52:33.570375 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:52:33.570375 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:52:33.570375 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:52:33.570375 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:52:33.570375 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:52:33.570375 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:52:33.570375 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:52:33.570375 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:52:33.570375 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:52:33.570375 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:52:33.570375 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:52:33.570375 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:52:33.570375 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 117/229] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Jun 8 11:52:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:52:33.570375 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bfe151-473a-4a6c-8aac-132787131189 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:33.608197 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df241f1-fc3e-48a9-bc44-2ffdb40657af None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:33.667244 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ffb13-004a-4c40-8f0d-8fbb4ac5b9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:33.668545 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ffb13-004a-4c40-8f0d-8fbb4ac5b9bc None admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:33.669601 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ffb13-004a-4c40-8f0d-8fbb4ac5b9bc None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:33.670073 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ffb13-004a-4c40-8f0d-8fbb4ac5b9bc None admin] PATH_INFO: `/v3/projects/226a798c297d4f20b3999a94a6dbe9d5/users/3838de79983a43f68a00c8dcfc770bf3/roles/b3d7a91b614d49a3bc751e1d330a67cf` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:33.672929 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ffb13-004a-4c40-8f0d-8fbb4ac5b9bc None admin] RBAC: Authorizing `identity:create_grant(project_id=226a798c297d4f20b3999a94a6dbe9d5, user_id=3838de79983a43f68a00c8dcfc770bf3, role_id=b3d7a91b614d49a3bc751e1d330a67cf)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:33.674610 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ffb13-004a-4c40-8f0d-8fbb4ac5b9bc None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:33.679669 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bfe151-473a-4a6c-8aac-132787131189 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:33.706602 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 113/230] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Jun 8 11:52:33 2022] PUT /identity/v3/projects/226a798c297d4f20b3999a94a6dbe9d5/users/3838de79983a43f68a00c8dcfc770bf3/roles/b3d7a91b614d49a3bc751e1d330a67cf => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 11:52:33.730829 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4d5df-b360-4a99-b206-1c2c9517079e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:33.732060 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4d5df-b360-4a99-b206-1c2c9517079e None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:33.732430 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4d5df-b360-4a99-b206-1c2c9517079e None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:33.732722 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4d5df-b360-4a99-b206-1c2c9517079e None admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:33.733510 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d4d5df-b360-4a99-b206-1c2c9517079e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:33.733820 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d4d5df-b360-4a99-b206-1c2c9517079e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:33.735366 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d4d5df-b360-4a99-b206-1c2c9517079e None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:33.751375 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 118/231] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:52:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:33.757847 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ffb13-004a-4c40-8f0d-8fbb4ac5b9bc None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:33.838559 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:33.890549 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ffb13-004a-4c40-8f0d-8fbb4ac5b9bc None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:33.937231 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed83056-d5de-44f7-99ad-e68f7d4fd8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:33.938490 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed83056-d5de-44f7-99ad-e68f7d4fd8de None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:33.938992 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed83056-d5de-44f7-99ad-e68f7d4fd8de None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:33.939457 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed83056-d5de-44f7-99ad-e68f7d4fd8de None admin] PATH_INFO: `/v3/users/3838de79983a43f68a00c8dcfc770bf3` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:33.940979 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed83056-d5de-44f7-99ad-e68f7d4fd8de None admin] RBAC: Authorizing `identity:get_user(user_id=3838de79983a43f68a00c8dcfc770bf3)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:33.942688 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed83056-d5de-44f7-99ad-e68f7d4fd8de None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:33.944686 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 114/232] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Jun 8 11:52:33 2022] GET /identity/v3/users/3838de79983a43f68a00c8dcfc770bf3 => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:33.953088 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4d5df-b360-4a99-b206-1c2c9517079e None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:34.025550 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:34.074299 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4d5df-b360-4a99-b206-1c2c9517079e None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:34.113203 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dad5a1-a64c-46ed-91d9-b1b32531b5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:34.114599 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dad5a1-a64c-46ed-91d9-b1b32531b5ff None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:34.114994 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dad5a1-a64c-46ed-91d9-b1b32531b5ff None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:34.115283 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dad5a1-a64c-46ed-91d9-b1b32531b5ff None admin] PATH_INFO: `/v3/projects/226a798c297d4f20b3999a94a6dbe9d5` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:34.116640 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dad5a1-a64c-46ed-91d9-b1b32531b5ff None admin] RBAC: Authorizing `identity:get_project(project_id=226a798c297d4f20b3999a94a6dbe9d5)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:34.118314 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dad5a1-a64c-46ed-91d9-b1b32531b5ff None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:34.121617 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 119/233] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Jun 8 11:52:33 2022] GET /identity/v3/projects/226a798c297d4f20b3999a94a6dbe9d5 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:34.128285 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed83056-d5de-44f7-99ad-e68f7d4fd8de None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:34.280857 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed83056-d5de-44f7-99ad-e68f7d4fd8de None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:34.310425 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:34.321695 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60041fe-2319-4965-8175-d8ce3b0020cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:34.322606 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60041fe-2319-4965-8175-d8ce3b0020cd None admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:34.322895 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60041fe-2319-4965-8175-d8ce3b0020cd None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:34.323173 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60041fe-2319-4965-8175-d8ce3b0020cd None admin] PATH_INFO: `/v3/projects/226a798c297d4f20b3999a94a6dbe9d5/users/3838de79983a43f68a00c8dcfc770bf3/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:34.325796 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60041fe-2319-4965-8175-d8ce3b0020cd None admin] RBAC: Authorizing `identity:create_grant(project_id=226a798c297d4f20b3999a94a6dbe9d5, user_id=3838de79983a43f68a00c8dcfc770bf3, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:34.327606 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60041fe-2319-4965-8175-d8ce3b0020cd None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:34.352886 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 115/234] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Jun 8 11:52:34 2022] PUT /identity/v3/projects/226a798c297d4f20b3999a94a6dbe9d5/users/3838de79983a43f68a00c8dcfc770bf3/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 11:52:35.269450 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cdf03b-8139-4682-add7-e74787ec43ab None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:35.270301 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cdf03b-8139-4682-add7-e74787ec43ab None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:35.270754 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cdf03b-8139-4682-add7-e74787ec43ab None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:35.272322 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 120/235] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:52:35.277642 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23c097-5f5b-4ede-a072-8f02a50c7924 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:35.279122 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23c097-5f5b-4ede-a072-8f02a50c7924 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:35.279583 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23c097-5f5b-4ede-a072-8f02a50c7924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:35.301651 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-7c23c097-5f5b-4ede-a072-8f02a50c7924 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:35.303111 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-7c23c097-5f5b-4ede-a072-8f02a50c7924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:35.378953 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0aa4e-ea84-444e-8405-8a773ef3ee06 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:35.379276 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0aa4e-ea84-444e-8405-8a773ef3ee06 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:35.379510 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0aa4e-ea84-444e-8405-8a773ef3ee06 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:35.381145 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 121/236] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 11:52:35.383067 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 116/237] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:52:35.387287 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63edd645-c35a-4564-815e-56b48cb51e35 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:35.388462 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63edd645-c35a-4564-815e-56b48cb51e35 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:35.389163 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63edd645-c35a-4564-815e-56b48cb51e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:35.406139 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-63edd645-c35a-4564-815e-56b48cb51e35 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:35.407655 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-63edd645-c35a-4564-815e-56b48cb51e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:35.420687 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23c097-5f5b-4ede-a072-8f02a50c7924 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:35.532282 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 122/238] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:52:35.580129 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63edd645-c35a-4564-815e-56b48cb51e35 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:35.596439 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23c097-5f5b-4ede-a072-8f02a50c7924 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:35.624376 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:35.639436 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760e39e-d607-4437-827d-5d2a6626e4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:35.640560 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760e39e-d607-4437-827d-5d2a6626e4d8 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:35.641048 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760e39e-d607-4437-827d-5d2a6626e4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:35.641519 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760e39e-d607-4437-827d-5d2a6626e4d8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:35.652582 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760e39e-d607-4437-827d-5d2a6626e4d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:52:35.661143 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-5760e39e-d607-4437-827d-5d2a6626e4d8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 11:52:35.661143 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:52:35.661143 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:52:35.661143 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:52:35.661143 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:52:35.661143 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:52:35.661143 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:52:35.661143 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:52:35.661143 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:52:35.661143 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:52:35.661143 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:52:35.661143 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:52:35.661143 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:52:35.661143 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:52:35.661143 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:52:35.661143 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:52:35.662002 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:52:35.662002 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:52:35.662002 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:52:35.662002 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:52:35.662002 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:52:35.662002 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:52:35.662002 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:52:35.662002 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:52:35.662002 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:52:35.662002 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:52:35.662002 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:52:35.662002 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:52:35.662002 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:52:35.662002 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:52:35.662002 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:52:35.662002 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:52:35.662785 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:52:35.662785 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:52:35.662785 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:52:35.662785 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:52:35.662785 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:52:35.662785 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:52:35.662785 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:52:35.662785 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:52:35.662785 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:52:35.662785 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:52:35.662785 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 11:52:35.662785 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:52:35.665184 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 117/239] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:52:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 11:52:35.673492 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760e39e-d607-4437-827d-5d2a6626e4d8 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:35.692571 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:35.734949 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63edd645-c35a-4564-815e-56b48cb51e35 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:35.782476 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b84a6-0426-4aed-88a2-9bf5a31d5056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:35.784258 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b84a6-0426-4aed-88a2-9bf5a31d5056 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:35.785495 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b84a6-0426-4aed-88a2-9bf5a31d5056 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:35.786902 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b84a6-0426-4aed-88a2-9bf5a31d5056 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:35.789784 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6b84a6-0426-4aed-88a2-9bf5a31d5056 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:35.794217 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6b84a6-0426-4aed-88a2-9bf5a31d5056 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:35.800606 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 123/240] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:52:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:35.802537 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b84a6-0426-4aed-88a2-9bf5a31d5056 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:35.870624 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760e39e-d607-4437-827d-5d2a6626e4d8 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:35.914932 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe799e-67f0-4de1-85af-33ecbbd822c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:35.917104 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe799e-67f0-4de1-85af-33ecbbd822c8 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:35.919309 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe799e-67f0-4de1-85af-33ecbbd822c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:35.920613 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe799e-67f0-4de1-85af-33ecbbd822c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:35.921603 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fe799e-67f0-4de1-85af-33ecbbd822c8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:35.923464 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fe799e-67f0-4de1-85af-33ecbbd822c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:35.926107 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fe799e-67f0-4de1-85af-33ecbbd822c8 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:35.944089 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 118/241] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Jun 8 11:52:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:35.951101 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe799e-67f0-4de1-85af-33ecbbd822c8 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:36.010308 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b84a6-0426-4aed-88a2-9bf5a31d5056 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:36.052632 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:36.057753 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:36.062696 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a51f31-b966-4aa2-a177-3a10d8ae5c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:36.063624 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a51f31-b966-4aa2-a177-3a10d8ae5c00 None admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:36.064103 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a51f31-b966-4aa2-a177-3a10d8ae5c00 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:36.064667 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a51f31-b966-4aa2-a177-3a10d8ae5c00 None admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:36.065806 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a51f31-b966-4aa2-a177-3a10d8ae5c00 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:36.067511 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a51f31-b966-4aa2-a177-3a10d8ae5c00 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:36.092324 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 124/242] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Jun 8 11:52:35 2022] POST /identity/v3/users => generated 293 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 11:52:36.155556 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe799e-67f0-4de1-85af-33ecbbd822c8 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:36.172654 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f0607-5a89-4cd2-90dc-f05c8f6c7ee2 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:36.173494 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f0607-5a89-4cd2-90dc-f05c8f6c7ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:36.174616 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f0607-5a89-4cd2-90dc-f05c8f6c7ee2 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:36.177247 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 125/243] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 11:52:36.182089 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746003e-a077-4312-ba62-74b6dab18be0 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:36.182646 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746003e-a077-4312-ba62-74b6dab18be0 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:36.183135 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746003e-a077-4312-ba62-74b6dab18be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:36.205648 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-b746003e-a077-4312-ba62-74b6dab18be0 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:36.207220 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-b746003e-a077-4312-ba62-74b6dab18be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:36.253614 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef2e33-0dea-432e-acc2-63f854f91d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:36.253868 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef2e33-0dea-432e-acc2-63f854f91d92 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:36.254106 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef2e33-0dea-432e-acc2-63f854f91d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:36.254381 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef2e33-0dea-432e-acc2-63f854f91d92 None admin] PATH_INFO: `/v3/users/a9c2b5c7502945da9aad5dcc25fc1766` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:36.294515 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 126/244] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 11:52:36.301014 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ef2e33-0dea-432e-acc2-63f854f91d92 None admin] RBAC: Authorizing `identity:get_user(user_id=a9c2b5c7502945da9aad5dcc25fc1766)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:36.302511 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ef2e33-0dea-432e-acc2-63f854f91d92 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:36.304722 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 119/245] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Jun 8 11:52:35 2022] GET /identity/v3/users/a9c2b5c7502945da9aad5dcc25fc1766 => generated 297 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:36.310679 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746003e-a077-4312-ba62-74b6dab18be0 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:36.335600 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef2e33-0dea-432e-acc2-63f854f91d92 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:36.441584 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746003e-a077-4312-ba62-74b6dab18be0 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:36.454041 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:36.485355 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062624db-2db7-4512-8b3c-b39138a15a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:36.486468 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062624db-2db7-4512-8b3c-b39138a15a78 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:36.486947 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062624db-2db7-4512-8b3c-b39138a15a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:36.487418 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062624db-2db7-4512-8b3c-b39138a15a78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:36.502526 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:36.505409 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef2e33-0dea-432e-acc2-63f854f91d92 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:36.557742 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd84796-d2bd-4457-bbef-6a9103143615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:36.559141 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd84796-d2bd-4457-bbef-6a9103143615 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:36.559674 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd84796-d2bd-4457-bbef-6a9103143615 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:36.560127 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd84796-d2bd-4457-bbef-6a9103143615 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:36.564655 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062624db-2db7-4512-8b3c-b39138a15a78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:36.566226 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062624db-2db7-4512-8b3c-b39138a15a78 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:36.574153 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd84796-d2bd-4457-bbef-6a9103143615 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:52:36.584883 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-abd84796-d2bd-4457-bbef-6a9103143615 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 11:52:36.584883 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:52:36.584883 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:52:36.584883 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:52:36.584883 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:52:36.584883 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:52:36.584883 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:52:36.584883 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:52:36.584883 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:52:36.584883 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:52:36.584883 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:52:36.584883 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:52:36.584883 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:52:36.584883 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:52:36.584883 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:52:36.584883 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:52:36.585878 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:52:36.585878 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:52:36.585878 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:52:36.585878 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:52:36.585878 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:52:36.585878 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:52:36.585878 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:52:36.585878 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:52:36.585878 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:52:36.585878 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:52:36.585878 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:52:36.585878 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:52:36.585878 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:52:36.585878 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:52:36.585878 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:52:36.585878 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:52:36.586647 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:52:36.586647 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:52:36.586647 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:52:36.586647 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:52:36.586647 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:52:36.586647 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:52:36.586647 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:52:36.586647 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:52:36.586647 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:52:36.586647 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:52:36.586647 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 11:52:36.586647 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:52:36.589963 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 120/246] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:52:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:52:36.596570 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd84796-d2bd-4457-bbef-6a9103143615 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:36.726610 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 127/247] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:52:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 11:52:36.732477 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062624db-2db7-4512-8b3c-b39138a15a78 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:36.756829 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd84796-d2bd-4457-bbef-6a9103143615 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:36.759326 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:36.806609 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00e79b2-4b54-4d65-adec-106be0fa64a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:36.807279 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e79b2-4b54-4d65-adec-106be0fa64a0 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:36.807561 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e79b2-4b54-4d65-adec-106be0fa64a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:36.807885 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e79b2-4b54-4d65-adec-106be0fa64a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:36.808650 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00e79b2-4b54-4d65-adec-106be0fa64a0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:36.808953 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00e79b2-4b54-4d65-adec-106be0fa64a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:36.810961 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00e79b2-4b54-4d65-adec-106be0fa64a0 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:36.820915 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 121/248] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Jun 8 11:52:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:36.822188 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446a615-fcef-411a-af1d-53bdbb80cd28 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:36.822481 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446a615-fcef-411a-af1d-53bdbb80cd28 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:36.822756 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446a615-fcef-411a-af1d-53bdbb80cd28 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:36.823994 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 122/249] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:52:36.827079 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446a615-fcef-411a-af1d-53bdbb80cd28 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:36.860750 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:36.901194 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062624db-2db7-4512-8b3c-b39138a15a78 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:36.964451 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e714df4-324c-4e6c-899b-30f1dab303fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:36.965380 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e714df4-324c-4e6c-899b-30f1dab303fc None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:36.966231 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e714df4-324c-4e6c-899b-30f1dab303fc None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:36.966522 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e714df4-324c-4e6c-899b-30f1dab303fc None admin] PATH_INFO: `/v3/projects/226a798c297d4f20b3999a94a6dbe9d5` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:36.968678 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e714df4-324c-4e6c-899b-30f1dab303fc None admin] RBAC: Authorizing `identity:get_project(project_id=226a798c297d4f20b3999a94a6dbe9d5)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:36.970166 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e714df4-324c-4e6c-899b-30f1dab303fc None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:36.973022 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 128/250] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Jun 8 11:52:36 2022] GET /identity/v3/projects/226a798c297d4f20b3999a94a6dbe9d5 => generated 302 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:52:36.974220 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7372764-a664-4b13-a4cc-5f907312f953 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:36.976132 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7372764-a664-4b13-a4cc-5f907312f953 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:36.976446 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7372764-a664-4b13-a4cc-5f907312f953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:37.007307 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446a615-fcef-411a-af1d-53bdbb80cd28 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:37.009759 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-f7372764-a664-4b13-a4cc-5f907312f953 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:37.011756 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-f7372764-a664-4b13-a4cc-5f907312f953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:37.069865 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b88881c-5f01-4241-bf96-4dda6d629467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:37.070660 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88881c-5f01-4241-bf96-4dda6d629467 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:37.070946 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88881c-5f01-4241-bf96-4dda6d629467 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:37.071222 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88881c-5f01-4241-bf96-4dda6d629467 None admin] PATH_INFO: `/v3/users/22d0ea2c89284635a3514899d9ac52eb` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:37.072570 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b88881c-5f01-4241-bf96-4dda6d629467 None admin] RBAC: Authorizing `identity:get_user(user_id=22d0ea2c89284635a3514899d9ac52eb)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:37.074035 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b88881c-5f01-4241-bf96-4dda6d629467 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:37.076404 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 123/251] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Jun 8 11:52:36 2022] GET /identity/v3/users/22d0ea2c89284635a3514899d9ac52eb => generated 297 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:37.079134 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b88881c-5f01-4241-bf96-4dda6d629467 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:37.139813 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 129/252] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:52:37.144816 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7372764-a664-4b13-a4cc-5f907312f953 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:37.164450 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:37.229130 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:37.240376 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b88881c-5f01-4241-bf96-4dda6d629467 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:37.277071 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b81894a-7109-4bf1-8410-dd398d9a4eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:37.277625 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81894a-7109-4bf1-8410-dd398d9a4eb8 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:37.278525 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81894a-7109-4bf1-8410-dd398d9a4eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:37.278944 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81894a-7109-4bf1-8410-dd398d9a4eb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:37.279829 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b81894a-7109-4bf1-8410-dd398d9a4eb8 None admin] RBAC: Adding query filter params (role.id=0615a114184d403c8ee7d5c22d6630a9, scope.project.id=226a798c297d4f20b3999a94a6dbe9d5, user.id=a9c2b5c7502945da9aad5dcc25fc1766) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:37.280365 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b81894a-7109-4bf1-8410-dd398d9a4eb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:37.281903 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b81894a-7109-4bf1-8410-dd398d9a4eb8 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:37.285308 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7372764-a664-4b13-a4cc-5f907312f953 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:37.288586 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 124/253] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Jun 8 11:52:37 2022] GET /identity/v3/role_assignments?user.id=a9c2b5c7502945da9aad5dcc25fc1766&scope.project.id=226a798c297d4f20b3999a94a6dbe9d5&role.id=0615a114184d403c8ee7d5c22d6630a9 => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:37.289859 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef5694-981b-4c36-98ce-d3aff7abf068 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:37.290218 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef5694-981b-4c36-98ce-d3aff7abf068 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:37.290568 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef5694-981b-4c36-98ce-d3aff7abf068 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:37.296727 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 125/254] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:52:37.298239 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef5694-981b-4c36-98ce-d3aff7abf068 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:37.327751 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eaa4e1-66fa-465a-a239-d488e5ba818f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:37.329441 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eaa4e1-66fa-465a-a239-d488e5ba818f None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:37.329999 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eaa4e1-66fa-465a-a239-d488e5ba818f None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:37.330488 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eaa4e1-66fa-465a-a239-d488e5ba818f None admin] PATH_INFO: `/v3/projects/226a798c297d4f20b3999a94a6dbe9d5` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:37.332551 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eaa4e1-66fa-465a-a239-d488e5ba818f None admin] RBAC: Authorizing `identity:get_project(project_id=226a798c297d4f20b3999a94a6dbe9d5)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:37.334289 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eaa4e1-66fa-465a-a239-d488e5ba818f None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:37.336402 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 130/255] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Jun 8 11:52:37 2022] GET /identity/v3/projects/226a798c297d4f20b3999a94a6dbe9d5 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:37.338073 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d528309-5dad-4702-acfc-05c5e68c5b21 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:37.338624 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d528309-5dad-4702-acfc-05c5e68c5b21 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:37.339147 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d528309-5dad-4702-acfc-05c5e68c5b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:37.358014 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-3d528309-5dad-4702-acfc-05c5e68c5b21 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:37.359545 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-3d528309-5dad-4702-acfc-05c5e68c5b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:37.417854 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef5694-981b-4c36-98ce-d3aff7abf068 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:37.436974 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 131/256] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:52:37.438171 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d528309-5dad-4702-acfc-05c5e68c5b21 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:37.446877 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:37.472562 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc901b0-5d40-4813-b401-d27b97be7f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:37.473550 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc901b0-5d40-4813-b401-d27b97be7f81 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:37.473930 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc901b0-5d40-4813-b401-d27b97be7f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:37.474644 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc901b0-5d40-4813-b401-d27b97be7f81 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:37.496334 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc901b0-5d40-4813-b401-d27b97be7f81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:52:37.508127 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-0dc901b0-5d40-4813-b401-d27b97be7f81 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 11:52:37.508127 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:52:37.508127 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:52:37.508127 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:52:37.508127 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:52:37.508127 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:52:37.508127 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:52:37.508127 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:52:37.508127 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:52:37.508127 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:52:37.508127 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:52:37.508127 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:52:37.508127 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:52:37.508127 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:52:37.508127 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:52:37.508127 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:52:37.509108 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:52:37.509108 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:52:37.509108 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:52:37.509108 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:52:37.509108 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:52:37.509108 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:52:37.509108 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:52:37.509108 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:52:37.509108 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:52:37.509108 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:52:37.509108 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:52:37.509108 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:52:37.509108 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:52:37.509108 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:52:37.509108 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:52:37.509108 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:52:37.510052 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:52:37.510052 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:52:37.510052 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:52:37.510052 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:52:37.510052 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:52:37.510052 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:52:37.510052 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:52:37.510052 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:52:37.510052 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:52:37.510052 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:52:37.510052 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 11:52:37.510052 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:52:37.510052 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 126/257] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Jun 8 11:52:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:52:37.510836 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc901b0-5d40-4813-b401-d27b97be7f81 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:37.529516 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:37.562787 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d528309-5dad-4702-acfc-05c5e68c5b21 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:37.601797 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3309d092-35e3-4f5c-91d8-e30bfa471117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:37.603032 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309d092-35e3-4f5c-91d8-e30bfa471117 None admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:37.603527 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309d092-35e3-4f5c-91d8-e30bfa471117 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:37.604026 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309d092-35e3-4f5c-91d8-e30bfa471117 None admin] PATH_INFO: `/v3/projects/226a798c297d4f20b3999a94a6dbe9d5/users/22d0ea2c89284635a3514899d9ac52eb/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:37.606971 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3309d092-35e3-4f5c-91d8-e30bfa471117 None admin] RBAC: Authorizing `identity:create_grant(project_id=226a798c297d4f20b3999a94a6dbe9d5, user_id=22d0ea2c89284635a3514899d9ac52eb, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:37.608971 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3309d092-35e3-4f5c-91d8-e30bfa471117 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:37.629238 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc901b0-5d40-4813-b401-d27b97be7f81 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:37.633653 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 132/258] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Jun 8 11:52:37 2022] PUT /identity/v3/projects/226a798c297d4f20b3999a94a6dbe9d5/users/22d0ea2c89284635a3514899d9ac52eb/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 11:52:37.634864 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3309d092-35e3-4f5c-91d8-e30bfa471117 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:37.675239 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e0ff5-8ed5-4105-ae7c-f0ffd2fced7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:37.675239 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e0ff5-8ed5-4105-ae7c-f0ffd2fced7a None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:37.675239 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e0ff5-8ed5-4105-ae7c-f0ffd2fced7a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:37.675239 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e0ff5-8ed5-4105-ae7c-f0ffd2fced7a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:37.688666 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e0ff5-8ed5-4105-ae7c-f0ffd2fced7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:52:37.697106 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-8a7e0ff5-8ed5-4105-ae7c-f0ffd2fced7a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:52:37.697106 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:52:37.697106 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:52:37.697106 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:52:37.697106 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:52:37.697106 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:52:37.697106 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:52:37.697106 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:52:37.697106 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:52:37.697106 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:52:37.697106 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:52:37.697106 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:52:37.697106 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:52:37.697106 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:52:37.697106 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:52:37.697106 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:52:37.698085 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:52:37.698085 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:52:37.698085 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:52:37.698085 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:52:37.698085 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:52:37.698085 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:52:37.698085 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:52:37.698085 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:52:37.698085 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:52:37.698085 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:52:37.698085 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:52:37.698085 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:52:37.698085 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:52:37.698085 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:52:37.698085 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:52:37.698085 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:52:37.704247 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:52:37.704247 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:52:37.704247 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:52:37.704247 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:52:37.704247 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:52:37.704247 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:52:37.704247 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:52:37.704247 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:52:37.704247 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:52:37.704247 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:52:37.704247 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:52:37.704247 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:52:37.704247 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 127/259] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Jun 8 11:52:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:52:37.704916 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e0ff5-8ed5-4105-ae7c-f0ffd2fced7a None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:37.764607 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:37.806366 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3309d092-35e3-4f5c-91d8-e30bfa471117 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:37.830458 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:37.851544 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f62493d-9d84-4f44-8839-7d9391e9f85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:37.852739 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62493d-9d84-4f44-8839-7d9391e9f85d None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:37.853259 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62493d-9d84-4f44-8839-7d9391e9f85d None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:37.853739 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62493d-9d84-4f44-8839-7d9391e9f85d None admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:37.854734 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f62493d-9d84-4f44-8839-7d9391e9f85d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:37.855255 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f62493d-9d84-4f44-8839-7d9391e9f85d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:37.858031 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f62493d-9d84-4f44-8839-7d9391e9f85d None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:37.869393 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 133/260] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Jun 8 11:52:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:37.875388 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f62493d-9d84-4f44-8839-7d9391e9f85d None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:37.907355 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e0ff5-8ed5-4105-ae7c-f0ffd2fced7a None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:37.983343 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec5981f-e62a-4696-8a95-eb07166847a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:37.985195 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5981f-e62a-4696-8a95-eb07166847a9 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:37.988274 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5981f-e62a-4696-8a95-eb07166847a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:37.989149 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5981f-e62a-4696-8a95-eb07166847a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:37.990263 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec5981f-e62a-4696-8a95-eb07166847a9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:37.990776 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec5981f-e62a-4696-8a95-eb07166847a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:37.993122 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec5981f-e62a-4696-8a95-eb07166847a9 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:38.016236 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 128/261] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:52:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:38.021825 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec5981f-e62a-4696-8a95-eb07166847a9 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:38.077212 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f62493d-9d84-4f44-8839-7d9391e9f85d None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:38.108629 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:38.117716 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab8bfb-2673-4c65-be3d-2d94b985b4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:38.118925 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab8bfb-2673-4c65-be3d-2d94b985b4b9 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:38.119432 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab8bfb-2673-4c65-be3d-2d94b985b4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:38.119967 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab8bfb-2673-4c65-be3d-2d94b985b4b9 None admin] PATH_INFO: `/v3/users/3838de79983a43f68a00c8dcfc770bf3` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:38.122307 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab8bfb-2673-4c65-be3d-2d94b985b4b9 None admin] RBAC: Authorizing `identity:get_user(user_id=3838de79983a43f68a00c8dcfc770bf3)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:38.124039 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab8bfb-2673-4c65-be3d-2d94b985b4b9 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:38.126339 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 134/262] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Jun 8 11:52:37 2022] GET /identity/v3/users/3838de79983a43f68a00c8dcfc770bf3 => generated 283 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:38.131597 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab8bfb-2673-4c65-be3d-2d94b985b4b9 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:38.225711 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec5981f-e62a-4696-8a95-eb07166847a9 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:38.269965 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d2dfe-7f83-493d-b3cd-4a34e0852b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:38.271679 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d2dfe-7f83-493d-b3cd-4a34e0852b10 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:38.272928 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d2dfe-7f83-493d-b3cd-4a34e0852b10 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:38.273221 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d2dfe-7f83-493d-b3cd-4a34e0852b10 None admin] PATH_INFO: `/v3/users/3838de79983a43f68a00c8dcfc770bf3` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:38.274557 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20d2dfe-7f83-493d-b3cd-4a34e0852b10 None admin] RBAC: Authorizing `identity:get_user(user_id=3838de79983a43f68a00c8dcfc770bf3)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:38.276136 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20d2dfe-7f83-493d-b3cd-4a34e0852b10 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:38.278080 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 129/263] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Jun 8 11:52:38 2022] GET /identity/v3/users/3838de79983a43f68a00c8dcfc770bf3 => generated 283 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:38.283323 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d2dfe-7f83-493d-b3cd-4a34e0852b10 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:38.291646 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:38.319059 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab8bfb-2673-4c65-be3d-2d94b985b4b9 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:38.358371 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93fa787-d9a2-4702-aad7-ae8bf6d8af69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:38.359881 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93fa787-d9a2-4702-aad7-ae8bf6d8af69 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:38.360398 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93fa787-d9a2-4702-aad7-ae8bf6d8af69 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:38.361035 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93fa787-d9a2-4702-aad7-ae8bf6d8af69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:38.433759 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:38.442546 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93fa787-d9a2-4702-aad7-ae8bf6d8af69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:38.444389 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93fa787-d9a2-4702-aad7-ae8bf6d8af69 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:38.515706 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d2dfe-7f83-493d-b3cd-4a34e0852b10 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:38.552222 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 135/264] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:52:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 11:52:38.560213 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93fa787-d9a2-4702-aad7-ae8bf6d8af69 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:38.644984 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be43d9ef-0ebd-4cac-89e3-6220299b018d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:38.645580 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43d9ef-0ebd-4cac-89e3-6220299b018d None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:38.645874 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43d9ef-0ebd-4cac-89e3-6220299b018d None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:38.646156 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43d9ef-0ebd-4cac-89e3-6220299b018d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:38.735281 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be43d9ef-0ebd-4cac-89e3-6220299b018d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:38.737310 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be43d9ef-0ebd-4cac-89e3-6220299b018d None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:38.740616 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:38.813167 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:38.826471 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93fa787-d9a2-4702-aad7-ae8bf6d8af69 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:38.862721 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48dbb66-fdf5-4c36-be73-47377d4a232a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:38.863556 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 130/265] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:52:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 11:52:38.863665 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48dbb66-fdf5-4c36-be73-47377d4a232a None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:38.863862 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48dbb66-fdf5-4c36-be73-47377d4a232a None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:38.868209 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48dbb66-fdf5-4c36-be73-47377d4a232a None admin] PATH_INFO: `/v3/projects/226a798c297d4f20b3999a94a6dbe9d5` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:38.870033 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48dbb66-fdf5-4c36-be73-47377d4a232a None admin] RBAC: Authorizing `identity:get_project(project_id=226a798c297d4f20b3999a94a6dbe9d5)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:38.870402 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be43d9ef-0ebd-4cac-89e3-6220299b018d None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:38.871506 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48dbb66-fdf5-4c36-be73-47377d4a232a None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:38.874504 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 136/266] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Jun 8 11:52:38 2022] GET /identity/v3/projects/226a798c297d4f20b3999a94a6dbe9d5 => generated 302 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:38.880549 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48dbb66-fdf5-4c36-be73-47377d4a232a None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:38.985826 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be43d9ef-0ebd-4cac-89e3-6220299b018d None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:38.988720 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:39.032498 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f08be5d-255a-482d-bdc5-2c11b3bf46ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:39.034047 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f08be5d-255a-482d-bdc5-2c11b3bf46ea None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:39.034533 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f08be5d-255a-482d-bdc5-2c11b3bf46ea None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:39.035177 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f08be5d-255a-482d-bdc5-2c11b3bf46ea None admin] PATH_INFO: `/v3/projects/226a798c297d4f20b3999a94a6dbe9d5` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:39.036694 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f08be5d-255a-482d-bdc5-2c11b3bf46ea None admin] RBAC: Authorizing `identity:get_project(project_id=226a798c297d4f20b3999a94a6dbe9d5)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:39.038537 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f08be5d-255a-482d-bdc5-2c11b3bf46ea None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:39.040623 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 131/267] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Jun 8 11:52:38 2022] GET /identity/v3/projects/226a798c297d4f20b3999a94a6dbe9d5 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:39.048740 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f08be5d-255a-482d-bdc5-2c11b3bf46ea None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:39.162162 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48dbb66-fdf5-4c36-be73-47377d4a232a None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:39.172338 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f08be5d-255a-482d-bdc5-2c11b3bf46ea None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:39.212568 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a321ebc5-af22-4534-833b-7dbb8045ea69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:39.213634 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a321ebc5-af22-4534-833b-7dbb8045ea69 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:39.214305 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a321ebc5-af22-4534-833b-7dbb8045ea69 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:39.214808 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a321ebc5-af22-4534-833b-7dbb8045ea69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:39.216385 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a321ebc5-af22-4534-833b-7dbb8045ea69 None admin] RBAC: Adding query filter params (role.id=028d4429a4554bbb88b3aec9f6a9d937, scope.project.id=226a798c297d4f20b3999a94a6dbe9d5, user.id=3838de79983a43f68a00c8dcfc770bf3) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:39.216903 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a321ebc5-af22-4534-833b-7dbb8045ea69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:39.219106 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a321ebc5-af22-4534-833b-7dbb8045ea69 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:39.226695 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 132/268] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Jun 8 11:52:39 2022] GET /identity/v3/role_assignments?user.id=3838de79983a43f68a00c8dcfc770bf3&scope.project.id=226a798c297d4f20b3999a94a6dbe9d5&role.id=028d4429a4554bbb88b3aec9f6a9d937 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:52:39.251569 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e42ea33-af87-4c30-9d62-60719282894d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:39.252190 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42ea33-af87-4c30-9d62-60719282894d None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:39.252550 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42ea33-af87-4c30-9d62-60719282894d None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:39.252838 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42ea33-af87-4c30-9d62-60719282894d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:39.253691 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e42ea33-af87-4c30-9d62-60719282894d None admin] RBAC: Adding query filter params (role.id=b3d7a91b614d49a3bc751e1d330a67cf, scope.project.id=226a798c297d4f20b3999a94a6dbe9d5, user.id=3838de79983a43f68a00c8dcfc770bf3) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:39.254009 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e42ea33-af87-4c30-9d62-60719282894d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:39.255474 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e42ea33-af87-4c30-9d62-60719282894d None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:39.266213 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 137/269] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Jun 8 11:52:38 2022] GET /identity/v3/role_assignments?user.id=3838de79983a43f68a00c8dcfc770bf3&scope.project.id=226a798c297d4f20b3999a94a6dbe9d5&role.id=b3d7a91b614d49a3bc751e1d330a67cf => generated 608 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:39.482271 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2e1f9-51d6-4f12-8336-a8f512cb00ca None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:39.483004 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2e1f9-51d6-4f12-8336-a8f512cb00ca None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:39.483508 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2e1f9-51d6-4f12-8336-a8f512cb00ca None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:39.485692 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 133/270] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:52:39.494210 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47086c77-21d6-447b-99c8-cadb15683432 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:39.495151 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47086c77-21d6-447b-99c8-cadb15683432 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:39.495658 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47086c77-21d6-447b-99c8-cadb15683432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:39.522698 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-47086c77-21d6-447b-99c8-cadb15683432 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:39.522698 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-47086c77-21d6-447b-99c8-cadb15683432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:39.551238 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:39.611157 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 138/271] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:52:39.656694 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2e1f9-51d6-4f12-8336-a8f512cb00ca None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:39.705058 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:39.790081 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2e1f9-51d6-4f12-8336-a8f512cb00ca None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:39.831584 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb70cdc-332c-479f-bc6b-56f6f7c316cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:39.832420 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb70cdc-332c-479f-bc6b-56f6f7c316cb None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:39.832709 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb70cdc-332c-479f-bc6b-56f6f7c316cb None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:39.833071 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb70cdc-332c-479f-bc6b-56f6f7c316cb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:39.834325 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb70cdc-332c-479f-bc6b-56f6f7c316cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:39.835863 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb70cdc-332c-479f-bc6b-56f6f7c316cb None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:39.837899 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 134/272] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:52:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:39.844370 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47086c77-21d6-447b-99c8-cadb15683432 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:39.970332 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47086c77-21d6-447b-99c8-cadb15683432 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:40.015772 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f11bbf-e49f-43bd-9966-0e2832d9a544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:40.016505 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f11bbf-e49f-43bd-9966-0e2832d9a544 None admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:40.016791 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f11bbf-e49f-43bd-9966-0e2832d9a544 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:40.017064 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f11bbf-e49f-43bd-9966-0e2832d9a544 None admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:40.017802 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f11bbf-e49f-43bd-9966-0e2832d9a544 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:40.019291 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f11bbf-e49f-43bd-9966-0e2832d9a544 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:40.050280 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 139/273] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Jun 8 11:52:39 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 11:52:40.085965 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f429745-cc5e-4118-a617-b48944b17bf2 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:40.086602 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f429745-cc5e-4118-a617-b48944b17bf2 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:40.087109 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f429745-cc5e-4118-a617-b48944b17bf2 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:40.089052 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 135/274] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:52:40.096777 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90efa1a-c5f9-446b-aca9-61aeca1d695f None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:40.097167 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90efa1a-c5f9-446b-aca9-61aeca1d695f None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:40.097321 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90efa1a-c5f9-446b-aca9-61aeca1d695f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:40.119192 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-c90efa1a-c5f9-446b-aca9-61aeca1d695f None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:40.120475 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-c90efa1a-c5f9-446b-aca9-61aeca1d695f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:40.132390 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:40.207707 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 140/275] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 11:52:40.232021 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f429745-cc5e-4118-a617-b48944b17bf2 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:40.338472 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f80921-a4d7-4506-b100-175c52b80d89 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:40.339101 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f80921-a4d7-4506-b100-175c52b80d89 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:40.339619 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f80921-a4d7-4506-b100-175c52b80d89 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:40.342294 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 141/276] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:52:40.343707 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f429745-cc5e-4118-a617-b48944b17bf2 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:40.348210 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:40.348379 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177541ff-0fde-46c6-831c-20e7e36df61a None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:40.348379 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177541ff-0fde-46c6-831c-20e7e36df61a None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:40.348379 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177541ff-0fde-46c6-831c-20e7e36df61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:40.372395 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-177541ff-0fde-46c6-831c-20e7e36df61a None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:40.373817 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-177541ff-0fde-46c6-831c-20e7e36df61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:40.388662 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8e73f-4afc-48dc-ab9a-29411e214a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:40.389787 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8e73f-4afc-48dc-ab9a-29411e214a3d None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:40.390072 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8e73f-4afc-48dc-ab9a-29411e214a3d None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:40.390618 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8e73f-4afc-48dc-ab9a-29411e214a3d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:40.402492 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8e73f-4afc-48dc-ab9a-29411e214a3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:52:40.412325 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-71f8e73f-4afc-48dc-ab9a-29411e214a3d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 11:52:40.412325 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:52:40.412325 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:52:40.412325 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:52:40.412325 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:52:40.412325 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:52:40.412325 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:52:40.412325 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:52:40.412325 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:52:40.412325 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:52:40.412325 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:52:40.412325 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:52:40.412325 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:52:40.412325 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:52:40.412325 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:52:40.412325 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:52:40.413282 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:52:40.413282 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:52:40.413282 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:52:40.413282 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:52:40.413282 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:52:40.413282 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:52:40.413282 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:52:40.413282 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:52:40.413282 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:52:40.413282 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:52:40.413282 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:52:40.413282 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:52:40.413282 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:52:40.413282 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:52:40.413282 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:52:40.413282 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:52:40.414099 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:52:40.414099 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:52:40.414099 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:52:40.414099 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:52:40.414099 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:52:40.414099 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:52:40.414099 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:52:40.414099 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:52:40.414099 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:52:40.414099 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:52:40.414099 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 11:52:40.414099 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:52:40.414099 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 136/277] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:52:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:52:40.419649 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8e73f-4afc-48dc-ab9a-29411e214a3d None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:40.461272 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 142/278] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:52:40.490402 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177541ff-0fde-46c6-831c-20e7e36df61a None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:40.549352 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8e73f-4afc-48dc-ab9a-29411e214a3d None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:40.596867 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:40.604710 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a7bda-756e-4f2b-a838-f6ff810c4284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:40.606582 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a7bda-756e-4f2b-a838-f6ff810c4284 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:40.606960 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a7bda-756e-4f2b-a838-f6ff810c4284 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:40.607528 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a7bda-756e-4f2b-a838-f6ff810c4284 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:40.612189 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8a7bda-756e-4f2b-a838-f6ff810c4284 None admin] RBAC: Adding query filter params (name=member) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:40.612189 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8a7bda-756e-4f2b-a838-f6ff810c4284 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:40.612189 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8a7bda-756e-4f2b-a838-f6ff810c4284 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:40.630939 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 137/279] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Jun 8 11:52:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:40.636644 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a7bda-756e-4f2b-a838-f6ff810c4284 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:40.642360 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177541ff-0fde-46c6-831c-20e7e36df61a None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:40.670093 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:40.713838 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf09d0b-58c5-4e7f-85a9-9f6f136bd1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:40.714679 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf09d0b-58c5-4e7f-85a9-9f6f136bd1d5 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:40.714968 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf09d0b-58c5-4e7f-85a9-9f6f136bd1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:40.715784 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf09d0b-58c5-4e7f-85a9-9f6f136bd1d5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:40.737541 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf09d0b-58c5-4e7f-85a9-9f6f136bd1d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:52:40.745909 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a7bda-756e-4f2b-a838-f6ff810c4284 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:40.763227 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-ebf09d0b-58c5-4e7f-85a9-9f6f136bd1d5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 11:52:40.763227 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:52:40.763227 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:52:40.763227 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:52:40.763227 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:52:40.763227 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:52:40.763227 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:52:40.763227 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:52:40.763227 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:52:40.763227 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:52:40.763227 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:52:40.763227 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:52:40.763227 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:52:40.763227 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:52:40.763227 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:52:40.763227 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:52:40.764193 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:52:40.764193 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:52:40.764193 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:52:40.764193 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:52:40.764193 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:52:40.764193 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:52:40.764193 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:52:40.764193 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:52:40.764193 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:52:40.764193 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:52:40.764193 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:52:40.764193 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:52:40.764193 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:52:40.764193 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:52:40.764193 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:52:40.764193 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:52:40.765486 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:52:40.765486 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:52:40.765486 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:52:40.765486 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:52:40.765486 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:52:40.765486 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:52:40.765486 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:52:40.765486 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:52:40.765486 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:52:40.765486 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:52:40.765486 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 11:52:40.765486 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:52:40.765486 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 143/280] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:52:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 11:52:40.780545 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf09d0b-58c5-4e7f-85a9-9f6f136bd1d5 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:40.789463 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b35b7-5ab4-43c4-a6a9-d86592b008f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:40.790349 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b35b7-5ab4-43c4-a6a9-d86592b008f9 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:40.790639 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b35b7-5ab4-43c4-a6a9-d86592b008f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:40.790915 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b35b7-5ab4-43c4-a6a9-d86592b008f9 None admin] PATH_INFO: `/v3/users/cceccf330e57455c9dc1967aab6736a1` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:40.806189 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4b35b7-5ab4-43c4-a6a9-d86592b008f9 None admin] RBAC: Authorizing `identity:get_user(user_id=cceccf330e57455c9dc1967aab6736a1)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:40.807665 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4b35b7-5ab4-43c4-a6a9-d86592b008f9 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:40.810308 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 138/281] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Jun 8 11:52:40 2022] GET /identity/v3/users/cceccf330e57455c9dc1967aab6736a1 => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:40.819747 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b35b7-5ab4-43c4-a6a9-d86592b008f9 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:40.941317 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:40.961439 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf09d0b-58c5-4e7f-85a9-9f6f136bd1d5 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:40.982737 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b35b7-5ab4-43c4-a6a9-d86592b008f9 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:41.002904 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea3fc69-23f6-4d58-861c-4998118f092d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:41.003959 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3fc69-23f6-4d58-861c-4998118f092d None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:41.005732 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3fc69-23f6-4d58-861c-4998118f092d None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:41.006212 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3fc69-23f6-4d58-861c-4998118f092d None admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:41.007160 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea3fc69-23f6-4d58-861c-4998118f092d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:41.007889 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea3fc69-23f6-4d58-861c-4998118f092d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:41.010351 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea3fc69-23f6-4d58-861c-4998118f092d None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:41.014409 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:41.028331 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 144/282] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Jun 8 11:52:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:41.037281 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea3fc69-23f6-4d58-861c-4998118f092d None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:41.045855 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2b7ac-d7c7-44ff-9706-5a8e13b58a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:41.045855 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2b7ac-d7c7-44ff-9706-5a8e13b58a7a None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:41.046247 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2b7ac-d7c7-44ff-9706-5a8e13b58a7a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:41.046445 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2b7ac-d7c7-44ff-9706-5a8e13b58a7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:41.047299 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f2b7ac-d7c7-44ff-9706-5a8e13b58a7a None admin] RBAC: Adding query filter params (role.id=3682372ab3c145ba87e8baa5c520625f, user.id=cceccf330e57455c9dc1967aab6736a1, scope.system=all) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:41.047616 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f2b7ac-d7c7-44ff-9706-5a8e13b58a7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:41.049097 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f2b7ac-d7c7-44ff-9706-5a8e13b58a7a None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:41.063525 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 139/283] 10.222.0.39 () {56 vars in 1308 bytes} [Wed Jun 8 11:52:40 2022] GET /identity/v3/role_assignments?user.id=cceccf330e57455c9dc1967aab6736a1&scope.system=all&role.id=3682372ab3c145ba87e8baa5c520625f => generated 226 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:41.207360 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8fe49-04d3-436f-a3b0-7cfafdc0dca9 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:41.207645 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8fe49-04d3-436f-a3b0-7cfafdc0dca9 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:41.207948 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8fe49-04d3-436f-a3b0-7cfafdc0dca9 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:41.209608 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 140/284] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 11:52:41.212007 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea3fc69-23f6-4d58-861c-4998118f092d None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:41.215297 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f28ef-02d9-4175-bd45-f167b76e4ef9 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:41.217331 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f28ef-02d9-4175-bd45-f167b76e4ef9 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:41.217613 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f28ef-02d9-4175-bd45-f167b76e4ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:41.236311 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-170f28ef-02d9-4175-bd45-f167b76e4ef9 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:41.237626 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-170f28ef-02d9-4175-bd45-f167b76e4ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:41.282685 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f046b8-447f-4179-9b2f-88a9d62776a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:41.283582 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f046b8-447f-4179-9b2f-88a9d62776a3 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:41.283861 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f046b8-447f-4179-9b2f-88a9d62776a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:41.284131 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f046b8-447f-4179-9b2f-88a9d62776a3 None admin] PATH_INFO: `/v3/users/a9c2b5c7502945da9aad5dcc25fc1766` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:41.286194 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f046b8-447f-4179-9b2f-88a9d62776a3 None admin] RBAC: Authorizing `identity:get_user(user_id=a9c2b5c7502945da9aad5dcc25fc1766)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:41.287682 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f046b8-447f-4179-9b2f-88a9d62776a3 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:41.290228 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 145/285] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Jun 8 11:52:41 2022] GET /identity/v3/users/a9c2b5c7502945da9aad5dcc25fc1766 => generated 297 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:41.297496 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f046b8-447f-4179-9b2f-88a9d62776a3 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:41.353654 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 141/286] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:52:41.378558 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f28ef-02d9-4175-bd45-f167b76e4ef9 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:41.379897 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:41.429336 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f046b8-447f-4179-9b2f-88a9d62776a3 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:41.474043 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e6128-f23b-4968-bc30-08309e683d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:41.475077 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e6128-f23b-4968-bc30-08309e683d37 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:41.475356 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e6128-f23b-4968-bc30-08309e683d37 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:41.475624 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e6128-f23b-4968-bc30-08309e683d37 None admin] PATH_INFO: `/v3/projects/226a798c297d4f20b3999a94a6dbe9d5` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:41.476826 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3e6128-f23b-4968-bc30-08309e683d37 None admin] RBAC: Authorizing `identity:get_project(project_id=226a798c297d4f20b3999a94a6dbe9d5)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:41.478257 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3e6128-f23b-4968-bc30-08309e683d37 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:41.480378 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 146/287] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Jun 8 11:52:41 2022] GET /identity/v3/projects/226a798c297d4f20b3999a94a6dbe9d5 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:41.484558 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:41.486614 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e6128-f23b-4968-bc30-08309e683d37 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:41.498186 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f28ef-02d9-4175-bd45-f167b76e4ef9 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:41.554132 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a318d6b3-b4d5-4339-b1ad-7367d168daa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:41.554943 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318d6b3-b4d5-4339-b1ad-7367d168daa8 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:41.555224 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318d6b3-b4d5-4339-b1ad-7367d168daa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:41.555494 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318d6b3-b4d5-4339-b1ad-7367d168daa8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:41.580206 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a318d6b3-b4d5-4339-b1ad-7367d168daa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:52:41.595290 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-a318d6b3-b4d5-4339-b1ad-7367d168daa8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 11:52:41.595290 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:52:41.595290 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:52:41.595290 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:52:41.595290 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:52:41.595290 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:52:41.595290 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:52:41.595290 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:52:41.595290 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:52:41.595290 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:52:41.595290 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:52:41.595290 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:52:41.595290 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:52:41.595290 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:52:41.595290 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:52:41.595290 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:52:41.596117 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:52:41.596117 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:52:41.596117 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:52:41.596117 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:52:41.596117 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:52:41.596117 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:52:41.596117 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:52:41.596117 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:52:41.596117 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:52:41.596117 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:52:41.596117 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:52:41.596117 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:52:41.596117 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:52:41.596117 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:52:41.596117 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:52:41.596117 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:52:41.596927 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:52:41.596927 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:52:41.596927 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:52:41.596927 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:52:41.596927 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:52:41.596927 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:52:41.596927 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:52:41.596927 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:52:41.596927 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:52:41.596927 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:52:41.596927 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 11:52:41.596927 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:52:41.607116 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 142/288] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:52:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:52:41.608060 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a318d6b3-b4d5-4339-b1ad-7367d168daa8 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:41.651675 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e6128-f23b-4968-bc30-08309e683d37 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:41.710219 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:41.722454 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de8d4f-e8bb-4679-bae6-a6d2bb499dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:41.723361 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de8d4f-e8bb-4679-bae6-a6d2bb499dd8 None admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:41.723643 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de8d4f-e8bb-4679-bae6-a6d2bb499dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:41.723920 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de8d4f-e8bb-4679-bae6-a6d2bb499dd8 None admin] PATH_INFO: `/v3/projects/226a798c297d4f20b3999a94a6dbe9d5/users/a9c2b5c7502945da9aad5dcc25fc1766/roles/0615a114184d403c8ee7d5c22d6630a9` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:41.727547 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de8d4f-e8bb-4679-bae6-a6d2bb499dd8 None admin] RBAC: Authorizing `identity:create_grant(project_id=226a798c297d4f20b3999a94a6dbe9d5, user_id=a9c2b5c7502945da9aad5dcc25fc1766, role_id=0615a114184d403c8ee7d5c22d6630a9)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:41.728951 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de8d4f-e8bb-4679-bae6-a6d2bb499dd8 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:41.756477 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 147/289] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Jun 8 11:52:41 2022] PUT /identity/v3/projects/226a798c297d4f20b3999a94a6dbe9d5/users/a9c2b5c7502945da9aad5dcc25fc1766/roles/0615a114184d403c8ee7d5c22d6630a9 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 11:52:41.784043 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a318d6b3-b4d5-4339-b1ad-7367d168daa8 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:41.835940 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e9911-570e-497a-854b-167355a94a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:41.836718 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e9911-570e-497a-854b-167355a94a48 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:41.837006 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e9911-570e-497a-854b-167355a94a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:41.837282 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e9911-570e-497a-854b-167355a94a48 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:41.838053 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e9911-570e-497a-854b-167355a94a48 None admin] RBAC: Adding query filter params (name=member) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:41.838358 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e9911-570e-497a-854b-167355a94a48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:41.839799 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e9911-570e-497a-854b-167355a94a48 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:41.853371 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:41.860355 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 143/290] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Jun 8 11:52:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:41.863985 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de8d4f-e8bb-4679-bae6-a6d2bb499dd8 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:41.993123 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de8d4f-e8bb-4679-bae6-a6d2bb499dd8 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:42.033111 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f7188c-a69a-41dc-a769-42700e2af1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:42.034062 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7188c-a69a-41dc-a769-42700e2af1c0 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:42.034343 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7188c-a69a-41dc-a769-42700e2af1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:42.034617 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7188c-a69a-41dc-a769-42700e2af1c0 None admin] PATH_INFO: `/v3/users/22d0ea2c89284635a3514899d9ac52eb` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:42.035877 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f7188c-a69a-41dc-a769-42700e2af1c0 None admin] RBAC: Authorizing `identity:get_user(user_id=22d0ea2c89284635a3514899d9ac52eb)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:42.037363 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f7188c-a69a-41dc-a769-42700e2af1c0 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:42.039298 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 148/291] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Jun 8 11:52:41 2022] GET /identity/v3/users/22d0ea2c89284635a3514899d9ac52eb => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:42.046555 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e9911-570e-497a-854b-167355a94a48 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:42.164030 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e9911-570e-497a-854b-167355a94a48 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:42.209986 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c7015e-7299-478f-a389-c6b537addfa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:42.210651 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7015e-7299-478f-a389-c6b537addfa7 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:42.210975 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7015e-7299-478f-a389-c6b537addfa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:42.211253 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7015e-7299-478f-a389-c6b537addfa7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:42.299735 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c7015e-7299-478f-a389-c6b537addfa7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:42.300308 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:42.304855 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c7015e-7299-478f-a389-c6b537addfa7 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:42.410069 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 144/292] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:52:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 11:52:42.415808 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f7188c-a69a-41dc-a769-42700e2af1c0 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:42.489810 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:42.533544 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f7188c-a69a-41dc-a769-42700e2af1c0 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:42.569921 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7216f2-7d4b-4dcf-8dce-e529514cda87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:42.570715 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7216f2-7d4b-4dcf-8dce-e529514cda87 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:42.571001 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7216f2-7d4b-4dcf-8dce-e529514cda87 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:42.571278 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7216f2-7d4b-4dcf-8dce-e529514cda87 None admin] PATH_INFO: `/v3/projects/226a798c297d4f20b3999a94a6dbe9d5` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:42.572514 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7216f2-7d4b-4dcf-8dce-e529514cda87 None admin] RBAC: Authorizing `identity:get_project(project_id=226a798c297d4f20b3999a94a6dbe9d5)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:42.574084 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7216f2-7d4b-4dcf-8dce-e529514cda87 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:42.576387 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 149/293] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Jun 8 11:52:42 2022] GET /identity/v3/projects/226a798c297d4f20b3999a94a6dbe9d5 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:42.582299 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c7015e-7299-478f-a389-c6b537addfa7 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:42.720673 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:42.725112 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c7015e-7299-478f-a389-c6b537addfa7 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:42.772410 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46c56ed-be4a-4b1f-b9df-298a3cfe1b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:42.773081 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c56ed-be4a-4b1f-b9df-298a3cfe1b59 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:42.773371 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c56ed-be4a-4b1f-b9df-298a3cfe1b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:42.773653 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c56ed-be4a-4b1f-b9df-298a3cfe1b59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:42.774616 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46c56ed-be4a-4b1f-b9df-298a3cfe1b59 None admin] RBAC: Adding query filter params (role.id=3682372ab3c145ba87e8baa5c520625f, scope.project.id=226a798c297d4f20b3999a94a6dbe9d5, user.id=22d0ea2c89284635a3514899d9ac52eb) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:42.774937 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46c56ed-be4a-4b1f-b9df-298a3cfe1b59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:42.776531 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46c56ed-be4a-4b1f-b9df-298a3cfe1b59 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:42.789266 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 145/294] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Jun 8 11:52:42 2022] GET /identity/v3/role_assignments?user.id=22d0ea2c89284635a3514899d9ac52eb&scope.project.id=226a798c297d4f20b3999a94a6dbe9d5&role.id=3682372ab3c145ba87e8baa5c520625f => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:42.876090 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c48b7-9cd7-4d4f-9a3c-63857d5e4ecc None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:42.877130 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c48b7-9cd7-4d4f-9a3c-63857d5e4ecc None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:42.877614 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c48b7-9cd7-4d4f-9a3c-63857d5e4ecc None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:42.879210 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 150/295] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:52:42.884926 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3b32e-0230-4fbf-8917-443d6ac10de8 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:42.885603 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3b32e-0230-4fbf-8917-443d6ac10de8 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:42.886083 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3b32e-0230-4fbf-8917-443d6ac10de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:42.908850 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-54d3b32e-0230-4fbf-8917-443d6ac10de8 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:42.910367 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-54d3b32e-0230-4fbf-8917-443d6ac10de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:43.010067 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 146/296] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:52:43.049644 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c48b7-9cd7-4d4f-9a3c-63857d5e4ecc None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:43.169405 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c48b7-9cd7-4d4f-9a3c-63857d5e4ecc None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:43.198185 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:43.206672 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3507a-b556-4d39-bd00-fe9d2cc99a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:43.207517 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3507a-b556-4d39-bd00-fe9d2cc99a2a None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:43.207803 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3507a-b556-4d39-bd00-fe9d2cc99a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:43.208084 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3507a-b556-4d39-bd00-fe9d2cc99a2a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:43.209511 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e3507a-b556-4d39-bd00-fe9d2cc99a2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:43.211079 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e3507a-b556-4d39-bd00-fe9d2cc99a2a None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:43.213484 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 151/297] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:52:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:43.219252 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3b32e-0230-4fbf-8917-443d6ac10de8 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:43.321021 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:43.329669 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3b32e-0230-4fbf-8917-443d6ac10de8 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:43.365775 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e223ec6-f725-4f66-9253-675d60303a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:43.366457 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e223ec6-f725-4f66-9253-675d60303a0b None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:43.366794 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e223ec6-f725-4f66-9253-675d60303a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:43.367079 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e223ec6-f725-4f66-9253-675d60303a0b None admin] PATH_INFO: `/v3/groups` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:43.367785 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e223ec6-f725-4f66-9253-675d60303a0b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:43.369279 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e223ec6-f725-4f66-9253-675d60303a0b None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:43.385896 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 147/298] 10.222.0.39 () {60 vars in 1134 bytes} [Wed Jun 8 11:52:43 2022] POST /identity/v3/groups => generated 229 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 11:52:43.463060 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a5d07-8260-4e95-b9c6-0d1ca9678b0d None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:43.463245 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a5d07-8260-4e95-b9c6-0d1ca9678b0d None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:43.463523 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a5d07-8260-4e95-b9c6-0d1ca9678b0d None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:43.464993 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 152/299] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:52:43.471932 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfbe6b2-c4d2-4ea3-af3d-937d62b96514 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:43.472396 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfbe6b2-c4d2-4ea3-af3d-937d62b96514 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:43.472683 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfbe6b2-c4d2-4ea3-af3d-937d62b96514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:43.494689 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-fbfbe6b2-c4d2-4ea3-af3d-937d62b96514 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:43.495997 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-fbfbe6b2-c4d2-4ea3-af3d-937d62b96514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:43.578781 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 148/300] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:52:43.600203 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a5d07-8260-4e95-b9c6-0d1ca9678b0d None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:43.710543 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a5d07-8260-4e95-b9c6-0d1ca9678b0d None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:43.747916 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fccf72e-9630-4ecd-927f-17a5579dc3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:43.748693 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccf72e-9630-4ecd-927f-17a5579dc3de None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:43.748979 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccf72e-9630-4ecd-927f-17a5579dc3de None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:43.749256 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccf72e-9630-4ecd-927f-17a5579dc3de None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:43.759753 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fccf72e-9630-4ecd-927f-17a5579dc3de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:52:43.767806 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-3fccf72e-9630-4ecd-927f-17a5579dc3de None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 11:52:43.767806 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:52:43.767806 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:52:43.767806 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:52:43.767806 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:52:43.767806 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:52:43.767806 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:52:43.767806 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:52:43.767806 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:52:43.767806 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:52:43.767806 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:52:43.767806 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:52:43.767806 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:52:43.767806 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:52:43.767806 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:52:43.767806 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:52:43.768741 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:52:43.768741 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:52:43.768741 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:52:43.768741 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:52:43.768741 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:52:43.768741 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:52:43.768741 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:52:43.768741 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:52:43.768741 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:52:43.768741 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:52:43.768741 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:52:43.768741 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:52:43.768741 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:52:43.768741 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:52:43.768741 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:52:43.768741 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:52:43.769517 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:52:43.769517 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:52:43.769517 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:52:43.769517 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:52:43.769517 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:52:43.769517 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:52:43.769517 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:52:43.769517 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:52:43.769517 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:52:43.769517 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:52:43.769517 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 11:52:43.769517 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:52:43.769517 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 153/301] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:52:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:52:43.774897 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfbe6b2-c4d2-4ea3-af3d-937d62b96514 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:43.830906 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d2a5f-f058-4176-86a3-69a527e841c1 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:43.831244 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d2a5f-f058-4176-86a3-69a527e841c1 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:43.831472 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d2a5f-f058-4176-86a3-69a527e841c1 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:43.833203 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 154/302] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 11:52:43.837993 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957b00c-6486-4c35-b489-b0c8989c6a99 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:43.838447 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957b00c-6486-4c35-b489-b0c8989c6a99 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:43.838864 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957b00c-6486-4c35-b489-b0c8989c6a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:43.857100 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-6957b00c-6486-4c35-b489-b0c8989c6a99 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:43.858625 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-6957b00c-6486-4c35-b489-b0c8989c6a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:43.865182 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:43.885224 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfbe6b2-c4d2-4ea3-af3d-937d62b96514 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:43.926215 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:43.927649 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1c2d05-c3e5-4b82-a08e-a8f25814a13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:43.928591 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c2d05-c3e5-4b82-a08e-a8f25814a13b None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:43.929080 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c2d05-c3e5-4b82-a08e-a8f25814a13b None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:43.929580 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c2d05-c3e5-4b82-a08e-a8f25814a13b None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:43.930371 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1c2d05-c3e5-4b82-a08e-a8f25814a13b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:43.930814 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1c2d05-c3e5-4b82-a08e-a8f25814a13b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:43.932372 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1c2d05-c3e5-4b82-a08e-a8f25814a13b None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:43.942127 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 149/303] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Jun 8 11:52:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:43.947060 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1c2d05-c3e5-4b82-a08e-a8f25814a13b None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:43.949922 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 155/304] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 11:52:43.974490 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6957b00c-6486-4c35-b489-b0c8989c6a99 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:44.082554 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1c2d05-c3e5-4b82-a08e-a8f25814a13b None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:44.090397 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6957b00c-6486-4c35-b489-b0c8989c6a99 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:44.120326 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f75c1-b7a1-451a-a89e-f7f807485ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:44.122136 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f75c1-b7a1-451a-a89e-f7f807485ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:44.122426 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f75c1-b7a1-451a-a89e-f7f807485ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:44.122707 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f75c1-b7a1-451a-a89e-f7f807485ce4 None admin] PATH_INFO: `/v3/users/8917c9cb421941e092fc25bafdac395f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:44.127461 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d30f904-d534-4436-b8b2-916411fb87ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:44.128547 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30f904-d534-4436-b8b2-916411fb87ae None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:44.129024 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30f904-d534-4436-b8b2-916411fb87ae None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:44.129486 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30f904-d534-4436-b8b2-916411fb87ae None admin] PATH_INFO: `/v3/roles/member` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:44.140017 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f75c1-b7a1-451a-a89e-f7f807485ce4 None admin] RBAC: Authorizing `identity:get_user(user_id=8917c9cb421941e092fc25bafdac395f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:44.141824 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f75c1-b7a1-451a-a89e-f7f807485ce4 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:44.142200 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d30f904-d534-4436-b8b2-916411fb87ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:52:44.148305 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 150/305] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Jun 8 11:52:43 2022] GET /identity/v3/users/8917c9cb421941e092fc25bafdac395f => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:44.149123 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f75c1-b7a1-451a-a89e-f7f807485ce4 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:44.150943 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-3d30f904-d534-4436-b8b2-916411fb87ae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 11:52:44.150943 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:52:44.150943 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:52:44.150943 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:52:44.150943 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:52:44.150943 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:52:44.150943 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:52:44.150943 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:52:44.150943 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:52:44.150943 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:52:44.150943 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:52:44.150943 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:52:44.150943 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:52:44.150943 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:52:44.150943 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:52:44.150943 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:52:44.151886 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:52:44.151886 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:52:44.151886 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:52:44.151886 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:52:44.151886 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:52:44.151886 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:52:44.151886 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:52:44.151886 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:52:44.151886 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:52:44.151886 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:52:44.151886 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:52:44.151886 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:52:44.151886 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:52:44.151886 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:52:44.151886 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:52:44.151886 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:52:44.153468 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:52:44.153468 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:52:44.153468 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:52:44.153468 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:52:44.153468 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:52:44.153468 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:52:44.153468 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:52:44.153468 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:52:44.153468 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:52:44.153468 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:52:44.153468 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 11:52:44.153468 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:52:44.156379 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 156/306] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:52:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 11:52:44.158411 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:44.165573 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d30f904-d534-4436-b8b2-916411fb87ae None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:44.227553 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:44.273299 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f75c1-b7a1-451a-a89e-f7f807485ce4 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:44.297483 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d30f904-d534-4436-b8b2-916411fb87ae None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:44.317442 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124f235-99b8-49d5-8191-b41178bd9a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:44.318343 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124f235-99b8-49d5-8191-b41178bd9a81 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:44.318768 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124f235-99b8-49d5-8191-b41178bd9a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:44.319184 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124f235-99b8-49d5-8191-b41178bd9a81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:44.320478 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f124f235-99b8-49d5-8191-b41178bd9a81 None admin] RBAC: Adding query filter params (role.id=0615a114184d403c8ee7d5c22d6630a9, user.id=8917c9cb421941e092fc25bafdac395f, scope.system=all) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:44.320812 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f124f235-99b8-49d5-8191-b41178bd9a81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:44.322411 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f124f235-99b8-49d5-8191-b41178bd9a81 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:44.336276 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 151/307] 10.222.0.39 () {56 vars in 1308 bytes} [Wed Jun 8 11:52:44 2022] GET /identity/v3/role_assignments?user.id=8917c9cb421941e092fc25bafdac395f&scope.system=all&role.id=0615a114184d403c8ee7d5c22d6630a9 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:44.352200 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc4ef9f-38ea-4ede-891f-d05323372953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:44.352900 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4ef9f-38ea-4ede-891f-d05323372953 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:44.353186 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4ef9f-38ea-4ede-891f-d05323372953 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:44.353466 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4ef9f-38ea-4ede-891f-d05323372953 None admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:44.354239 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc4ef9f-38ea-4ede-891f-d05323372953 None admin] RBAC: Adding query filter params (name=member) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:44.354550 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc4ef9f-38ea-4ede-891f-d05323372953 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:44.356119 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc4ef9f-38ea-4ede-891f-d05323372953 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:44.366404 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 157/308] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Jun 8 11:52:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:44.372586 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124f235-99b8-49d5-8191-b41178bd9a81 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:44.457511 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:44.501447 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124f235-99b8-49d5-8191-b41178bd9a81 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:44.541952 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac57ad8f-5856-406f-bb1c-d7244b136f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:44.543410 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57ad8f-5856-406f-bb1c-d7244b136f68 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:44.544047 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57ad8f-5856-406f-bb1c-d7244b136f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:44.544552 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57ad8f-5856-406f-bb1c-d7244b136f68 None admin] PATH_INFO: `/v3/users/cceccf330e57455c9dc1967aab6736a1` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:44.546088 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac57ad8f-5856-406f-bb1c-d7244b136f68 None admin] RBAC: Authorizing `identity:get_user(user_id=cceccf330e57455c9dc1967aab6736a1)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:44.547818 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac57ad8f-5856-406f-bb1c-d7244b136f68 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:44.550235 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 152/309] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Jun 8 11:52:44 2022] GET /identity/v3/users/cceccf330e57455c9dc1967aab6736a1 => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:44.557383 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc4ef9f-38ea-4ede-891f-d05323372953 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:44.681651 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc4ef9f-38ea-4ede-891f-d05323372953 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:44.691663 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:44.718289 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b87be9f-859e-432e-b9a0-e633a961f352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:44.719166 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b87be9f-859e-432e-b9a0-e633a961f352 None admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:44.719449 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b87be9f-859e-432e-b9a0-e633a961f352 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:44.719728 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b87be9f-859e-432e-b9a0-e633a961f352 None admin] PATH_INFO: `/v3/system/users/cceccf330e57455c9dc1967aab6736a1/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:44.721280 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b87be9f-859e-432e-b9a0-e633a961f352 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=cceccf330e57455c9dc1967aab6736a1, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:44.722662 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b87be9f-859e-432e-b9a0-e633a961f352 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:44.735979 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 158/310] 10.222.0.39 () {58 vars in 1334 bytes} [Wed Jun 8 11:52:44 2022] PUT /identity/v3/system/users/cceccf330e57455c9dc1967aab6736a1/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 11:52:44.772856 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111201f2-3adb-440d-bf46-dd3c9f6f588f None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:44.773505 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111201f2-3adb-440d-bf46-dd3c9f6f588f None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:44.774010 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111201f2-3adb-440d-bf46-dd3c9f6f588f None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:44.775672 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 153/311] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:52:44.782724 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c21c1d-d328-41b6-9ab0-4a7e6f553aba None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:44.783063 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c21c1d-d328-41b6-9ab0-4a7e6f553aba None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:44.783580 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c21c1d-d328-41b6-9ab0-4a7e6f553aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:44.802136 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-27c21c1d-d328-41b6-9ab0-4a7e6f553aba None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:44.803810 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-27c21c1d-d328-41b6-9ab0-4a7e6f553aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:44.882532 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 159/312] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:52:44.906516 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111201f2-3adb-440d-bf46-dd3c9f6f588f None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:45.028889 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111201f2-3adb-440d-bf46-dd3c9f6f588f None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:45.065020 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf70c7d-63e9-4e7d-939f-2ab8ad7fd94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:45.065879 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf70c7d-63e9-4e7d-939f-2ab8ad7fd94b None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:45.066159 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf70c7d-63e9-4e7d-939f-2ab8ad7fd94b None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:45.066430 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf70c7d-63e9-4e7d-939f-2ab8ad7fd94b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:45.069365 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:45.078958 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf70c7d-63e9-4e7d-939f-2ab8ad7fd94b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:52:45.086972 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-0bf70c7d-63e9-4e7d-939f-2ab8ad7fd94b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 11:52:45.086972 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:52:45.086972 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:52:45.086972 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:52:45.086972 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:52:45.086972 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:52:45.086972 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:52:45.086972 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:52:45.086972 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:52:45.086972 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:52:45.086972 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:52:45.086972 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:52:45.086972 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:52:45.086972 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:52:45.086972 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:52:45.086972 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:52:45.087867 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:52:45.087867 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:52:45.087867 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:52:45.087867 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:52:45.087867 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:52:45.087867 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:52:45.087867 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:52:45.087867 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:52:45.087867 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:52:45.087867 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:52:45.087867 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:52:45.087867 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:52:45.087867 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:52:45.087867 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:52:45.087867 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:52:45.087867 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:52:45.088722 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:52:45.088722 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:52:45.088722 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:52:45.088722 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:52:45.088722 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:52:45.088722 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:52:45.088722 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:52:45.088722 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:52:45.088722 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:52:45.088722 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:52:45.088722 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 11:52:45.088722 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:52:45.089317 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 154/313] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:52:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:52:45.096273 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c21c1d-d328-41b6-9ab0-4a7e6f553aba None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:45.201221 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c21c1d-d328-41b6-9ab0-4a7e6f553aba None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:45.203130 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:45.240085 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f19c0b-e571-41fd-a479-5bdea7172114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:45.241150 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f19c0b-e571-41fd-a479-5bdea7172114 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:45.241637 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f19c0b-e571-41fd-a479-5bdea7172114 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:45.242119 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f19c0b-e571-41fd-a479-5bdea7172114 None admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:45.243115 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f19c0b-e571-41fd-a479-5bdea7172114 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:45.243619 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f19c0b-e571-41fd-a479-5bdea7172114 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:45.245226 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f19c0b-e571-41fd-a479-5bdea7172114 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:45.255017 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 160/314] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Jun 8 11:52:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:45.260710 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf70c7d-63e9-4e7d-939f-2ab8ad7fd94b None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:45.368316 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf70c7d-63e9-4e7d-939f-2ab8ad7fd94b None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:45.403713 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c76d39-f98e-4e78-ae62-ce56d0916c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:45.405035 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c76d39-f98e-4e78-ae62-ce56d0916c05 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:45.405532 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c76d39-f98e-4e78-ae62-ce56d0916c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:45.406007 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c76d39-f98e-4e78-ae62-ce56d0916c05 None admin] PATH_INFO: `/v3/users/a9c2b5c7502945da9aad5dcc25fc1766` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:45.407429 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c76d39-f98e-4e78-ae62-ce56d0916c05 None admin] RBAC: Authorizing `identity:get_user(user_id=a9c2b5c7502945da9aad5dcc25fc1766)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:45.409121 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c76d39-f98e-4e78-ae62-ce56d0916c05 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:45.411256 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 155/315] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Jun 8 11:52:45 2022] GET /identity/v3/users/a9c2b5c7502945da9aad5dcc25fc1766 => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:45.416879 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f19c0b-e571-41fd-a479-5bdea7172114 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:45.531959 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f19c0b-e571-41fd-a479-5bdea7172114 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:45.568761 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f95f11f-6252-4ec3-b44c-be7a473ab60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:45.569460 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95f11f-6252-4ec3-b44c-be7a473ab60c None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:45.569748 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95f11f-6252-4ec3-b44c-be7a473ab60c None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:45.570023 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95f11f-6252-4ec3-b44c-be7a473ab60c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:45.604233 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:45.645283 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f95f11f-6252-4ec3-b44c-be7a473ab60c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:45.646747 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f95f11f-6252-4ec3-b44c-be7a473ab60c None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:45.754171 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 161/316] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:52:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 11:52:45.759697 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c76d39-f98e-4e78-ae62-ce56d0916c05 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:45.825229 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:45.828362 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58081b-17ae-47ba-8179-0148eb009b6f None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:45.829551 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58081b-17ae-47ba-8179-0148eb009b6f None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:45.830033 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58081b-17ae-47ba-8179-0148eb009b6f None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:45.831855 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 162/317] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 11:52:45.837866 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0dc7d-2282-4b74-92c5-207acc3ccdc2 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:45.838382 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0dc7d-2282-4b74-92c5-207acc3ccdc2 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:45.838894 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0dc7d-2282-4b74-92c5-207acc3ccdc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:45.858036 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-08c0dc7d-2282-4b74-92c5-207acc3ccdc2 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:45.859493 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-08c0dc7d-2282-4b74-92c5-207acc3ccdc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:45.866487 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c76d39-f98e-4e78-ae62-ce56d0916c05 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:45.901611 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367798b-7d39-44d6-b156-190307bdaf74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:45.902528 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367798b-7d39-44d6-b156-190307bdaf74 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:45.902997 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367798b-7d39-44d6-b156-190307bdaf74 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:45.903424 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367798b-7d39-44d6-b156-190307bdaf74 None admin] PATH_INFO: `/v3/projects/226a798c297d4f20b3999a94a6dbe9d5` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:45.904786 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367798b-7d39-44d6-b156-190307bdaf74 None admin] RBAC: Authorizing `identity:get_project(project_id=226a798c297d4f20b3999a94a6dbe9d5)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:45.906390 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367798b-7d39-44d6-b156-190307bdaf74 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:45.908566 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 156/318] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Jun 8 11:52:45 2022] GET /identity/v3/projects/226a798c297d4f20b3999a94a6dbe9d5 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:45.915245 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367798b-7d39-44d6-b156-190307bdaf74 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:45.922458 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:45.940326 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 163/319] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:52:45.959806 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c0dc7d-2282-4b74-92c5-207acc3ccdc2 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:46.031329 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367798b-7d39-44d6-b156-190307bdaf74 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:46.063404 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:46.068609 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76a17d-a2a0-4e05-9563-3741324e7577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:46.069453 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76a17d-a2a0-4e05-9563-3741324e7577 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:46.069908 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76a17d-a2a0-4e05-9563-3741324e7577 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:46.070434 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76a17d-a2a0-4e05-9563-3741324e7577 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:46.071429 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e76a17d-a2a0-4e05-9563-3741324e7577 None admin] RBAC: Adding query filter params (role.id=0615a114184d403c8ee7d5c22d6630a9, scope.project.id=226a798c297d4f20b3999a94a6dbe9d5, user.id=a9c2b5c7502945da9aad5dcc25fc1766) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:46.071892 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e76a17d-a2a0-4e05-9563-3741324e7577 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:46.073614 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e76a17d-a2a0-4e05-9563-3741324e7577 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:46.080613 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c0dc7d-2282-4b74-92c5-207acc3ccdc2 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:46.084475 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 157/320] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Jun 8 11:52:45 2022] GET /identity/v3/role_assignments?user.id=a9c2b5c7502945da9aad5dcc25fc1766&scope.project.id=226a798c297d4f20b3999a94a6dbe9d5&role.id=0615a114184d403c8ee7d5c22d6630a9 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:46.123282 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7a4ba-f502-478d-898b-7da62de63ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:46.124104 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7a4ba-f502-478d-898b-7da62de63ee7 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:46.124417 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7a4ba-f502-478d-898b-7da62de63ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:46.124690 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7a4ba-f502-478d-898b-7da62de63ee7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:46.125926 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a7a4ba-f502-478d-898b-7da62de63ee7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:46.127406 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a7a4ba-f502-478d-898b-7da62de63ee7 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:46.129464 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 164/321] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:52:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:52:46.136361 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76a17d-a2a0-4e05-9563-3741324e7577 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:46.254814 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76a17d-a2a0-4e05-9563-3741324e7577 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:46.296413 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9fb977-3251-432f-a29e-94dd2bede3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:46.297353 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9fb977-3251-432f-a29e-94dd2bede3c5 None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:46.297790 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9fb977-3251-432f-a29e-94dd2bede3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:46.298216 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9fb977-3251-432f-a29e-94dd2bede3c5 None admin] PATH_INFO: `/v3/groups` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:46.299059 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9fb977-3251-432f-a29e-94dd2bede3c5 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:46.300721 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9fb977-3251-432f-a29e-94dd2bede3c5 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:46.318793 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 158/322] 10.222.0.39 () {60 vars in 1134 bytes} [Wed Jun 8 11:52:46 2022] POST /identity/v3/groups => generated 226 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 11:52:46.742964 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a3e95-a2a0-4005-bd6e-6910dc497f0a None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:46.743246 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a3e95-a2a0-4005-bd6e-6910dc497f0a None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:46.743776 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a3e95-a2a0-4005-bd6e-6910dc497f0a None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:46.745685 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 165/323] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:52:46.750874 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3aa0d-8409-4a51-96a2-7c99e058671e None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:46.751451 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3aa0d-8409-4a51-96a2-7c99e058671e None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:46.751930 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3aa0d-8409-4a51-96a2-7c99e058671e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:46.770410 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-38a3aa0d-8409-4a51-96a2-7c99e058671e None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:46.771958 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-38a3aa0d-8409-4a51-96a2-7c99e058671e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:46.833525 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:46.854373 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 159/324] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:52:46.877563 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a3e95-a2a0-4005-bd6e-6910dc497f0a None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:46.966606 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:47.015634 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a3e95-a2a0-4005-bd6e-6910dc497f0a None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:47.061190 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d719bf-a50d-4f6c-b18a-ee54e4410338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:47.062062 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d719bf-a50d-4f6c-b18a-ee54e4410338 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:47.062346 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d719bf-a50d-4f6c-b18a-ee54e4410338 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:47.062668 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d719bf-a50d-4f6c-b18a-ee54e4410338 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:47.074940 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d719bf-a50d-4f6c-b18a-ee54e4410338 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:52:47.083138 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-75d719bf-a50d-4f6c-b18a-ee54e4410338 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 11:52:47.083138 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:52:47.083138 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:52:47.083138 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:52:47.083138 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:52:47.083138 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:52:47.083138 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:52:47.083138 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:52:47.083138 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:52:47.083138 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:52:47.083138 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:52:47.083138 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:52:47.083138 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:52:47.083138 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:52:47.083138 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:52:47.083138 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:52:47.084051 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:52:47.084051 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:52:47.084051 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:52:47.084051 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:52:47.084051 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:52:47.084051 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:52:47.084051 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:52:47.084051 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:52:47.084051 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:52:47.084051 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:52:47.084051 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:52:47.084051 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:52:47.084051 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:52:47.084051 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:52:47.084051 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:52:47.084051 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:52:47.085313 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:52:47.085313 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:52:47.085313 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:52:47.085313 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:52:47.085313 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:52:47.085313 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:52:47.085313 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:52:47.085313 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:52:47.085313 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:52:47.085313 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:52:47.085313 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 11:52:47.085313 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:52:47.085313 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 166/325] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:52:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:52:47.090329 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3aa0d-8409-4a51-96a2-7c99e058671e None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:47.257125 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3aa0d-8409-4a51-96a2-7c99e058671e None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:47.266829 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5c671-a5bd-4044-9291-837442941288 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:47.267797 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5c671-a5bd-4044-9291-837442941288 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:47.268334 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5c671-a5bd-4044-9291-837442941288 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:47.269914 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 167/326] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 11:52:47.276542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeec58f-d0c4-4349-b6d7-79ee3fd94256 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:47.277114 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeec58f-d0c4-4349-b6d7-79ee3fd94256 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:47.277666 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeec58f-d0c4-4349-b6d7-79ee3fd94256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:47.299687 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-bfeec58f-d0c4-4349-b6d7-79ee3fd94256 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:47.301287 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-bfeec58f-d0c4-4349-b6d7-79ee3fd94256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:47.316282 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f299d8-1f6f-4624-99ad-8e3aad7bd5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:47.316980 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f299d8-1f6f-4624-99ad-8e3aad7bd5a7 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:47.317267 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f299d8-1f6f-4624-99ad-8e3aad7bd5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:47.317546 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f299d8-1f6f-4624-99ad-8e3aad7bd5a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:47.318418 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f299d8-1f6f-4624-99ad-8e3aad7bd5a7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:47.318625 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f299d8-1f6f-4624-99ad-8e3aad7bd5a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:47.320056 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f299d8-1f6f-4624-99ad-8e3aad7bd5a7 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:47.335720 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 160/327] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Jun 8 11:52:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:47.342468 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f299d8-1f6f-4624-99ad-8e3aad7bd5a7 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:47.382097 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 168/328] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 11:52:47.407219 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeec58f-d0c4-4349-b6d7-79ee3fd94256 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:47.438718 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:47.463436 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:47.513773 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeec58f-d0c4-4349-b6d7-79ee3fd94256 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:47.551869 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec279be-ec6a-4a9e-9381-86fa3d6606df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:47.553038 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec279be-ec6a-4a9e-9381-86fa3d6606df None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:47.553534 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec279be-ec6a-4a9e-9381-86fa3d6606df None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:47.554048 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec279be-ec6a-4a9e-9381-86fa3d6606df None admin] PATH_INFO: `/v3/roles/member` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:47.566234 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec279be-ec6a-4a9e-9381-86fa3d6606df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:52:47.575480 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-aec279be-ec6a-4a9e-9381-86fa3d6606df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 11:52:47.575480 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:52:47.575480 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:52:47.575480 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:52:47.575480 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:52:47.575480 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:52:47.575480 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:52:47.575480 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:52:47.575480 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:52:47.575480 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:52:47.575480 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:52:47.575480 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:52:47.575480 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:52:47.575480 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:52:47.575480 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:52:47.575480 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:52:47.576407 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:52:47.576407 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:52:47.576407 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:52:47.576407 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:52:47.576407 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:52:47.576407 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:52:47.576407 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:52:47.576407 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:52:47.576407 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:52:47.576407 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:52:47.576407 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:52:47.576407 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:52:47.576407 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:52:47.576407 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:52:47.576407 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:52:47.576407 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:52:47.577210 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:52:47.577210 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:52:47.577210 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:52:47.577210 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:52:47.577210 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:52:47.577210 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:52:47.577210 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:52:47.577210 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:52:47.577210 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:52:47.577210 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:52:47.577210 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 11:52:47.577210 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:52:47.579629 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 169/329] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:52:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 11:52:47.585469 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec279be-ec6a-4a9e-9381-86fa3d6606df None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:47.598201 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f299d8-1f6f-4624-99ad-8e3aad7bd5a7 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:47.645883 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c54121-e1e2-4ce4-81e6-eca573ee3cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:47.647092 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c54121-e1e2-4ce4-81e6-eca573ee3cce None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:47.647544 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c54121-e1e2-4ce4-81e6-eca573ee3cce None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:47.647970 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c54121-e1e2-4ce4-81e6-eca573ee3cce None admin] PATH_INFO: `/v3/users/8917c9cb421941e092fc25bafdac395f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:47.650614 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c54121-e1e2-4ce4-81e6-eca573ee3cce None admin] RBAC: Authorizing `identity:get_user(user_id=8917c9cb421941e092fc25bafdac395f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:47.652247 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c54121-e1e2-4ce4-81e6-eca573ee3cce None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:47.660004 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 161/330] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Jun 8 11:52:47 2022] GET /identity/v3/users/8917c9cb421941e092fc25bafdac395f => generated 293 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:52:47.661317 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c54121-e1e2-4ce4-81e6-eca573ee3cce None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:47.761511 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec279be-ec6a-4a9e-9381-86fa3d6606df None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:47.786073 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:47.825981 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5aed17-add0-4771-9be3-6f6336528a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:47.826931 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5aed17-add0-4771-9be3-6f6336528a80 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:47.827386 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5aed17-add0-4771-9be3-6f6336528a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:47.827819 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5aed17-add0-4771-9be3-6f6336528a80 None admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:47.828745 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5aed17-add0-4771-9be3-6f6336528a80 None admin] RBAC: Adding query filter params (name=member) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:47.829218 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5aed17-add0-4771-9be3-6f6336528a80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:47.830741 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5aed17-add0-4771-9be3-6f6336528a80 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:47.846070 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 170/331] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Jun 8 11:52:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:47.851155 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c54121-e1e2-4ce4-81e6-eca573ee3cce None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:47.852289 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5aed17-add0-4771-9be3-6f6336528a80 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:47.873198 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:47.905279 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f2f4f-16f5-4df7-8547-f96327bc22e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:47.907080 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f2f4f-16f5-4df7-8547-f96327bc22e5 None admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:47.907368 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f2f4f-16f5-4df7-8547-f96327bc22e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:47.907651 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f2f4f-16f5-4df7-8547-f96327bc22e5 None admin] PATH_INFO: `/v3/system/users/8917c9cb421941e092fc25bafdac395f/roles/0615a114184d403c8ee7d5c22d6630a9` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:47.910052 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995f2f4f-16f5-4df7-8547-f96327bc22e5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8917c9cb421941e092fc25bafdac395f, role_id=0615a114184d403c8ee7d5c22d6630a9)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:47.912749 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995f2f4f-16f5-4df7-8547-f96327bc22e5 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:47.930571 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 162/332] 10.222.0.39 () {58 vars in 1334 bytes} [Wed Jun 8 11:52:47 2022] PUT /identity/v3/system/users/8917c9cb421941e092fc25bafdac395f/roles/0615a114184d403c8ee7d5c22d6630a9 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 11:52:48.015980 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5aed17-add0-4771-9be3-6f6336528a80 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:48.055237 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416db1a-38e8-4695-be74-20ea499f04d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:48.056052 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416db1a-38e8-4695-be74-20ea499f04d7 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:48.056365 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416db1a-38e8-4695-be74-20ea499f04d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:48.056647 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416db1a-38e8-4695-be74-20ea499f04d7 None admin] PATH_INFO: `/v3/users/cceccf330e57455c9dc1967aab6736a1` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:48.058889 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b416db1a-38e8-4695-be74-20ea499f04d7 None admin] RBAC: Authorizing `identity:get_user(user_id=cceccf330e57455c9dc1967aab6736a1)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:48.060905 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b416db1a-38e8-4695-be74-20ea499f04d7 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:48.062927 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 171/333] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Jun 8 11:52:47 2022] GET /identity/v3/users/cceccf330e57455c9dc1967aab6736a1 => generated 293 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:48.068722 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f2f4f-16f5-4df7-8547-f96327bc22e5 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:48.194556 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f2f4f-16f5-4df7-8547-f96327bc22e5 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:48.232926 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c3b996-2ba2-4d18-9c84-e609d811672b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:48.233609 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3b996-2ba2-4d18-9c84-e609d811672b None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:48.233963 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3b996-2ba2-4d18-9c84-e609d811672b None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:48.234243 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3b996-2ba2-4d18-9c84-e609d811672b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:48.235150 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c3b996-2ba2-4d18-9c84-e609d811672b None admin] RBAC: Adding query filter params (role.id=3682372ab3c145ba87e8baa5c520625f, user.id=cceccf330e57455c9dc1967aab6736a1, scope.system=all) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:48.235470 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c3b996-2ba2-4d18-9c84-e609d811672b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:48.237009 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c3b996-2ba2-4d18-9c84-e609d811672b None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:48.251950 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 163/334] 10.222.0.39 () {56 vars in 1308 bytes} [Wed Jun 8 11:52:48 2022] GET /identity/v3/role_assignments?user.id=cceccf330e57455c9dc1967aab6736a1&scope.system=all&role.id=3682372ab3c145ba87e8baa5c520625f => generated 510 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:49.602140 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f4bf0-8fb6-4f5c-a069-bee72422a7ef None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:49.602646 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f4bf0-8fb6-4f5c-a069-bee72422a7ef None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:49.602932 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f4bf0-8fb6-4f5c-a069-bee72422a7ef None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:49.604614 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 172/335] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:52:49.611615 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e182fb-7563-493b-97a6-e8958aee3c39 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:49.612566 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e182fb-7563-493b-97a6-e8958aee3c39 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:49.613071 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e182fb-7563-493b-97a6-e8958aee3c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:49.631670 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-55e182fb-7563-493b-97a6-e8958aee3c39 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:49.633897 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-55e182fb-7563-493b-97a6-e8958aee3c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:49.670039 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:49.712862 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 164/336] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:52:49.738601 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f4bf0-8fb6-4f5c-a069-bee72422a7ef None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:49.795240 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:49.869089 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f4bf0-8fb6-4f5c-a069-bee72422a7ef None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:49.909348 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebac10-494f-4871-9d6c-e76a54311b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:49.910171 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebac10-494f-4871-9d6c-e76a54311b98 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:49.910459 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebac10-494f-4871-9d6c-e76a54311b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:49.910735 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebac10-494f-4871-9d6c-e76a54311b98 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:49.921894 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ebac10-494f-4871-9d6c-e76a54311b98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:52:49.930110 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-35ebac10-494f-4871-9d6c-e76a54311b98 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 11:52:49.930110 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:52:49.930110 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:52:49.930110 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:52:49.930110 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:52:49.930110 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:52:49.930110 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:52:49.930110 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:52:49.930110 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:52:49.930110 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:52:49.930110 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:52:49.930110 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:52:49.930110 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:52:49.930110 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:52:49.930110 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:52:49.930110 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:52:49.931006 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:52:49.931006 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:52:49.931006 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:52:49.931006 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:52:49.931006 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:52:49.931006 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:52:49.931006 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:52:49.931006 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:52:49.931006 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:52:49.931006 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:52:49.931006 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:52:49.931006 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:52:49.931006 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:52:49.931006 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:52:49.931006 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:52:49.931006 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:52:49.931785 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:52:49.931785 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:52:49.931785 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:52:49.931785 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:52:49.931785 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:52:49.931785 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:52:49.931785 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:52:49.931785 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:52:49.931785 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:52:49.931785 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:52:49.931785 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 11:52:49.931785 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:52:49.931785 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 173/337] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Jun 8 11:52:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:52:49.937903 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e182fb-7563-493b-97a6-e8958aee3c39 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:49.957188 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2634c7-cf79-4f49-b168-028f3ee8af17 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:49.957509 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2634c7-cf79-4f49-b168-028f3ee8af17 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:49.957756 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2634c7-cf79-4f49-b168-028f3ee8af17 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:49.959258 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 174/338] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 11:52:49.965270 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34a65b-501d-4b21-be97-df91a2a858fa None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:49.966209 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34a65b-501d-4b21-be97-df91a2a858fa None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:49.966504 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34a65b-501d-4b21-be97-df91a2a858fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:49.988933 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-4d34a65b-501d-4b21-be97-df91a2a858fa None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:49.990276 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-4d34a65b-501d-4b21-be97-df91a2a858fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:50.112948 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e182fb-7563-493b-97a6-e8958aee3c39 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:50.116990 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 175/339] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 11:52:50.156142 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d34a65b-501d-4b21-be97-df91a2a858fa None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:50.162816 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0304ca-18c1-42ca-97fa-8dad1563b810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:50.163504 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0304ca-18c1-42ca-97fa-8dad1563b810 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:50.163791 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0304ca-18c1-42ca-97fa-8dad1563b810 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:50.164072 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0304ca-18c1-42ca-97fa-8dad1563b810 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:50.164872 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0304ca-18c1-42ca-97fa-8dad1563b810 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:50.165183 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0304ca-18c1-42ca-97fa-8dad1563b810 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:50.166587 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0304ca-18c1-42ca-97fa-8dad1563b810 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:50.178583 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 165/340] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Jun 8 11:52:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:50.184159 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0304ca-18c1-42ca-97fa-8dad1563b810 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:50.220296 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:50.249001 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:50.347694 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0304ca-18c1-42ca-97fa-8dad1563b810 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:50.372976 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d34a65b-501d-4b21-be97-df91a2a858fa None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:50.385821 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b978b7c5-9b66-4785-9574-2c91b50aece4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:50.387056 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978b7c5-9b66-4785-9574-2c91b50aece4 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:50.387424 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978b7c5-9b66-4785-9574-2c91b50aece4 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:50.387699 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978b7c5-9b66-4785-9574-2c91b50aece4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:50.430365 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b10f1e-1482-4ed7-9b49-455d055e8fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:50.431096 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b10f1e-1482-4ed7-9b49-455d055e8fcc None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:50.431381 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b10f1e-1482-4ed7-9b49-455d055e8fcc None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:50.431656 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b10f1e-1482-4ed7-9b49-455d055e8fcc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:50.453085 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b10f1e-1482-4ed7-9b49-455d055e8fcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:52:50.460910 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-a0b10f1e-1482-4ed7-9b49-455d055e8fcc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 11:52:50.460910 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:52:50.460910 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:52:50.460910 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:52:50.460910 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:52:50.460910 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:52:50.460910 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:52:50.460910 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:52:50.460910 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:52:50.460910 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:52:50.460910 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:52:50.460910 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:52:50.460910 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:52:50.460910 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:52:50.460910 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:52:50.460910 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:52:50.461812 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:52:50.461812 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:52:50.461812 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:52:50.461812 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:52:50.461812 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:52:50.461812 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:52:50.461812 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:52:50.461812 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:52:50.461812 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:52:50.461812 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:52:50.461812 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:52:50.461812 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:52:50.461812 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:52:50.461812 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:52:50.461812 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:52:50.461812 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:52:50.462593 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:52:50.462593 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:52:50.462593 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:52:50.462593 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:52:50.462593 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:52:50.462593 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:52:50.462593 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:52:50.462593 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:52:50.462593 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:52:50.462593 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:52:50.462593 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 11:52:50.462593 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:52:50.462593 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 176/341] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:52:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 11:52:50.473162 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b10f1e-1482-4ed7-9b49-455d055e8fcc None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:50.481234 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b978b7c5-9b66-4785-9574-2c91b50aece4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:50.482724 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b978b7c5-9b66-4785-9574-2c91b50aece4 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:50.516547 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:50.601256 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 166/342] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:52:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 11:52:50.606833 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b978b7c5-9b66-4785-9574-2c91b50aece4 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:50.680359 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:50.690749 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b10f1e-1482-4ed7-9b49-455d055e8fcc None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:50.720522 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b978b7c5-9b66-4785-9574-2c91b50aece4 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:50.752881 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe4cbe-aed2-4d7b-a29c-1b5db89926f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:50.753562 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe4cbe-aed2-4d7b-a29c-1b5db89926f4 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:50.753850 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe4cbe-aed2-4d7b-a29c-1b5db89926f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:50.754012 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:50.754154 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe4cbe-aed2-4d7b-a29c-1b5db89926f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:50.754888 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfe4cbe-aed2-4d7b-a29c-1b5db89926f4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:50.755290 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfe4cbe-aed2-4d7b-a29c-1b5db89926f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:50.756827 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfe4cbe-aed2-4d7b-a29c-1b5db89926f4 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:50.759259 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5ad5f-ab96-441b-8b38-558896a3ed5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:50.760369 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5ad5f-ab96-441b-8b38-558896a3ed5b None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:50.760838 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5ad5f-ab96-441b-8b38-558896a3ed5b None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:50.761315 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5ad5f-ab96-441b-8b38-558896a3ed5b None admin] PATH_INFO: `/v3/projects/8d69c66b67494123b35f0b9eeaf0f02b` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:50.762957 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed5ad5f-ab96-441b-8b38-558896a3ed5b None admin] RBAC: Authorizing `identity:get_project(project_id=8d69c66b67494123b35f0b9eeaf0f02b)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:50.764646 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed5ad5f-ab96-441b-8b38-558896a3ed5b None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:50.771047 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 167/343] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Jun 8 11:52:50 2022] GET /identity/v3/projects/8d69c66b67494123b35f0b9eeaf0f02b => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:50.771919 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 177/344] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Jun 8 11:52:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:50.772342 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5ad5f-ab96-441b-8b38-558896a3ed5b None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:50.776902 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd04d7e-c5d9-431f-b5b5-737fef530957 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:50.777062 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd04d7e-c5d9-431f-b5b5-737fef530957 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:50.777998 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd04d7e-c5d9-431f-b5b5-737fef530957 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:50.779444 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 178/345] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 11:52:50.780150 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd04d7e-c5d9-431f-b5b5-737fef530957 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:50.881764 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5ad5f-ab96-441b-8b38-558896a3ed5b None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:50.893107 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd04d7e-c5d9-431f-b5b5-737fef530957 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:50.919007 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397962c0-cf80-409e-a236-b4fa048e3c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:50.922029 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397962c0-cf80-409e-a236-b4fa048e3c9e None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:50.922526 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397962c0-cf80-409e-a236-b4fa048e3c9e None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:50.922993 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397962c0-cf80-409e-a236-b4fa048e3c9e None admin] PATH_INFO: `/v3/groups/e476c135909a4d1b9e7efc70b73b8a6c` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:50.929685 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397962c0-cf80-409e-a236-b4fa048e3c9e None admin] RBAC: Authorizing `identity:get_group(group_id=e476c135909a4d1b9e7efc70b73b8a6c)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:50.930721 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a45dcf-aa12-48f1-bdb1-cdff3ecb6365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:50.931378 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a45dcf-aa12-48f1-bdb1-cdff3ecb6365 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:50.931662 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a45dcf-aa12-48f1-bdb1-cdff3ecb6365 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:50.931941 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a45dcf-aa12-48f1-bdb1-cdff3ecb6365 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:50.932184 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397962c0-cf80-409e-a236-b4fa048e3c9e None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:50.934132 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 168/346] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Jun 8 11:52:50 2022] GET /identity/v3/groups/e476c135909a4d1b9e7efc70b73b8a6c => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:50.935541 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671533c0-a3f6-4844-be02-ad9437550a38 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:50.936028 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671533c0-a3f6-4844-be02-ad9437550a38 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:50.936794 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671533c0-a3f6-4844-be02-ad9437550a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:50.956274 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-671533c0-a3f6-4844-be02-ad9437550a38 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:50.957764 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-671533c0-a3f6-4844-be02-ad9437550a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:50.960248 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:51.009504 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a45dcf-aa12-48f1-bdb1-cdff3ecb6365 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:51.011200 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a45dcf-aa12-48f1-bdb1-cdff3ecb6365 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:51.022371 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:51.033972 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 169/347] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:52:51.034803 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671533c0-a3f6-4844-be02-ad9437550a38 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:51.143538 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671533c0-a3f6-4844-be02-ad9437550a38 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:51.150398 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 179/348] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:52:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 11:52:51.151378 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a45dcf-aa12-48f1-bdb1-cdff3ecb6365 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:51.184228 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a92a5-9206-4b82-9d20-0928c6e74802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:51.185010 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a92a5-9206-4b82-9d20-0928c6e74802 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:51.185299 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a92a5-9206-4b82-9d20-0928c6e74802 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:51.185580 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a92a5-9206-4b82-9d20-0928c6e74802 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:51.186425 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a92a5-9206-4b82-9d20-0928c6e74802 None admin] RBAC: Adding query filter params (group.id=e476c135909a4d1b9e7efc70b73b8a6c, role.id=b3d7a91b614d49a3bc751e1d330a67cf, scope.project.id=8d69c66b67494123b35f0b9eeaf0f02b) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:51.186743 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a92a5-9206-4b82-9d20-0928c6e74802 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:51.188820 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a92a5-9206-4b82-9d20-0928c6e74802 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:51.194997 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 170/349] 10.222.0.39 () {56 vars in 1376 bytes} [Wed Jun 8 11:52:51 2022] GET /identity/v3/role_assignments?group.id=e476c135909a4d1b9e7efc70b73b8a6c&scope.project.id=8d69c66b67494123b35f0b9eeaf0f02b&role.id=b3d7a91b614d49a3bc751e1d330a67cf => generated 260 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:51.195895 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a92a5-9206-4b82-9d20-0928c6e74802 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:51.213947 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:51.264267 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:51.270548 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a45dcf-aa12-48f1-bdb1-cdff3ecb6365 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:51.311274 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e0ceba-25dd-439d-bbba-9206aedc4334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:51.312194 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0ceba-25dd-439d-bbba-9206aedc4334 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:51.312614 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0ceba-25dd-439d-bbba-9206aedc4334 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:51.312950 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0ceba-25dd-439d-bbba-9206aedc4334 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:51.315459 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a92a5-9206-4b82-9d20-0928c6e74802 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:51.324800 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e0ceba-25dd-439d-bbba-9206aedc4334 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:52:51.334492 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-42e0ceba-25dd-439d-bbba-9206aedc4334 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 11:52:51.334492 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:52:51.334492 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:52:51.334492 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:52:51.334492 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:52:51.334492 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:52:51.334492 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:52:51.334492 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:52:51.334492 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:52:51.334492 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:52:51.334492 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:52:51.334492 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:52:51.334492 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:52:51.334492 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:52:51.334492 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:52:51.334492 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:52:51.335462 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:52:51.335462 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:52:51.335462 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:52:51.335462 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:52:51.335462 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:52:51.335462 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:52:51.335462 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:52:51.335462 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:52:51.335462 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:52:51.335462 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:52:51.335462 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:52:51.335462 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:52:51.335462 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:52:51.335462 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:52:51.335462 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:52:51.335462 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:52:51.336351 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:52:51.336351 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:52:51.336351 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:52:51.336351 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:52:51.336351 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:52:51.336351 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:52:51.336351 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:52:51.336351 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:52:51.336351 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:52:51.336351 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:52:51.336351 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 11:52:51.336351 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:52:51.340676 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 180/350] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:52:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:52:51.342717 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e0ceba-25dd-439d-bbba-9206aedc4334 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:51.356791 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3acd6d-0f3c-4a3c-9465-810fa7da36e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:51.357698 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3acd6d-0f3c-4a3c-9465-810fa7da36e4 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:51.357976 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3acd6d-0f3c-4a3c-9465-810fa7da36e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:51.358372 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3acd6d-0f3c-4a3c-9465-810fa7da36e4 None admin] PATH_INFO: `/v3/projects/8d69c66b67494123b35f0b9eeaf0f02b` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:51.359656 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3acd6d-0f3c-4a3c-9465-810fa7da36e4 None admin] RBAC: Authorizing `identity:get_project(project_id=8d69c66b67494123b35f0b9eeaf0f02b)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:51.361278 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3acd6d-0f3c-4a3c-9465-810fa7da36e4 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:51.363543 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 171/351] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Jun 8 11:52:51 2022] GET /identity/v3/projects/8d69c66b67494123b35f0b9eeaf0f02b => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:51.369633 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3acd6d-0f3c-4a3c-9465-810fa7da36e4 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:51.526573 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e0ceba-25dd-439d-bbba-9206aedc4334 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:51.543713 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:51.568645 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3acd6d-0f3c-4a3c-9465-810fa7da36e4 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:51.568967 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7ef71-a72b-4e61-8008-b3951712379b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:51.569812 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7ef71-a72b-4e61-8008-b3951712379b None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:51.570240 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7ef71-a72b-4e61-8008-b3951712379b None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:51.570896 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7ef71-a72b-4e61-8008-b3951712379b None admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:51.571786 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af7ef71-a72b-4e61-8008-b3951712379b None admin] RBAC: Adding query filter params (name=member) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:51.572247 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af7ef71-a72b-4e61-8008-b3951712379b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:51.575388 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af7ef71-a72b-4e61-8008-b3951712379b None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:51.585705 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 181/352] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Jun 8 11:52:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:52:51.587868 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5d9c7-ec11-4877-8943-33085c9c2517 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:51.592579 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5d9c7-ec11-4877-8943-33085c9c2517 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:51.593160 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5d9c7-ec11-4877-8943-33085c9c2517 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:51.596098 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 182/353] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:51 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:52:51.597556 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5d9c7-ec11-4877-8943-33085c9c2517 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:51.616934 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:51.632578 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3cd60d-b23e-46ed-b348-2317cf994a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:51.633476 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3cd60d-b23e-46ed-b348-2317cf994a55 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:51.633760 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3cd60d-b23e-46ed-b348-2317cf994a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:51.634035 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3cd60d-b23e-46ed-b348-2317cf994a55 None admin] PATH_INFO: `/v3/groups/e476c135909a4d1b9e7efc70b73b8a6c` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:51.635187 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3cd60d-b23e-46ed-b348-2317cf994a55 None admin] RBAC: Authorizing `identity:get_group(group_id=e476c135909a4d1b9e7efc70b73b8a6c)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:51.638884 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3cd60d-b23e-46ed-b348-2317cf994a55 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:51.639232 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 172/354] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Jun 8 11:52:51 2022] GET /identity/v3/groups/e476c135909a4d1b9e7efc70b73b8a6c => generated 226 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:51.640513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817f53e-b5c9-43d2-b054-be0bb414cf0b None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:51.640796 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817f53e-b5c9-43d2-b054-be0bb414cf0b None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:51.641069 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817f53e-b5c9-43d2-b054-be0bb414cf0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:51.663207 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-d817f53e-b5c9-43d2-b054-be0bb414cf0b None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:51.666292 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-d817f53e-b5c9-43d2-b054-be0bb414cf0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:51.751368 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5d9c7-ec11-4877-8943-33085c9c2517 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:51.759279 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 173/355] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:52:51.760783 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817f53e-b5c9-43d2-b054-be0bb414cf0b None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:51.789079 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4937fd-03ff-40dc-ab82-eb479b031dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:51.789860 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4937fd-03ff-40dc-ab82-eb479b031dc1 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:51.789968 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4937fd-03ff-40dc-ab82-eb479b031dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:51.790209 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4937fd-03ff-40dc-ab82-eb479b031dc1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:51.858614 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:51.889970 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4937fd-03ff-40dc-ab82-eb479b031dc1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:51.892399 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4937fd-03ff-40dc-ab82-eb479b031dc1 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:51.893309 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817f53e-b5c9-43d2-b054-be0bb414cf0b None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:51.922061 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:51.936670 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56586b8-a50f-400e-9636-7779c8ad005c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:51.937458 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56586b8-a50f-400e-9636-7779c8ad005c None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:51.937750 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56586b8-a50f-400e-9636-7779c8ad005c None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:51.938032 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56586b8-a50f-400e-9636-7779c8ad005c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:51.939506 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56586b8-a50f-400e-9636-7779c8ad005c None admin] RBAC: Adding query filter params (group.id=e476c135909a4d1b9e7efc70b73b8a6c, role.id=3682372ab3c145ba87e8baa5c520625f, scope.project.id=8d69c66b67494123b35f0b9eeaf0f02b) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:51.939506 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56586b8-a50f-400e-9636-7779c8ad005c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:51.940848 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56586b8-a50f-400e-9636-7779c8ad005c None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:51.947246 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 174/356] 10.222.0.39 () {56 vars in 1376 bytes} [Wed Jun 8 11:52:51 2022] GET /identity/v3/role_assignments?group.id=e476c135909a4d1b9e7efc70b73b8a6c&scope.project.id=8d69c66b67494123b35f0b9eeaf0f02b&role.id=3682372ab3c145ba87e8baa5c520625f => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:51.952277 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6d095-e4df-4919-a688-c5f54cb45166 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:51.952277 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6d095-e4df-4919-a688-c5f54cb45166 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:51.952277 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6d095-e4df-4919-a688-c5f54cb45166 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:51.956294 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 175/357] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:52:51.957197 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c6d095-e4df-4919-a688-c5f54cb45166 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:52.028950 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 183/358] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:52:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 11:52:52.031693 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0a61e-3d87-43ca-a5b9-b7dccb266c42 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:52.032300 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0a61e-3d87-43ca-a5b9-b7dccb266c42 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:52.032781 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0a61e-3d87-43ca-a5b9-b7dccb266c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:52.060369 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-93e0a61e-3d87-43ca-a5b9-b7dccb266c42 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:52.061907 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-93e0a61e-3d87-43ca-a5b9-b7dccb266c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:52.148337 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 184/359] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:52:52.150192 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e0a61e-3d87-43ca-a5b9-b7dccb266c42 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:52.161063 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:52.176867 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c6d095-e4df-4919-a688-c5f54cb45166 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:52.248887 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a98f9e4-1087-410c-b992-1ef38bb6ec21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:52.249734 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a98f9e4-1087-410c-b992-1ef38bb6ec21 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:52.250021 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a98f9e4-1087-410c-b992-1ef38bb6ec21 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:52.250411 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a98f9e4-1087-410c-b992-1ef38bb6ec21 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:52.264665 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a98f9e4-1087-410c-b992-1ef38bb6ec21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:52:52.275906 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e0a61e-3d87-43ca-a5b9-b7dccb266c42 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:52.277770 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-8a98f9e4-1087-410c-b992-1ef38bb6ec21 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 11:52:52.277770 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:52:52.277770 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:52:52.277770 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:52:52.277770 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:52:52.277770 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:52:52.277770 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:52:52.277770 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:52:52.277770 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:52:52.277770 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:52:52.277770 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:52:52.277770 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:52:52.277770 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:52:52.277770 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:52:52.277770 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:52:52.277770 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:52:52.278838 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:52:52.278838 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:52:52.278838 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:52:52.278838 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:52:52.278838 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:52:52.278838 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:52:52.278838 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:52:52.278838 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:52:52.278838 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:52:52.278838 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:52:52.278838 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:52:52.278838 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:52:52.278838 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:52:52.278838 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:52:52.278838 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:52:52.278838 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:52:52.279818 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:52:52.279818 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:52:52.279818 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:52:52.279818 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:52:52.279818 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:52:52.279818 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:52:52.279818 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:52:52.279818 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:52:52.279818 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:52:52.279818 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:52:52.279818 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 11:52:52.279818 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:52:52.281375 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 176/360] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Jun 8 11:52:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:52:52.282420 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a98f9e4-1087-410c-b992-1ef38bb6ec21 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:52.328949 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b8ae15-22a2-4ac1-af4d-576212cc6ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:52.329956 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8ae15-22a2-4ac1-af4d-576212cc6ea2 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:52.330316 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8ae15-22a2-4ac1-af4d-576212cc6ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:52.330669 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8ae15-22a2-4ac1-af4d-576212cc6ea2 None admin] PATH_INFO: `/v3/projects/226a798c297d4f20b3999a94a6dbe9d5` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:52.332368 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b8ae15-22a2-4ac1-af4d-576212cc6ea2 None admin] RBAC: Authorizing `identity:get_project(project_id=226a798c297d4f20b3999a94a6dbe9d5)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:52.335020 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b8ae15-22a2-4ac1-af4d-576212cc6ea2 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:52.336933 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 185/361] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Jun 8 11:52:52 2022] GET /identity/v3/projects/226a798c297d4f20b3999a94a6dbe9d5 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:52.338320 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955fb9c8-1afc-4a7d-a06c-6a142560f1d6 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:52.339331 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955fb9c8-1afc-4a7d-a06c-6a142560f1d6 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:52.339916 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955fb9c8-1afc-4a7d-a06c-6a142560f1d6 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:52.342126 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 186/362] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:52:52.343016 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955fb9c8-1afc-4a7d-a06c-6a142560f1d6 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:52.348781 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:52.430329 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a98f9e4-1087-410c-b992-1ef38bb6ec21 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:52.445164 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:52.476553 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862cb54-1a32-4bc3-9696-8219221c9268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:52.477530 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862cb54-1a32-4bc3-9696-8219221c9268 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:52.477820 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862cb54-1a32-4bc3-9696-8219221c9268 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:52.478410 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862cb54-1a32-4bc3-9696-8219221c9268 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:52.485070 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955fb9c8-1afc-4a7d-a06c-6a142560f1d6 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:52.491412 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862cb54-1a32-4bc3-9696-8219221c9268 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:52:52.501316 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-6862cb54-1a32-4bc3-9696-8219221c9268 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 11:52:52.501316 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:52:52.501316 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:52:52.501316 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:52:52.501316 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:52:52.501316 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:52:52.501316 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:52:52.501316 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:52:52.501316 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:52:52.501316 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:52:52.501316 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:52:52.501316 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:52:52.501316 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:52:52.501316 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:52:52.501316 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:52:52.501316 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:52:52.502234 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:52:52.502234 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:52:52.502234 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:52:52.502234 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:52:52.502234 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:52:52.502234 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:52:52.502234 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:52:52.502234 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:52:52.502234 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:52:52.502234 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:52:52.502234 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:52:52.502234 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:52:52.502234 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:52:52.502234 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:52:52.502234 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:52:52.502234 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:52:52.503033 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:52:52.503033 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:52:52.503033 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:52:52.503033 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:52:52.503033 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:52:52.503033 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:52:52.503033 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:52:52.503033 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:52:52.503033 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:52:52.503033 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:52:52.503033 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 08 11:52:52.503033 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:52:52.503637 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 177/363] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:52:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:52:52.507136 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f9d94-fe07-4709-9d54-dcc41f5e3905 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:52.507136 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f9d94-fe07-4709-9d54-dcc41f5e3905 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:52.507136 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f9d94-fe07-4709-9d54-dcc41f5e3905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:52.526567 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-4a0f9d94-fe07-4709-9d54-dcc41f5e3905 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:52.528308 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-4a0f9d94-fe07-4709-9d54-dcc41f5e3905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:52.531920 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f256db4c-d15b-455e-b890-dcf7c2f48e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:52.532757 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256db4c-d15b-455e-b890-dcf7c2f48e0d None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:52.533041 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256db4c-d15b-455e-b890-dcf7c2f48e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:52.533326 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256db4c-d15b-455e-b890-dcf7c2f48e0d None admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:52.534085 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f256db4c-d15b-455e-b890-dcf7c2f48e0d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:52.534390 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f256db4c-d15b-455e-b890-dcf7c2f48e0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:52.535802 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f256db4c-d15b-455e-b890-dcf7c2f48e0d None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:52.547325 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 187/364] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Jun 8 11:52:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:52.548124 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f256db4c-d15b-455e-b890-dcf7c2f48e0d None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:52.618526 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 178/365] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:52:52.619565 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f9d94-fe07-4709-9d54-dcc41f5e3905 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:52.660814 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:52.680193 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f256db4c-d15b-455e-b890-dcf7c2f48e0d None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:52.731288 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d71f84-e839-48ef-9c56-2eff756a6810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:52.731288 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d71f84-e839-48ef-9c56-2eff756a6810 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:52.731288 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d71f84-e839-48ef-9c56-2eff756a6810 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:52.731632 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d71f84-e839-48ef-9c56-2eff756a6810 None admin] PATH_INFO: `/v3/groups/e476c135909a4d1b9e7efc70b73b8a6c` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:52.733548 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d71f84-e839-48ef-9c56-2eff756a6810 None admin] RBAC: Authorizing `identity:get_group(group_id=e476c135909a4d1b9e7efc70b73b8a6c)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:52.735513 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d71f84-e839-48ef-9c56-2eff756a6810 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:52.738005 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 188/366] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Jun 8 11:52:52 2022] GET /identity/v3/groups/e476c135909a4d1b9e7efc70b73b8a6c => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:52.738848 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d71f84-e839-48ef-9c56-2eff756a6810 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:52.742516 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:52.749432 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f9d94-fe07-4709-9d54-dcc41f5e3905 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:52.798135 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d4f3c0-1ead-4498-81a4-0f57140e853d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:52.798874 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4f3c0-1ead-4498-81a4-0f57140e853d None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:52.799109 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4f3c0-1ead-4498-81a4-0f57140e853d None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:52.799385 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4f3c0-1ead-4498-81a4-0f57140e853d None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:52.800148 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d4f3c0-1ead-4498-81a4-0f57140e853d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:52.800555 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d4f3c0-1ead-4498-81a4-0f57140e853d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:52.802861 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d4f3c0-1ead-4498-81a4-0f57140e853d None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:52.814445 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 179/367] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Jun 8 11:52:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:52.815426 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d4f3c0-1ead-4498-81a4-0f57140e853d None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:52.873252 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d71f84-e839-48ef-9c56-2eff756a6810 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:52.920100 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfdd582-d7a6-4783-9454-bd013d27d53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:52.920782 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfdd582-d7a6-4783-9454-bd013d27d53b None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:52.921064 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfdd582-d7a6-4783-9454-bd013d27d53b None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:52.921338 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfdd582-d7a6-4783-9454-bd013d27d53b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:52.934210 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:52.938091 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d4f3c0-1ead-4498-81a4-0f57140e853d None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:52.984944 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f986711-4c53-4a37-996b-dc49ff920d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:52.986147 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f986711-4c53-4a37-996b-dc49ff920d31 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:52.986423 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f986711-4c53-4a37-996b-dc49ff920d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:52.986691 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f986711-4c53-4a37-996b-dc49ff920d31 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:53.003612 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f986711-4c53-4a37-996b-dc49ff920d31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:52:53.009687 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfdd582-d7a6-4783-9454-bd013d27d53b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:53.011181 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfdd582-d7a6-4783-9454-bd013d27d53b None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:53.012856 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-8f986711-4c53-4a37-996b-dc49ff920d31 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:52:53.012856 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:52:53.012856 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:52:53.012856 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:52:53.012856 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:52:53.012856 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:52:53.012856 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:52:53.012856 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:52:53.012856 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:52:53.012856 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:52:53.012856 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:52:53.012856 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:52:53.012856 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:52:53.012856 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:52:53.012856 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:52:53.012856 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:52:53.014922 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:52:53.014922 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:52:53.014922 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:52:53.014922 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:52:53.014922 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:52:53.014922 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:52:53.014922 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:52:53.014922 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:52:53.014922 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:52:53.014922 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:52:53.014922 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:52:53.014922 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:52:53.014922 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:52:53.014922 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:52:53.014922 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:52:53.014922 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:52:53.016912 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:52:53.016912 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:52:53.016912 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:52:53.016912 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:52:53.016912 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:52:53.016912 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:52:53.016912 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:52:53.016912 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:52:53.016912 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:52:53.016912 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:52:53.016912 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:52:53.016912 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:52:53.016912 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 180/368] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Jun 8 11:52:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:52:53.016912 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f986711-4c53-4a37-996b-dc49ff920d31 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:53.021770 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:53.139291 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f986711-4c53-4a37-996b-dc49ff920d31 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:53.147567 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 189/369] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:52:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 11:52:53.149152 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfdd582-d7a6-4783-9454-bd013d27d53b None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:53.187194 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26880e-a9d4-49c7-82fd-f8b9b49a6599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:53.188362 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26880e-a9d4-49c7-82fd-f8b9b49a6599 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:53.188761 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26880e-a9d4-49c7-82fd-f8b9b49a6599 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:53.189051 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26880e-a9d4-49c7-82fd-f8b9b49a6599 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:53.189884 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d26880e-a9d4-49c7-82fd-f8b9b49a6599 None admin] RBAC: Adding query filter params (group.id=e476c135909a4d1b9e7efc70b73b8a6c, role.id=3682372ab3c145ba87e8baa5c520625f, scope.project.id=226a798c297d4f20b3999a94a6dbe9d5) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:53.190197 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d26880e-a9d4-49c7-82fd-f8b9b49a6599 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:53.191811 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d26880e-a9d4-49c7-82fd-f8b9b49a6599 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:53.198020 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 181/370] 10.222.0.39 () {56 vars in 1376 bytes} [Wed Jun 8 11:52:53 2022] GET /identity/v3/role_assignments?group.id=e476c135909a4d1b9e7efc70b73b8a6c&scope.project.id=226a798c297d4f20b3999a94a6dbe9d5&role.id=3682372ab3c145ba87e8baa5c520625f => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:53.198733 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26880e-a9d4-49c7-82fd-f8b9b49a6599 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:53.233917 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:53.282604 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfdd582-d7a6-4783-9454-bd013d27d53b None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:53.288590 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:53.330544 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944357b-e611-456e-b5ab-4953ec3c3de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:53.331418 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944357b-e611-456e-b5ab-4953ec3c3de7 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:53.331703 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944357b-e611-456e-b5ab-4953ec3c3de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:53.331976 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944357b-e611-456e-b5ab-4953ec3c3de7 None admin] PATH_INFO: `/v3/users/8917c9cb421941e092fc25bafdac395f` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:53.333571 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a944357b-e611-456e-b5ab-4953ec3c3de7 None admin] RBAC: Authorizing `identity:get_user(user_id=8917c9cb421941e092fc25bafdac395f)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:53.335299 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a944357b-e611-456e-b5ab-4953ec3c3de7 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:53.337412 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 190/371] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Jun 8 11:52:53 2022] GET /identity/v3/users/8917c9cb421941e092fc25bafdac395f => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:53.338433 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944357b-e611-456e-b5ab-4953ec3c3de7 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:53.346093 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26880e-a9d4-49c7-82fd-f8b9b49a6599 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:53.397975 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2aed59-0d06-48bc-bc64-e5e60c05cc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:53.398579 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2aed59-0d06-48bc-bc64-e5e60c05cc91 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:53.398861 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2aed59-0d06-48bc-bc64-e5e60c05cc91 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:53.399132 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2aed59-0d06-48bc-bc64-e5e60c05cc91 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:53.399921 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2aed59-0d06-48bc-bc64-e5e60c05cc91 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:53.400256 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2aed59-0d06-48bc-bc64-e5e60c05cc91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:53.402997 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2aed59-0d06-48bc-bc64-e5e60c05cc91 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:53.416437 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 182/372] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:52:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:53.418123 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2aed59-0d06-48bc-bc64-e5e60c05cc91 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:53.475017 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944357b-e611-456e-b5ab-4953ec3c3de7 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:53.513136 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea671397-1847-42ae-b0e3-363e21a2588b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:53.514090 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea671397-1847-42ae-b0e3-363e21a2588b None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:53.514658 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea671397-1847-42ae-b0e3-363e21a2588b None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:53.514658 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea671397-1847-42ae-b0e3-363e21a2588b None admin] PATH_INFO: `/v3/projects/226a798c297d4f20b3999a94a6dbe9d5` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:53.515832 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea671397-1847-42ae-b0e3-363e21a2588b None admin] RBAC: Authorizing `identity:get_project(project_id=226a798c297d4f20b3999a94a6dbe9d5)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:53.517353 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea671397-1847-42ae-b0e3-363e21a2588b None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:53.519072 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 191/373] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Jun 8 11:52:53 2022] GET /identity/v3/projects/226a798c297d4f20b3999a94a6dbe9d5 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:53.523660 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:53.524571 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea671397-1847-42ae-b0e3-363e21a2588b None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:53.543805 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2aed59-0d06-48bc-bc64-e5e60c05cc91 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:53.569372 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:53.587657 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e03ba3-e26e-49aa-b327-e250060cbfd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:53.589322 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e03ba3-e26e-49aa-b327-e250060cbfd2 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:53.590459 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e03ba3-e26e-49aa-b327-e250060cbfd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:53.590952 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e03ba3-e26e-49aa-b327-e250060cbfd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:53.591995 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e03ba3-e26e-49aa-b327-e250060cbfd2 None admin] RBAC: Adding query filter params (role.id=0615a114184d403c8ee7d5c22d6630a9, user.id=8917c9cb421941e092fc25bafdac395f, scope.system=all) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:53.595316 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e03ba3-e26e-49aa-b327-e250060cbfd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:53.604189 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e03ba3-e26e-49aa-b327-e250060cbfd2 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:53.612238 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 183/374] 10.222.0.39 () {56 vars in 1308 bytes} [Wed Jun 8 11:52:53 2022] GET /identity/v3/role_assignments?user.id=8917c9cb421941e092fc25bafdac395f&scope.system=all&role.id=0615a114184d403c8ee7d5c22d6630a9 => generated 510 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:53.613273 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e03ba3-e26e-49aa-b327-e250060cbfd2 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:53.636770 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea671397-1847-42ae-b0e3-363e21a2588b None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:53.678076 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b445c-807b-41c5-96ba-b7e34dd9ce3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:53.678683 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b445c-807b-41c5-96ba-b7e34dd9ce3b None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:53.678966 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b445c-807b-41c5-96ba-b7e34dd9ce3b None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:53.679243 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b445c-807b-41c5-96ba-b7e34dd9ce3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:53.738162 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e03ba3-e26e-49aa-b327-e250060cbfd2 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:53.754077 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65b445c-807b-41c5-96ba-b7e34dd9ce3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:53.755595 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65b445c-807b-41c5-96ba-b7e34dd9ce3b None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:53.778432 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65acc40f-20cb-4186-a2f4-b59b8171e2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:53.779373 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acc40f-20cb-4186-a2f4-b59b8171e2bf None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:53.779659 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acc40f-20cb-4186-a2f4-b59b8171e2bf None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:53.779932 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acc40f-20cb-4186-a2f4-b59b8171e2bf None admin] PATH_INFO: `/v3/groups/e476c135909a4d1b9e7efc70b73b8a6c` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:53.781309 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65acc40f-20cb-4186-a2f4-b59b8171e2bf None admin] RBAC: Authorizing `identity:get_group(group_id=e476c135909a4d1b9e7efc70b73b8a6c)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:53.783004 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65acc40f-20cb-4186-a2f4-b59b8171e2bf None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:53.785283 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 184/375] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Jun 8 11:52:53 2022] GET /identity/v3/groups/e476c135909a4d1b9e7efc70b73b8a6c => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:53.806277 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:53.807035 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65acc40f-20cb-4186-a2f4-b59b8171e2bf None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:53.827715 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:53.871150 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 192/376] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:52:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 11:52:53.877209 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b445c-807b-41c5-96ba-b7e34dd9ce3b None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:53.938574 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65acc40f-20cb-4186-a2f4-b59b8171e2bf None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:53.982309 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b7806-3aad-4294-b522-6f7cc63cd37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:53.982990 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b7806-3aad-4294-b522-6f7cc63cd37b None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:53.983280 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b7806-3aad-4294-b522-6f7cc63cd37b None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:53.983559 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b7806-3aad-4294-b522-6f7cc63cd37b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:53.985536 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b7806-3aad-4294-b522-6f7cc63cd37b None admin] RBAC: Adding query filter params (group.id=e476c135909a4d1b9e7efc70b73b8a6c, role.id=b3d7a91b614d49a3bc751e1d330a67cf, scope.project.id=226a798c297d4f20b3999a94a6dbe9d5) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:53.985856 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b7806-3aad-4294-b522-6f7cc63cd37b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:53.987318 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b7806-3aad-4294-b522-6f7cc63cd37b None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:53.992815 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b445c-807b-41c5-96ba-b7e34dd9ce3b None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:53.994005 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 185/377] 10.222.0.39 () {56 vars in 1376 bytes} [Wed Jun 8 11:52:53 2022] GET /identity/v3/role_assignments?group.id=e476c135909a4d1b9e7efc70b73b8a6c&scope.project.id=226a798c297d4f20b3999a94a6dbe9d5&role.id=b3d7a91b614d49a3bc751e1d330a67cf => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:52:54.063918 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa9fc7-564b-4c7d-800a-5f50a99e241c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:54.064862 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa9fc7-564b-4c7d-800a-5f50a99e241c None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:54.065147 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa9fc7-564b-4c7d-800a-5f50a99e241c None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:54.065424 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa9fc7-564b-4c7d-800a-5f50a99e241c None admin] PATH_INFO: `/v3/projects/8f8cde9fd1b644e687e4b80b620e4c44` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:54.073251 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fa9fc7-564b-4c7d-800a-5f50a99e241c None admin] RBAC: Authorizing `identity:get_project(project_id=8f8cde9fd1b644e687e4b80b620e4c44)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:54.075457 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fa9fc7-564b-4c7d-800a-5f50a99e241c None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:54.077729 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 193/378] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Jun 8 11:52:53 2022] GET /identity/v3/projects/8f8cde9fd1b644e687e4b80b620e4c44 => generated 344 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:52:54.083345 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b7806-3aad-4294-b522-6f7cc63cd37b None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:54.218287 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:54.257194 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b7806-3aad-4294-b522-6f7cc63cd37b None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:54.301773 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa22db3-fc5f-41f4-9723-9f660d381e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:54.302655 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa22db3-fc5f-41f4-9723-9f660d381e8e None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:54.302940 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa22db3-fc5f-41f4-9723-9f660d381e8e None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:54.303219 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa22db3-fc5f-41f4-9723-9f660d381e8e None admin] PATH_INFO: `/v3/groups/928736aafaa042e688747ef80a0f707a` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:54.309469 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa22db3-fc5f-41f4-9723-9f660d381e8e None admin] RBAC: Authorizing `identity:get_group(group_id=928736aafaa042e688747ef80a0f707a)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:54.310958 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa22db3-fc5f-41f4-9723-9f660d381e8e None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:54.316550 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 186/379] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Jun 8 11:52:54 2022] GET /identity/v3/groups/928736aafaa042e688747ef80a0f707a => generated 229 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:54.318925 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa9fc7-564b-4c7d-800a-5f50a99e241c None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:54.340568 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:54.436633 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94763286-e975-40d1-9bbc-fbabe694d1f6 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:54.436952 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94763286-e975-40d1-9bbc-fbabe694d1f6 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:54.437194 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94763286-e975-40d1-9bbc-fbabe694d1f6 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:54.438825 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 187/380] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:52:54.462502 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b103e-9c11-4aac-8a4b-45454bf186a2 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:54.462808 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b103e-9c11-4aac-8a4b-45454bf186a2 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:54.463066 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b103e-9c11-4aac-8a4b-45454bf186a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:54.465078 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa9fc7-564b-4c7d-800a-5f50a99e241c None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:54.495042 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-b81b103e-9c11-4aac-8a4b-45454bf186a2 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:54.500243 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b81b103e-9c11-4aac-8a4b-45454bf186a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:54.509179 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a94a0-973f-43f1-92f9-21a707149321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:54.509863 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a94a0-973f-43f1-92f9-21a707149321 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:54.510150 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a94a0-973f-43f1-92f9-21a707149321 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:54.510427 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a94a0-973f-43f1-92f9-21a707149321 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:54.511303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a94a0-973f-43f1-92f9-21a707149321 None admin] RBAC: Adding query filter params (group.id=928736aafaa042e688747ef80a0f707a, role.id=028d4429a4554bbb88b3aec9f6a9d937, scope.project.id=8f8cde9fd1b644e687e4b80b620e4c44) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:54.512244 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a94a0-973f-43f1-92f9-21a707149321 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:54.513700 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a94a0-973f-43f1-92f9-21a707149321 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:54.526345 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 194/381] 10.222.0.39 () {56 vars in 1376 bytes} [Wed Jun 8 11:52:54 2022] GET /identity/v3/role_assignments?group.id=928736aafaa042e688747ef80a0f707a&scope.project.id=8f8cde9fd1b644e687e4b80b620e4c44&role.id=028d4429a4554bbb88b3aec9f6a9d937 => generated 260 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:54.639324 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 188/382] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:52:54.679005 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a94a0-973f-43f1-92f9-21a707149321 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:54.769542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:54.813966 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a94a0-973f-43f1-92f9-21a707149321 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:54.854867 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f76deb2-f19c-420a-9cf9-f0bed97a624b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:54.856864 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76deb2-f19c-420a-9cf9-f0bed97a624b None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:54.857144 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76deb2-f19c-420a-9cf9-f0bed97a624b None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:54.857416 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76deb2-f19c-420a-9cf9-f0bed97a624b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:54.879671 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f76deb2-f19c-420a-9cf9-f0bed97a624b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:52:54.889665 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-2f76deb2-f19c-420a-9cf9-f0bed97a624b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 11:52:54.889665 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:52:54.889665 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:52:54.889665 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:52:54.889665 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:52:54.889665 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:52:54.889665 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:52:54.889665 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:52:54.889665 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:52:54.889665 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:52:54.889665 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:52:54.889665 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:52:54.889665 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:52:54.889665 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:52:54.889665 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:52:54.889665 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:52:54.890636 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:52:54.890636 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:52:54.890636 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:52:54.890636 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:52:54.890636 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:52:54.890636 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:52:54.890636 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:52:54.890636 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:52:54.890636 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:52:54.890636 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:52:54.890636 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:52:54.890636 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:52:54.890636 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:52:54.890636 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:52:54.890636 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:52:54.890636 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:52:54.891417 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:52:54.891417 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:52:54.891417 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:52:54.891417 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:52:54.891417 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:52:54.891417 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:52:54.891417 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:52:54.891417 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:52:54.891417 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:52:54.891417 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:52:54.891417 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 11:52:54.891417 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:52:54.892020 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 195/383] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Jun 8 11:52:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:52:54.897401 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b103e-9c11-4aac-8a4b-45454bf186a2 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:54.993992 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:55.023530 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b103e-9c11-4aac-8a4b-45454bf186a2 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:55.070687 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c957ebf-d26f-4650-a7a9-2919fa722ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:55.071376 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c957ebf-d26f-4650-a7a9-2919fa722ed2 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:55.071654 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c957ebf-d26f-4650-a7a9-2919fa722ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:55.071924 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c957ebf-d26f-4650-a7a9-2919fa722ed2 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:55.072703 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c957ebf-d26f-4650-a7a9-2919fa722ed2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:55.073004 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c957ebf-d26f-4650-a7a9-2919fa722ed2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:55.075049 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c957ebf-d26f-4650-a7a9-2919fa722ed2 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:55.090778 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 189/384] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Jun 8 11:52:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:55.096092 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f76deb2-f19c-420a-9cf9-f0bed97a624b None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:55.223285 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f76deb2-f19c-420a-9cf9-f0bed97a624b None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:55.263867 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:55.269247 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8b66f-fccd-4f28-bbe5-6dd8719e2ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:55.270370 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8b66f-fccd-4f28-bbe5-6dd8719e2ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:55.270860 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8b66f-fccd-4f28-bbe5-6dd8719e2ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:55.271330 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8b66f-fccd-4f28-bbe5-6dd8719e2ae9 None admin] PATH_INFO: `/v3/groups/e476c135909a4d1b9e7efc70b73b8a6c` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:55.277451 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f8b66f-fccd-4f28-bbe5-6dd8719e2ae9 None admin] RBAC: Authorizing `identity:get_group(group_id=e476c135909a4d1b9e7efc70b73b8a6c)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:55.279143 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f8b66f-fccd-4f28-bbe5-6dd8719e2ae9 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:55.281386 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 196/385] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Jun 8 11:52:55 2022] GET /identity/v3/groups/e476c135909a4d1b9e7efc70b73b8a6c => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:55.289264 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c957ebf-d26f-4650-a7a9-2919fa722ed2 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:55.411984 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2168c7-e914-47c2-8372-84f7c69c2440 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:55.412324 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2168c7-e914-47c2-8372-84f7c69c2440 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:55.412589 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2168c7-e914-47c2-8372-84f7c69c2440 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:55.414242 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 197/386] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:52:55.420712 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab3dea-9677-400c-9a2c-da6af7de6e90 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:55.421008 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab3dea-9677-400c-9a2c-da6af7de6e90 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:55.421289 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab3dea-9677-400c-9a2c-da6af7de6e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:55.429578 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c957ebf-d26f-4650-a7a9-2919fa722ed2 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:55.443264 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-76ab3dea-9677-400c-9a2c-da6af7de6e90 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:55.444503 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-76ab3dea-9677-400c-9a2c-da6af7de6e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:55.490030 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:55.503276 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa46e74-0fc2-40f2-8d0d-253dd62fa015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:55.504185 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa46e74-0fc2-40f2-8d0d-253dd62fa015 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:55.504481 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa46e74-0fc2-40f2-8d0d-253dd62fa015 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:55.504757 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa46e74-0fc2-40f2-8d0d-253dd62fa015 None admin] PATH_INFO: `/v3/projects/8d69c66b67494123b35f0b9eeaf0f02b` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:55.506880 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa46e74-0fc2-40f2-8d0d-253dd62fa015 None admin] RBAC: Authorizing `identity:get_project(project_id=8d69c66b67494123b35f0b9eeaf0f02b)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:55.507419 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa46e74-0fc2-40f2-8d0d-253dd62fa015 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:55.513638 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 190/387] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Jun 8 11:52:55 2022] GET /identity/v3/projects/8d69c66b67494123b35f0b9eeaf0f02b => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:55.519137 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa46e74-0fc2-40f2-8d0d-253dd62fa015 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:55.534695 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 198/388] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 11:52:55.634972 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ab3dea-9677-400c-9a2c-da6af7de6e90 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:55.670395 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa46e74-0fc2-40f2-8d0d-253dd62fa015 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:55.711676 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3767c6-2605-468e-9978-0b34251f2a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:55.713009 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3767c6-2605-468e-9978-0b34251f2a6a None admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:55.715116 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3767c6-2605-468e-9978-0b34251f2a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:55.715878 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3767c6-2605-468e-9978-0b34251f2a6a None admin] PATH_INFO: `/v3/projects/8d69c66b67494123b35f0b9eeaf0f02b/groups/e476c135909a4d1b9e7efc70b73b8a6c/roles/b3d7a91b614d49a3bc751e1d330a67cf` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:55.721074 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3767c6-2605-468e-9978-0b34251f2a6a None admin] RBAC: Authorizing `identity:create_grant(project_id=8d69c66b67494123b35f0b9eeaf0f02b, group_id=e476c135909a4d1b9e7efc70b73b8a6c, role_id=b3d7a91b614d49a3bc751e1d330a67cf)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:55.725509 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3767c6-2605-468e-9978-0b34251f2a6a None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:55.752784 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 191/389] 10.222.0.39 () {58 vars in 1442 bytes} [Wed Jun 8 11:52:55 2022] PUT /identity/v3/projects/8d69c66b67494123b35f0b9eeaf0f02b/groups/e476c135909a4d1b9e7efc70b73b8a6c/roles/b3d7a91b614d49a3bc751e1d330a67cf => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 11:52:55.836921 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ab3dea-9677-400c-9a2c-da6af7de6e90 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:55.874052 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:55.881707 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c3524-a761-48c6-8763-17b68515a4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:55.883496 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c3524-a761-48c6-8763-17b68515a4df None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:55.883784 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c3524-a761-48c6-8763-17b68515a4df None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:55.884065 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c3524-a761-48c6-8763-17b68515a4df None admin] PATH_INFO: `/v3/roles/member` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:55.896344 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2c3524-a761-48c6-8763-17b68515a4df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:52:55.905034 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-bf2c3524-a761-48c6-8763-17b68515a4df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 11:52:55.905034 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:52:55.905034 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:52:55.905034 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:52:55.905034 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:52:55.905034 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:52:55.905034 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:52:55.905034 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:52:55.905034 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:52:55.905034 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:52:55.905034 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:52:55.905034 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:52:55.905034 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:52:55.905034 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:52:55.905034 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:52:55.905034 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:52:55.905925 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:52:55.905925 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:52:55.905925 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:52:55.905925 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:52:55.905925 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:52:55.905925 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:52:55.905925 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:52:55.905925 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:52:55.905925 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:52:55.905925 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:52:55.905925 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:52:55.905925 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:52:55.905925 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:52:55.905925 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:52:55.905925 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:52:55.905925 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:52:55.906732 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:52:55.906732 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:52:55.906732 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:52:55.906732 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:52:55.906732 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:52:55.906732 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:52:55.906732 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:52:55.906732 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:52:55.906732 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:52:55.906732 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:52:55.906732 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 11:52:55.906732 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:52:55.906732 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 199/390] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:52:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 11:52:55.912554 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3767c6-2605-468e-9978-0b34251f2a6a None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:55.981079 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:56.037243 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3767c6-2605-468e-9978-0b34251f2a6a None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:56.089802 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be2cf0-324b-4f5a-96ad-4e1af0e9acee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:56.090749 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be2cf0-324b-4f5a-96ad-4e1af0e9acee None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:56.091043 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be2cf0-324b-4f5a-96ad-4e1af0e9acee None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:56.091328 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be2cf0-324b-4f5a-96ad-4e1af0e9acee None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:56.092106 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18be2cf0-324b-4f5a-96ad-4e1af0e9acee None admin] RBAC: Adding query filter params (name=member) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:56.092444 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18be2cf0-324b-4f5a-96ad-4e1af0e9acee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:56.093863 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18be2cf0-324b-4f5a-96ad-4e1af0e9acee None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:56.109634 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 192/391] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Jun 8 11:52:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:56.115867 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c3524-a761-48c6-8763-17b68515a4df None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:56.243665 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c3524-a761-48c6-8763-17b68515a4df None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:56.286784 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a7da5a-48b2-4384-bb45-1840089dc3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:56.287671 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7da5a-48b2-4384-bb45-1840089dc3d9 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:56.287958 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7da5a-48b2-4384-bb45-1840089dc3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:56.288266 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7da5a-48b2-4384-bb45-1840089dc3d9 None admin] PATH_INFO: `/v3/groups/e476c135909a4d1b9e7efc70b73b8a6c` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:56.289468 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a7da5a-48b2-4384-bb45-1840089dc3d9 None admin] RBAC: Authorizing `identity:get_group(group_id=e476c135909a4d1b9e7efc70b73b8a6c)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:56.290925 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a7da5a-48b2-4384-bb45-1840089dc3d9 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:56.293480 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 200/392] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Jun 8 11:52:56 2022] GET /identity/v3/groups/e476c135909a4d1b9e7efc70b73b8a6c => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:56.298958 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be2cf0-324b-4f5a-96ad-4e1af0e9acee None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:56.419340 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be2cf0-324b-4f5a-96ad-4e1af0e9acee None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:56.440883 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:56.457215 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f374f-6160-4212-a713-1528f23f8e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:56.458112 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f374f-6160-4212-a713-1528f23f8e95 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:56.458399 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f374f-6160-4212-a713-1528f23f8e95 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:56.458688 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f374f-6160-4212-a713-1528f23f8e95 None admin] PATH_INFO: `/v3/projects/8d69c66b67494123b35f0b9eeaf0f02b` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:56.459960 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f374f-6160-4212-a713-1528f23f8e95 None admin] RBAC: Authorizing `identity:get_project(project_id=8d69c66b67494123b35f0b9eeaf0f02b)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:56.461434 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f374f-6160-4212-a713-1528f23f8e95 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:56.463497 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 193/393] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Jun 8 11:52:56 2022] GET /identity/v3/projects/8d69c66b67494123b35f0b9eeaf0f02b => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:56.469637 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a7da5a-48b2-4384-bb45-1840089dc3d9 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:56.548120 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:56.599643 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a7da5a-48b2-4384-bb45-1840089dc3d9 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:56.639698 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ffae4-00ad-4d86-894e-625715f571bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:56.640628 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ffae4-00ad-4d86-894e-625715f571bc None admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:56.640915 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ffae4-00ad-4d86-894e-625715f571bc None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:56.641194 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ffae4-00ad-4d86-894e-625715f571bc None admin] PATH_INFO: `/v3/projects/8d69c66b67494123b35f0b9eeaf0f02b/groups/e476c135909a4d1b9e7efc70b73b8a6c/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:56.643198 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86ffae4-00ad-4d86-894e-625715f571bc None admin] RBAC: Authorizing `identity:create_grant(project_id=8d69c66b67494123b35f0b9eeaf0f02b, group_id=e476c135909a4d1b9e7efc70b73b8a6c, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:56.644753 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86ffae4-00ad-4d86-894e-625715f571bc None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:56.663069 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 201/394] 10.222.0.39 () {58 vars in 1442 bytes} [Wed Jun 8 11:52:56 2022] PUT /identity/v3/projects/8d69c66b67494123b35f0b9eeaf0f02b/groups/e476c135909a4d1b9e7efc70b73b8a6c/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 11:52:56.732327 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba80593e-3eb3-40f3-aae6-90ed39cbdb70 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:56.732733 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba80593e-3eb3-40f3-aae6-90ed39cbdb70 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:56.733027 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba80593e-3eb3-40f3-aae6-90ed39cbdb70 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:56.734759 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 194/395] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:52:56.740278 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba775b6-55b2-4f27-a073-36121250b2da None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:56.740635 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba775b6-55b2-4f27-a073-36121250b2da None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:56.740925 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba775b6-55b2-4f27-a073-36121250b2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:56.763543 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-8ba775b6-55b2-4f27-a073-36121250b2da None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:56.764813 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-8ba775b6-55b2-4f27-a073-36121250b2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:56.851913 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 202/396] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:52:56.887547 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba80593e-3eb3-40f3-aae6-90ed39cbdb70 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:57.015071 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba80593e-3eb3-40f3-aae6-90ed39cbdb70 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:57.061252 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec42dc6-81a4-4adb-809b-275c380e3eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:57.062070 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec42dc6-81a4-4adb-809b-275c380e3eda None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:57.062356 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec42dc6-81a4-4adb-809b-275c380e3eda None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:57.062634 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec42dc6-81a4-4adb-809b-275c380e3eda None admin] PATH_INFO: `/v3/roles/member` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:57.078196 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec42dc6-81a4-4adb-809b-275c380e3eda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:52:57.086436 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-5ec42dc6-81a4-4adb-809b-275c380e3eda None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 11:52:57.086436 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:52:57.086436 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:52:57.086436 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:52:57.086436 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:52:57.086436 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:52:57.086436 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:52:57.086436 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:52:57.086436 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:52:57.086436 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:52:57.086436 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:52:57.086436 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:52:57.086436 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:52:57.086436 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:52:57.086436 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:52:57.086436 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:52:57.087412 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:52:57.087412 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:52:57.087412 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:52:57.087412 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:52:57.087412 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:52:57.087412 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:52:57.087412 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:52:57.087412 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:52:57.087412 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:52:57.087412 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:52:57.087412 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:52:57.087412 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:52:57.087412 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:52:57.087412 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:52:57.087412 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:52:57.087412 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:52:57.088243 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:52:57.088243 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:52:57.088243 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:52:57.088243 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:52:57.088243 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:52:57.088243 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:52:57.088243 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:52:57.088243 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:52:57.088243 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:52:57.088243 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:52:57.088243 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 11:52:57.088243 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:52:57.088243 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 195/397] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:52:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:52:57.095524 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba775b6-55b2-4f27-a073-36121250b2da None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:57.141290 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525703be-3816-4471-b9b2-6ca08695acb1 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:57.141616 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525703be-3816-4471-b9b2-6ca08695acb1 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:57.141865 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525703be-3816-4471-b9b2-6ca08695acb1 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:57.143712 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 196/398] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:52:57.154071 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c738a-61f4-4169-9678-e2a5a86fc46a None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:57.154409 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c738a-61f4-4169-9678-e2a5a86fc46a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:57.154638 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c738a-61f4-4169-9678-e2a5a86fc46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:57.180524 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:57.181493 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-941c738a-61f4-4169-9678-e2a5a86fc46a None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:57.185101 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-941c738a-61f4-4169-9678-e2a5a86fc46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:57.281685 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba775b6-55b2-4f27-a073-36121250b2da None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:57.284624 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:57.331673 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 197/399] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 11:52:57.344458 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f38b07-e0de-44ca-9657-6b8c8e928b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:57.345152 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f38b07-e0de-44ca-9657-6b8c8e928b1c None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:57.345443 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f38b07-e0de-44ca-9657-6b8c8e928b1c None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:57.345729 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f38b07-e0de-44ca-9657-6b8c8e928b1c None admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:57.346503 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f38b07-e0de-44ca-9657-6b8c8e928b1c None admin] RBAC: Adding query filter params (name=member) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:57.346819 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f38b07-e0de-44ca-9657-6b8c8e928b1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:57.348324 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f38b07-e0de-44ca-9657-6b8c8e928b1c None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:57.358068 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 203/400] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Jun 8 11:52:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:57.363782 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c738a-61f4-4169-9678-e2a5a86fc46a None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:57.384456 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f38b07-e0de-44ca-9657-6b8c8e928b1c None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:57.494937 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c738a-61f4-4169-9678-e2a5a86fc46a None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:57.539535 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5a3a6-7192-4575-b444-de2c77bbd04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:57.540381 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5a3a6-7192-4575-b444-de2c77bbd04a None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:57.540725 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5a3a6-7192-4575-b444-de2c77bbd04a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:57.541017 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5a3a6-7192-4575-b444-de2c77bbd04a None admin] PATH_INFO: `/v3/groups/e476c135909a4d1b9e7efc70b73b8a6c` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:57.542873 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f5a3a6-7192-4575-b444-de2c77bbd04a None admin] RBAC: Authorizing `identity:get_group(group_id=e476c135909a4d1b9e7efc70b73b8a6c)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:57.544819 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f5a3a6-7192-4575-b444-de2c77bbd04a None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:57.547788 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 198/401] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Jun 8 11:52:57 2022] GET /identity/v3/groups/e476c135909a4d1b9e7efc70b73b8a6c => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:57.557847 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5a3a6-7192-4575-b444-de2c77bbd04a None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:57.628880 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:57.633257 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f38b07-e0de-44ca-9657-6b8c8e928b1c None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:57.647246 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:57.684233 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa40fc7-eb10-48a9-b5b6-7684895a87fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:57.685384 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa40fc7-eb10-48a9-b5b6-7684895a87fa None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:57.685850 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa40fc7-eb10-48a9-b5b6-7684895a87fa None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:57.686331 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa40fc7-eb10-48a9-b5b6-7684895a87fa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:57.699467 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa40fc7-eb10-48a9-b5b6-7684895a87fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:52:57.707909 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-cfa40fc7-eb10-48a9-b5b6-7684895a87fa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 11:52:57.707909 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:52:57.707909 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:52:57.707909 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:52:57.707909 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:52:57.707909 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:52:57.707909 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:52:57.707909 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:52:57.707909 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:52:57.707909 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:52:57.707909 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:52:57.707909 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:52:57.707909 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:52:57.707909 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:52:57.707909 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:52:57.707909 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:52:57.708912 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:52:57.708912 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:52:57.708912 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:52:57.708912 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:52:57.708912 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:52:57.708912 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:52:57.708912 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:52:57.708912 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:52:57.708912 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:52:57.708912 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:52:57.708912 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:52:57.708912 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:52:57.708912 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:52:57.708912 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:52:57.708912 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:52:57.708912 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:52:57.709705 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:52:57.709705 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:52:57.709705 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:52:57.709705 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:52:57.709705 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:52:57.709705 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:52:57.709705 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:52:57.709705 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:52:57.709705 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:52:57.709705 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:52:57.709705 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 11:52:57.709705 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:52:57.710300 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5a3a6-7192-4575-b444-de2c77bbd04a None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:57.712101 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 204/402] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Jun 8 11:52:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 11:52:57.713538 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa10cd-b18a-4a01-8782-6a6efc8cd0b8 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:57.713995 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa10cd-b18a-4a01-8782-6a6efc8cd0b8 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:57.714461 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa10cd-b18a-4a01-8782-6a6efc8cd0b8 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:57.715894 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 205/403] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:52:57.721778 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c8dc3-6538-4ffc-924f-ac45df426688 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:57.722257 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c8dc3-6538-4ffc-924f-ac45df426688 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:57.722682 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c8dc3-6538-4ffc-924f-ac45df426688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:57.746568 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-588c8dc3-6538-4ffc-924f-ac45df426688 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:57.748070 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1ba66-6923-4519-a59a-900e182e797b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:57.748294 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-588c8dc3-6538-4ffc-924f-ac45df426688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:57.749008 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1ba66-6923-4519-a59a-900e182e797b None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:57.749293 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1ba66-6923-4519-a59a-900e182e797b None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:57.749569 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1ba66-6923-4519-a59a-900e182e797b None admin] PATH_INFO: `/v3/projects/226a798c297d4f20b3999a94a6dbe9d5` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:57.750841 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa1ba66-6923-4519-a59a-900e182e797b None admin] RBAC: Authorizing `identity:get_project(project_id=226a798c297d4f20b3999a94a6dbe9d5)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:57.753417 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa1ba66-6923-4519-a59a-900e182e797b None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:57.754458 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 199/404] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Jun 8 11:52:57 2022] GET /identity/v3/projects/226a798c297d4f20b3999a94a6dbe9d5 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:52:57.755266 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1ba66-6923-4519-a59a-900e182e797b None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:57.851974 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 206/405] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:52:57.852914 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588c8dc3-6538-4ffc-924f-ac45df426688 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:57.888084 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1ba66-6923-4519-a59a-900e182e797b None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:57.904054 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:57.926542 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cb11a2-6a13-4310-a6fc-e4626eadec98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:57.927210 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb11a2-6a13-4310-a6fc-e4626eadec98 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:57.927504 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb11a2-6a13-4310-a6fc-e4626eadec98 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:57.927783 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb11a2-6a13-4310-a6fc-e4626eadec98 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:57.928692 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cb11a2-6a13-4310-a6fc-e4626eadec98 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:57.929012 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cb11a2-6a13-4310-a6fc-e4626eadec98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:57.930496 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cb11a2-6a13-4310-a6fc-e4626eadec98 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:57.939915 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 200/406] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Jun 8 11:52:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:57.941890 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cb11a2-6a13-4310-a6fc-e4626eadec98 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:57.968105 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:57.970627 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588c8dc3-6538-4ffc-924f-ac45df426688 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:58.011432 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e7d19-1eaa-4e34-b895-5306b2c55878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:58.012709 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e7d19-1eaa-4e34-b895-5306b2c55878 None admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:58.013200 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e7d19-1eaa-4e34-b895-5306b2c55878 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:58.013698 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e7d19-1eaa-4e34-b895-5306b2c55878 None admin] PATH_INFO: `/v3/projects/226a798c297d4f20b3999a94a6dbe9d5/groups/e476c135909a4d1b9e7efc70b73b8a6c/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:58.016115 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e7d19-1eaa-4e34-b895-5306b2c55878 None admin] RBAC: Authorizing `identity:create_grant(project_id=226a798c297d4f20b3999a94a6dbe9d5, group_id=e476c135909a4d1b9e7efc70b73b8a6c, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:58.017841 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e7d19-1eaa-4e34-b895-5306b2c55878 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:58.038691 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 207/407] 10.222.0.39 () {58 vars in 1442 bytes} [Wed Jun 8 11:52:57 2022] PUT /identity/v3/projects/226a798c297d4f20b3999a94a6dbe9d5/groups/e476c135909a4d1b9e7efc70b73b8a6c/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 11:52:58.040237 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e7d19-1eaa-4e34-b895-5306b2c55878 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:58.075047 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cb11a2-6a13-4310-a6fc-e4626eadec98 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:58.125413 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a2208a-07b6-4c26-af5e-721a5436ed0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:58.126626 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a2208a-07b6-4c26-af5e-721a5436ed0f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:58.127136 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a2208a-07b6-4c26-af5e-721a5436ed0f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:58.127778 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a2208a-07b6-4c26-af5e-721a5436ed0f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:58.143547 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a2208a-07b6-4c26-af5e-721a5436ed0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:52:58.153568 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-58a2208a-07b6-4c26-af5e-721a5436ed0f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:52:58.153568 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:52:58.153568 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:52:58.153568 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:52:58.153568 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:52:58.153568 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:52:58.153568 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:52:58.153568 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:52:58.153568 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:52:58.153568 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:52:58.153568 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:52:58.153568 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:52:58.153568 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:52:58.153568 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:52:58.153568 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:52:58.153568 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:52:58.154718 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:52:58.154718 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:52:58.154718 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:52:58.154718 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:52:58.154718 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:52:58.154718 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:52:58.154718 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:52:58.154718 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:52:58.154718 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:52:58.154718 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:52:58.154718 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:52:58.154718 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:52:58.154718 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:52:58.154718 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:52:58.154718 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:52:58.154718 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:52:58.155762 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:52:58.155762 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:52:58.155762 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:52:58.155762 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:52:58.155762 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:52:58.155762 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:52:58.155762 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:52:58.155762 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:52:58.155762 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:52:58.155762 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:52:58.155762 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:52:58.155762 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:52:58.158006 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 201/408] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Jun 8 11:52:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:52:58.163708 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a2208a-07b6-4c26-af5e-721a5436ed0f None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:58.192083 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e7d19-1eaa-4e34-b895-5306b2c55878 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:58.239098 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:58.268737 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b9e51-c1a7-481e-aab2-555b1b02d035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:58.269620 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b9e51-c1a7-481e-aab2-555b1b02d035 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:58.269902 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b9e51-c1a7-481e-aab2-555b1b02d035 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:58.270177 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b9e51-c1a7-481e-aab2-555b1b02d035 None admin] PATH_INFO: `/v3/groups/e476c135909a4d1b9e7efc70b73b8a6c` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:58.273135 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9b9e51-c1a7-481e-aab2-555b1b02d035 None admin] RBAC: Authorizing `identity:get_group(group_id=e476c135909a4d1b9e7efc70b73b8a6c)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:58.274777 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9b9e51-c1a7-481e-aab2-555b1b02d035 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:58.278417 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 208/409] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Jun 8 11:52:58 2022] GET /identity/v3/groups/e476c135909a4d1b9e7efc70b73b8a6c => generated 226 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:58.282636 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b9e51-c1a7-481e-aab2-555b1b02d035 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:58.322577 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:58.382140 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a2208a-07b6-4c26-af5e-721a5436ed0f None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:58.419936 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b9e51-c1a7-481e-aab2-555b1b02d035 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:58.427571 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84962e5-ef4b-4716-b393-00ecd315f294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:58.428423 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84962e5-ef4b-4716-b393-00ecd315f294 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:58.428805 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84962e5-ef4b-4716-b393-00ecd315f294 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:58.429724 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84962e5-ef4b-4716-b393-00ecd315f294 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:58.430601 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84962e5-ef4b-4716-b393-00ecd315f294 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:58.431013 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84962e5-ef4b-4716-b393-00ecd315f294 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:58.433157 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84962e5-ef4b-4716-b393-00ecd315f294 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:58.447189 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 202/410] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:52:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:52:58.453058 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84962e5-ef4b-4716-b393-00ecd315f294 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:58.476192 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2beb427-5881-4853-ba96-86e01da50ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:58.476192 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2beb427-5881-4853-ba96-86e01da50ace None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:58.476192 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2beb427-5881-4853-ba96-86e01da50ace None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:58.476192 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2beb427-5881-4853-ba96-86e01da50ace None admin] PATH_INFO: `/v3/projects/226a798c297d4f20b3999a94a6dbe9d5` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:58.476580 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2beb427-5881-4853-ba96-86e01da50ace None admin] RBAC: Authorizing `identity:get_project(project_id=226a798c297d4f20b3999a94a6dbe9d5)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:58.476580 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2beb427-5881-4853-ba96-86e01da50ace None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:58.476580 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 209/411] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Jun 8 11:52:58 2022] GET /identity/v3/projects/226a798c297d4f20b3999a94a6dbe9d5 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:58.483899 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2beb427-5881-4853-ba96-86e01da50ace None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:58.571976 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:58.578622 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84962e5-ef4b-4716-b393-00ecd315f294 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:58.617257 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729cd5ff-f42f-48e1-91fc-d64d7fc1831c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:58.618495 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729cd5ff-f42f-48e1-91fc-d64d7fc1831c None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:58.619013 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729cd5ff-f42f-48e1-91fc-d64d7fc1831c None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:58.619491 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729cd5ff-f42f-48e1-91fc-d64d7fc1831c None admin] PATH_INFO: `/v3/groups/928736aafaa042e688747ef80a0f707a` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:58.620988 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729cd5ff-f42f-48e1-91fc-d64d7fc1831c None admin] RBAC: Authorizing `identity:get_group(group_id=928736aafaa042e688747ef80a0f707a)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:58.622657 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729cd5ff-f42f-48e1-91fc-d64d7fc1831c None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:58.624836 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 203/412] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Jun 8 11:52:58 2022] GET /identity/v3/groups/928736aafaa042e688747ef80a0f707a => generated 229 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:52:58.630366 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729cd5ff-f42f-48e1-91fc-d64d7fc1831c None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:58.725708 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:58.738297 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2beb427-5881-4853-ba96-86e01da50ace None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:58.740312 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729cd5ff-f42f-48e1-91fc-d64d7fc1831c None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:58.776205 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824cb00b-b44f-4ca8-b1cd-7b1ab0b28836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:58.777638 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824cb00b-b44f-4ca8-b1cd-7b1ab0b28836 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:58.777926 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824cb00b-b44f-4ca8-b1cd-7b1ab0b28836 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:58.778206 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824cb00b-b44f-4ca8-b1cd-7b1ab0b28836 None admin] PATH_INFO: `/v3/projects/8f8cde9fd1b644e687e4b80b620e4c44` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:58.779426 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824cb00b-b44f-4ca8-b1cd-7b1ab0b28836 None admin] RBAC: Authorizing `identity:get_project(project_id=8f8cde9fd1b644e687e4b80b620e4c44)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:58.780952 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824cb00b-b44f-4ca8-b1cd-7b1ab0b28836 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:58.782752 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 204/413] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Jun 8 11:52:58 2022] GET /identity/v3/projects/8f8cde9fd1b644e687e4b80b620e4c44 => generated 344 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:52:58.788695 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824cb00b-b44f-4ca8-b1cd-7b1ab0b28836 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:58.829628 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:58.849161 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc676a99-3f7c-43d3-9cba-e78973c9d91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:58.850070 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc676a99-3f7c-43d3-9cba-e78973c9d91c None admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:58.850354 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc676a99-3f7c-43d3-9cba-e78973c9d91c None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:58.850630 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc676a99-3f7c-43d3-9cba-e78973c9d91c None admin] PATH_INFO: `/v3/projects/226a798c297d4f20b3999a94a6dbe9d5/groups/e476c135909a4d1b9e7efc70b73b8a6c/roles/b3d7a91b614d49a3bc751e1d330a67cf` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:58.856986 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc676a99-3f7c-43d3-9cba-e78973c9d91c None admin] RBAC: Authorizing `identity:create_grant(project_id=226a798c297d4f20b3999a94a6dbe9d5, group_id=e476c135909a4d1b9e7efc70b73b8a6c, role_id=b3d7a91b614d49a3bc751e1d330a67cf)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:58.858469 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc676a99-3f7c-43d3-9cba-e78973c9d91c None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:58.883785 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 210/414] 10.222.0.39 () {58 vars in 1442 bytes} [Wed Jun 8 11:52:58 2022] PUT /identity/v3/projects/226a798c297d4f20b3999a94a6dbe9d5/groups/e476c135909a4d1b9e7efc70b73b8a6c/roles/b3d7a91b614d49a3bc751e1d330a67cf => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 11:52:58.914350 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824cb00b-b44f-4ca8-b1cd-7b1ab0b28836 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:58.966447 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c6d6a0-6566-4618-b892-568f8b0575bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:58.967370 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6d6a0-6566-4618-b892-568f8b0575bc None admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:58.967658 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6d6a0-6566-4618-b892-568f8b0575bc None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:58.967936 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6d6a0-6566-4618-b892-568f8b0575bc None admin] PATH_INFO: `/v3/projects/8f8cde9fd1b644e687e4b80b620e4c44/groups/928736aafaa042e688747ef80a0f707a/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:58.970101 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c6d6a0-6566-4618-b892-568f8b0575bc None admin] RBAC: Authorizing `identity:create_grant(project_id=8f8cde9fd1b644e687e4b80b620e4c44, group_id=928736aafaa042e688747ef80a0f707a, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:58.971562 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c6d6a0-6566-4618-b892-568f8b0575bc None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:58.986996 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 205/415] 10.222.0.39 () {58 vars in 1442 bytes} [Wed Jun 8 11:52:58 2022] PUT /identity/v3/projects/8f8cde9fd1b644e687e4b80b620e4c44/groups/928736aafaa042e688747ef80a0f707a/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 11:52:59.228586 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c63a0-50b3-4d8e-8475-28c9aa7f55d4 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:59.229104 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c63a0-50b3-4d8e-8475-28c9aa7f55d4 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:59.229212 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c63a0-50b3-4d8e-8475-28c9aa7f55d4 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:59.231736 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 211/416] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:52:59.237428 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49448a6b-2c14-4954-9692-3ca7445e5598 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:59.237912 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49448a6b-2c14-4954-9692-3ca7445e5598 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:59.237912 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49448a6b-2c14-4954-9692-3ca7445e5598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:59.255950 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-49448a6b-2c14-4954-9692-3ca7445e5598 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:59.257260 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-49448a6b-2c14-4954-9692-3ca7445e5598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:59.331801 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 206/417] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:52:59.357023 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c63a0-50b3-4d8e-8475-28c9aa7f55d4 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:59.432154 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb002e84-4aff-4c14-a5a2-7c2399e185f4 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:59.432503 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb002e84-4aff-4c14-a5a2-7c2399e185f4 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:59.432743 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb002e84-4aff-4c14-a5a2-7c2399e185f4 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:59.434538 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 207/418] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:52:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:52:59.439835 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526afb52-5c58-4575-9a54-dfce9b6055fa None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:59.440127 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526afb52-5c58-4575-9a54-dfce9b6055fa None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:59.440438 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526afb52-5c58-4575-9a54-dfce9b6055fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:59.468321 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-526afb52-5c58-4575-9a54-dfce9b6055fa None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:52:59.469519 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-526afb52-5c58-4575-9a54-dfce9b6055fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:52:59.508783 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c63a0-50b3-4d8e-8475-28c9aa7f55d4 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:59.509652 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:59.591801 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c24dbf3-b137-4c6f-aff6-69173be07b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:59.593215 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24dbf3-b137-4c6f-aff6-69173be07b93 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:59.593720 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24dbf3-b137-4c6f-aff6-69173be07b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:59.594220 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24dbf3-b137-4c6f-aff6-69173be07b93 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:59.608216 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 208/419] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:52:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 11:52:59.629579 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526afb52-5c58-4575-9a54-dfce9b6055fa None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:59.636966 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c24dbf3-b137-4c6f-aff6-69173be07b93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:52:59.645174 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-6c24dbf3-b137-4c6f-aff6-69173be07b93 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 11:52:59.645174 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:52:59.645174 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:52:59.645174 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:52:59.645174 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:52:59.645174 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:52:59.645174 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:52:59.645174 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:52:59.645174 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:52:59.645174 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:52:59.645174 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:52:59.645174 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:52:59.645174 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:52:59.645174 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:52:59.645174 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:52:59.645174 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:52:59.646092 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:52:59.646092 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:52:59.646092 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:52:59.646092 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:52:59.646092 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:52:59.646092 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:52:59.646092 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:52:59.646092 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:52:59.646092 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:52:59.646092 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:52:59.646092 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:52:59.646092 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:52:59.646092 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:52:59.646092 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:52:59.646092 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:52:59.646092 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:52:59.647143 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:52:59.647143 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:52:59.647143 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:52:59.647143 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:52:59.647143 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:52:59.647143 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:52:59.647143 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:52:59.647143 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:52:59.647143 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:52:59.647143 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:52:59.647143 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 11:52:59.647143 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:52:59.647143 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 212/420] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Jun 8 11:52:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:52:59.652876 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c24dbf3-b137-4c6f-aff6-69173be07b93 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:59.694488 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:59.787527 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c24dbf3-b137-4c6f-aff6-69173be07b93 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:59.825078 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef5b06-e9c7-4f0b-9e63-1e272ca23cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:59.826120 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef5b06-e9c7-4f0b-9e63-1e272ca23cb0 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:59.826607 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef5b06-e9c7-4f0b-9e63-1e272ca23cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:59.827118 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef5b06-e9c7-4f0b-9e63-1e272ca23cb0 None admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:59.828069 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ef5b06-e9c7-4f0b-9e63-1e272ca23cb0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:52:59.828597 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ef5b06-e9c7-4f0b-9e63-1e272ca23cb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:52:59.830168 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ef5b06-e9c7-4f0b-9e63-1e272ca23cb0 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:52:59.839532 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 213/421] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Jun 8 11:52:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:52:59.844482 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef5b06-e9c7-4f0b-9e63-1e272ca23cb0 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:52:59.860455 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526afb52-5c58-4575-9a54-dfce9b6055fa None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:52:59.930485 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d1740-1aa9-4e85-b71e-fd7d5b6844d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:52:59.931727 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d1740-1aa9-4e85-b71e-fd7d5b6844d3 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:52:59.933575 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d1740-1aa9-4e85-b71e-fd7d5b6844d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:52:59.935606 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d1740-1aa9-4e85-b71e-fd7d5b6844d3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:52:59.969272 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30d1740-1aa9-4e85-b71e-fd7d5b6844d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:52:59.978269 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:52:59.982910 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-d30d1740-1aa9-4e85-b71e-fd7d5b6844d3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 11:52:59.982910 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:52:59.982910 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:52:59.982910 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:52:59.982910 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:52:59.982910 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:52:59.982910 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:52:59.982910 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:52:59.982910 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:52:59.982910 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:52:59.982910 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:52:59.982910 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:52:59.982910 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:52:59.982910 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:52:59.982910 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:52:59.982910 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:52:59.985621 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:52:59.985621 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:52:59.985621 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:52:59.985621 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:52:59.985621 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:52:59.985621 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:52:59.985621 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:52:59.985621 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:52:59.985621 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:52:59.985621 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:52:59.985621 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:52:59.985621 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:52:59.985621 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:52:59.985621 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:52:59.985621 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:52:59.985621 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:52:59.986493 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:52:59.986493 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:52:59.986493 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:52:59.986493 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:52:59.986493 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:52:59.986493 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:52:59.986493 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:52:59.986493 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:52:59.986493 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:52:59.986493 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:52:59.986493 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 11:52:59.986493 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:52:59.986493 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 209/422] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:52:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 11:52:59.993217 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d1740-1aa9-4e85-b71e-fd7d5b6844d3 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:00.008946 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef5b06-e9c7-4f0b-9e63-1e272ca23cb0 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:00.009850 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:00.048405 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d294fa9-0a2b-4d22-b9fa-932f0af68f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:00.049474 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d294fa9-0a2b-4d22-b9fa-932f0af68f19 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:00.050008 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d294fa9-0a2b-4d22-b9fa-932f0af68f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:00.050484 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d294fa9-0a2b-4d22-b9fa-932f0af68f19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:00.104191 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d1740-1aa9-4e85-b71e-fd7d5b6844d3 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:00.124458 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d294fa9-0a2b-4d22-b9fa-932f0af68f19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:00.126275 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d294fa9-0a2b-4d22-b9fa-932f0af68f19 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:00.141387 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a9c2d-4958-417e-958e-32e11815dda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:00.142082 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a9c2d-4958-417e-958e-32e11815dda4 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:00.142392 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a9c2d-4958-417e-958e-32e11815dda4 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:00.142641 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a9c2d-4958-417e-958e-32e11815dda4 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:00.143401 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a9c2d-4958-417e-958e-32e11815dda4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:00.143710 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a9c2d-4958-417e-958e-32e11815dda4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:00.145182 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a9c2d-4958-417e-958e-32e11815dda4 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:00.155178 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 210/423] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Jun 8 11:52:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:00.161113 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a9c2d-4958-417e-958e-32e11815dda4 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:00.212444 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:00.238957 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 214/424] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:52:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 08 11:53:00.246707 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d294fa9-0a2b-4d22-b9fa-932f0af68f19 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:00.329275 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:00.372802 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d294fa9-0a2b-4d22-b9fa-932f0af68f19 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:00.379469 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a9c2d-4958-417e-958e-32e11815dda4 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:00.417964 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b82669-af19-4bf8-9aad-b4a2af435c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:00.419238 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b82669-af19-4bf8-9aad-b4a2af435c75 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:00.419894 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b82669-af19-4bf8-9aad-b4a2af435c75 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:00.421634 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b82669-af19-4bf8-9aad-b4a2af435c75 None admin] PATH_INFO: `/v3/projects/8d69c66b67494123b35f0b9eeaf0f02b` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:00.423814 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b82669-af19-4bf8-9aad-b4a2af435c75 None admin] RBAC: Authorizing `identity:get_project(project_id=8d69c66b67494123b35f0b9eeaf0f02b)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:00.428629 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b82669-af19-4bf8-9aad-b4a2af435c75 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:00.430862 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 215/425] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Jun 8 11:53:00 2022] GET /identity/v3/projects/8d69c66b67494123b35f0b9eeaf0f02b => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:00.437708 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b82669-af19-4bf8-9aad-b4a2af435c75 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:00.461577 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce239d9-8ab5-4daf-90f8-7727a0ac099d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:00.462249 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce239d9-8ab5-4daf-90f8-7727a0ac099d None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:00.462528 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce239d9-8ab5-4daf-90f8-7727a0ac099d None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:00.462797 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce239d9-8ab5-4daf-90f8-7727a0ac099d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:00.521932 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:00.571692 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce239d9-8ab5-4daf-90f8-7727a0ac099d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:00.573203 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce239d9-8ab5-4daf-90f8-7727a0ac099d None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:00.618409 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b82669-af19-4bf8-9aad-b4a2af435c75 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:00.663566 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:00.687677 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 211/426] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:53:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 11:53:00.693282 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce239d9-8ab5-4daf-90f8-7727a0ac099d None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:00.740925 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73436674-20b5-467c-91ec-bfac8f3e0599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:00.742074 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73436674-20b5-467c-91ec-bfac8f3e0599 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:00.742502 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73436674-20b5-467c-91ec-bfac8f3e0599 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:00.742917 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73436674-20b5-467c-91ec-bfac8f3e0599 None admin] PATH_INFO: `/v3/groups/e476c135909a4d1b9e7efc70b73b8a6c` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:00.744801 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73436674-20b5-467c-91ec-bfac8f3e0599 None admin] RBAC: Authorizing `identity:get_group(group_id=e476c135909a4d1b9e7efc70b73b8a6c)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:00.746525 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73436674-20b5-467c-91ec-bfac8f3e0599 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:00.749543 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 216/427] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Jun 8 11:53:00 2022] GET /identity/v3/groups/e476c135909a4d1b9e7efc70b73b8a6c => generated 226 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:00.755358 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73436674-20b5-467c-91ec-bfac8f3e0599 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:00.863219 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73436674-20b5-467c-91ec-bfac8f3e0599 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:00.878599 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:00.900558 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f44e8-1a5f-40f1-ad7f-939473052262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:00.901673 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f44e8-1a5f-40f1-ad7f-939473052262 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:00.901876 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce239d9-8ab5-4daf-90f8-7727a0ac099d None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:00.902465 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f44e8-1a5f-40f1-ad7f-939473052262 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:00.902948 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f44e8-1a5f-40f1-ad7f-939473052262 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:00.904190 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997f44e8-1a5f-40f1-ad7f-939473052262 None admin] RBAC: Adding query filter params (group.id=e476c135909a4d1b9e7efc70b73b8a6c, role.id=b3d7a91b614d49a3bc751e1d330a67cf, scope.project.id=8d69c66b67494123b35f0b9eeaf0f02b) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:00.904714 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997f44e8-1a5f-40f1-ad7f-939473052262 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:00.906395 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997f44e8-1a5f-40f1-ad7f-939473052262 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:00.913061 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 217/428] 10.222.0.39 () {56 vars in 1376 bytes} [Wed Jun 8 11:53:00 2022] GET /identity/v3/role_assignments?group.id=e476c135909a4d1b9e7efc70b73b8a6c&scope.project.id=8d69c66b67494123b35f0b9eeaf0f02b&role.id=b3d7a91b614d49a3bc751e1d330a67cf => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:53:00.968568 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c6842-ec7a-4813-82ab-297b5fb4cf3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:00.969465 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c6842-ec7a-4813-82ab-297b5fb4cf3f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:00.969754 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c6842-ec7a-4813-82ab-297b5fb4cf3f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:00.970033 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c6842-ec7a-4813-82ab-297b5fb4cf3f None admin] PATH_INFO: `/v3/projects/8d69c66b67494123b35f0b9eeaf0f02b` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:00.977181 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5c6842-ec7a-4813-82ab-297b5fb4cf3f None admin] RBAC: Authorizing `identity:get_project(project_id=8d69c66b67494123b35f0b9eeaf0f02b)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:00.978693 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5c6842-ec7a-4813-82ab-297b5fb4cf3f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:00.980659 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 212/429] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Jun 8 11:53:00 2022] GET /identity/v3/projects/8d69c66b67494123b35f0b9eeaf0f02b => generated 298 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:00.986490 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f44e8-1a5f-40f1-ad7f-939473052262 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:01.002214 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cabb7ae-7aeb-40b6-a47b-b80e48ae9ee4 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:01.002523 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cabb7ae-7aeb-40b6-a47b-b80e48ae9ee4 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:01.002782 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cabb7ae-7aeb-40b6-a47b-b80e48ae9ee4 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:01.004440 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 213/430] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:53:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 11:53:01.015228 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b944a-b6f8-4597-a364-e94e35182ef7 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:01.015553 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b944a-b6f8-4597-a364-e94e35182ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:01.015802 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b944a-b6f8-4597-a364-e94e35182ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:01.045668 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-1c9b944a-b6f8-4597-a364-e94e35182ef7 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:53:01.046919 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-1c9b944a-b6f8-4597-a364-e94e35182ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:53:01.107650 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f44e8-1a5f-40f1-ad7f-939473052262 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:01.134055 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:01.149456 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d0bde-3533-45bd-8126-d740fa192b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:01.150664 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d0bde-3533-45bd-8126-d740fa192b13 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:01.151161 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d0bde-3533-45bd-8126-d740fa192b13 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:01.152423 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d0bde-3533-45bd-8126-d740fa192b13 None admin] PATH_INFO: `/v3/groups/e476c135909a4d1b9e7efc70b73b8a6c` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:01.154024 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787d0bde-3533-45bd-8126-d740fa192b13 None admin] RBAC: Authorizing `identity:get_group(group_id=e476c135909a4d1b9e7efc70b73b8a6c)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:01.155796 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787d0bde-3533-45bd-8126-d740fa192b13 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:01.158046 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 218/431] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Jun 8 11:53:00 2022] GET /identity/v3/groups/e476c135909a4d1b9e7efc70b73b8a6c => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:01.164315 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d0bde-3533-45bd-8126-d740fa192b13 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:01.180266 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 214/432] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:53:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 11:53:01.205359 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b944a-b6f8-4597-a364-e94e35182ef7 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:01.227126 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:01.297236 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d0bde-3533-45bd-8126-d740fa192b13 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:01.326717 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b944a-b6f8-4597-a364-e94e35182ef7 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:01.335831 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3429b0-f3c9-4f2f-9880-2edaf568894f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:01.336900 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3429b0-f3c9-4f2f-9880-2edaf568894f None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:01.337547 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3429b0-f3c9-4f2f-9880-2edaf568894f None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:01.338027 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3429b0-f3c9-4f2f-9880-2edaf568894f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:01.339153 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3429b0-f3c9-4f2f-9880-2edaf568894f None admin] RBAC: Adding query filter params (group.id=e476c135909a4d1b9e7efc70b73b8a6c, role.id=3682372ab3c145ba87e8baa5c520625f, scope.project.id=8d69c66b67494123b35f0b9eeaf0f02b) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:01.339722 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3429b0-f3c9-4f2f-9880-2edaf568894f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:01.341479 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3429b0-f3c9-4f2f-9880-2edaf568894f None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:01.349570 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 219/433] 10.222.0.39 () {56 vars in 1376 bytes} [Wed Jun 8 11:53:01 2022] GET /identity/v3/role_assignments?group.id=e476c135909a4d1b9e7efc70b73b8a6c&scope.project.id=8d69c66b67494123b35f0b9eeaf0f02b&role.id=3682372ab3c145ba87e8baa5c520625f => generated 611 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:01.377322 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856508e5-4cfa-451e-bce2-0b7968e3170b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:01.378162 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856508e5-4cfa-451e-bce2-0b7968e3170b None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:01.381024 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856508e5-4cfa-451e-bce2-0b7968e3170b None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:01.381024 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856508e5-4cfa-451e-bce2-0b7968e3170b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:01.394523 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856508e5-4cfa-451e-bce2-0b7968e3170b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:53:01.402622 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-856508e5-4cfa-451e-bce2-0b7968e3170b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 08 11:53:01.402622 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:01.402622 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:01.402622 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:01.402622 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:01.402622 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:01.402622 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:01.402622 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:01.402622 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:01.402622 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:01.402622 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:01.402622 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:01.402622 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:53:01.402622 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:53:01.402622 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:53:01.402622 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:53:01.403630 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:53:01.403630 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:53:01.403630 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:53:01.403630 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:53:01.403630 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:01.403630 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:01.403630 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:01.403630 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:01.403630 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:01.403630 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:01.403630 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:01.403630 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:01.403630 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:01.403630 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:01.403630 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:01.403630 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:01.404768 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:01.404768 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:01.404768 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:01.404768 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:01.404768 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:53:01.404768 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:53:01.404768 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:53:01.404768 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:53:01.404768 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:53:01.404768 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:53:01.404768 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 08 11:53:01.404768 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:01.404768 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 215/434] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:53:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 11:53:01.410020 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3429b0-f3c9-4f2f-9880-2edaf568894f None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:01.530052 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3429b0-f3c9-4f2f-9880-2edaf568894f None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:01.544670 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:01.576086 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3d835f-2f1f-4247-93f9-024bb1d16914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:01.577041 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d835f-2f1f-4247-93f9-024bb1d16914 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:01.577497 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d835f-2f1f-4247-93f9-024bb1d16914 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:01.577908 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d835f-2f1f-4247-93f9-024bb1d16914 None admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:01.578799 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3d835f-2f1f-4247-93f9-024bb1d16914 None admin] RBAC: Adding query filter params (name=member) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:01.579260 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3d835f-2f1f-4247-93f9-024bb1d16914 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:01.581637 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3d835f-2f1f-4247-93f9-024bb1d16914 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:01.591430 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 220/435] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Jun 8 11:53:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:53:01.597799 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856508e5-4cfa-451e-bce2-0b7968e3170b None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:01.640824 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:01.718081 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856508e5-4cfa-451e-bce2-0b7968e3170b None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:01.745866 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979f2c7-56c9-4bf1-9409-3031e0665061 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:01.746315 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979f2c7-56c9-4bf1-9409-3031e0665061 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:01.746608 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979f2c7-56c9-4bf1-9409-3031e0665061 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:01.748376 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 221/436] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:53:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:53:01.753761 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da562921-4240-4ed2-824d-e1e2cc6e3b9b None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:01.754050 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da562921-4240-4ed2-824d-e1e2cc6e3b9b None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:01.754331 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da562921-4240-4ed2-824d-e1e2cc6e3b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:01.754991 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400afc9a-af10-4b5a-855f-bd418b85af8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:01.755762 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400afc9a-af10-4b5a-855f-bd418b85af8e None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:01.756058 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400afc9a-af10-4b5a-855f-bd418b85af8e None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:01.756362 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400afc9a-af10-4b5a-855f-bd418b85af8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:01.781614 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-da562921-4240-4ed2-824d-e1e2cc6e3b9b None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:53:01.783148 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-da562921-4240-4ed2-824d-e1e2cc6e3b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:53:01.833650 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400afc9a-af10-4b5a-855f-bd418b85af8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:01.835130 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400afc9a-af10-4b5a-855f-bd418b85af8e None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:01.875728 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 222/437] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:53:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:53:01.877786 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:01.882008 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e8e44-5321-4d8f-a757-c6ef27bfb8da None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:01.882547 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e8e44-5321-4d8f-a757-c6ef27bfb8da None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:01.883031 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e8e44-5321-4d8f-a757-c6ef27bfb8da None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:01.885584 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 223/438] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:53:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:53:01.892729 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d0b96b-f967-4e7a-b7d2-73418d4e650f None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:01.892729 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d0b96b-f967-4e7a-b7d2-73418d4e650f None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:01.892959 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d0b96b-f967-4e7a-b7d2-73418d4e650f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:01.912309 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-76d0b96b-f967-4e7a-b7d2-73418d4e650f None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:53:01.913498 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-76d0b96b-f967-4e7a-b7d2-73418d4e650f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:53:01.966398 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 216/439] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:53:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 11:53:01.967365 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400afc9a-af10-4b5a-855f-bd418b85af8e None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:01.994091 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 224/440] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:53:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 11:53:01.995046 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d0b96b-f967-4e7a-b7d2-73418d4e650f None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:02.035678 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:02.090530 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400afc9a-af10-4b5a-855f-bd418b85af8e None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:02.111439 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d0b96b-f967-4e7a-b7d2-73418d4e650f None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:02.124700 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f5374-ef9b-4864-b91c-fd414158b2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:02.125510 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f5374-ef9b-4864-b91c-fd414158b2e7 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:02.125791 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f5374-ef9b-4864-b91c-fd414158b2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:02.126064 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f5374-ef9b-4864-b91c-fd414158b2e7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:02.127880 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:02.137656 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4f5374-ef9b-4864-b91c-fd414158b2e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:53:02.145259 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00638305-3dff-411f-ae20-eff0715b30e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:02.145667 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-5c4f5374-ef9b-4864-b91c-fd414158b2e7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 11:53:02.145667 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:02.145667 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:02.145667 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:02.145667 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:02.145667 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:02.145667 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:02.145667 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:02.145667 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:02.145667 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:02.145667 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:02.145667 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:02.145667 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:53:02.145667 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:53:02.145667 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:53:02.145667 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:53:02.146590 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:53:02.146590 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:53:02.146590 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:53:02.146590 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:53:02.146590 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:02.146590 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:02.146590 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:02.146590 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:02.146590 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:02.146590 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:02.146590 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:02.146590 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:02.146590 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:02.146590 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:02.146590 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:02.146590 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:02.147384 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:02.147384 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:02.147384 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:02.147384 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:02.147384 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:53:02.147384 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:53:02.147384 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:53:02.147384 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:53:02.147384 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:53:02.147384 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:53:02.147384 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 11:53:02.147384 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:02.147970 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00638305-3dff-411f-ae20-eff0715b30e2 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:02.147970 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00638305-3dff-411f-ae20-eff0715b30e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:02.147970 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00638305-3dff-411f-ae20-eff0715b30e2 None admin] PATH_INFO: `/v3/projects/226a798c297d4f20b3999a94a6dbe9d5` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:02.148146 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 217/441] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Jun 8 11:53:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:02.148146 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f5374-ef9b-4864-b91c-fd414158b2e7 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:02.152860 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00638305-3dff-411f-ae20-eff0715b30e2 None admin] RBAC: Authorizing `identity:get_project(project_id=226a798c297d4f20b3999a94a6dbe9d5)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:02.154343 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00638305-3dff-411f-ae20-eff0715b30e2 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:02.156064 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 225/442] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Jun 8 11:53:01 2022] GET /identity/v3/projects/226a798c297d4f20b3999a94a6dbe9d5 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:02.156862 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00638305-3dff-411f-ae20-eff0715b30e2 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:02.251166 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f5374-ef9b-4864-b91c-fd414158b2e7 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:02.254839 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:02.258015 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00638305-3dff-411f-ae20-eff0715b30e2 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:02.284563 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be0b70-c96a-4051-9a82-cf74426d9fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:02.285350 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be0b70-c96a-4051-9a82-cf74426d9fa6 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:02.285634 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be0b70-c96a-4051-9a82-cf74426d9fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:02.285910 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be0b70-c96a-4051-9a82-cf74426d9fa6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:02.291738 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29745fa-7685-4cc3-85b7-e7a3311dd895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:02.292563 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29745fa-7685-4cc3-85b7-e7a3311dd895 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:02.292849 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29745fa-7685-4cc3-85b7-e7a3311dd895 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:02.293131 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29745fa-7685-4cc3-85b7-e7a3311dd895 None admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:02.293880 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29745fa-7685-4cc3-85b7-e7a3311dd895 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:02.294187 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29745fa-7685-4cc3-85b7-e7a3311dd895 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:02.295564 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29745fa-7685-4cc3-85b7-e7a3311dd895 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:02.295857 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4be0b70-c96a-4051-9a82-cf74426d9fa6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:53:02.303311 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 226/443] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Jun 8 11:53:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:02.303752 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-f4be0b70-c96a-4051-9a82-cf74426d9fa6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:53:02.303752 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:02.303752 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:02.303752 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:02.303752 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:02.303752 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:02.303752 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:02.303752 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:02.303752 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:02.303752 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:02.303752 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:02.303752 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:02.303752 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:53:02.303752 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:53:02.303752 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:53:02.303752 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:53:02.304612 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:53:02.304612 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:53:02.304612 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:53:02.304612 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:53:02.304612 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:02.304612 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:02.304612 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:02.304612 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:02.304612 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:02.304612 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:02.304612 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:02.304612 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:02.304612 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:02.304612 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:02.304612 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:02.304612 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:02.305391 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:02.305391 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:02.305391 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:02.305391 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:02.305391 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:53:02.305391 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:53:02.305391 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:53:02.305391 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:53:02.305391 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:53:02.305391 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:53:02.305391 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:53:02.305391 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:02.305991 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29745fa-7685-4cc3-85b7-e7a3311dd895 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:02.306057 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 218/444] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Jun 8 11:53:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:02.309052 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be0b70-c96a-4051-9a82-cf74426d9fa6 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:02.365590 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:02.410857 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be0b70-c96a-4051-9a82-cf74426d9fa6 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:02.411490 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29745fa-7685-4cc3-85b7-e7a3311dd895 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:02.443662 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c93dac-25f7-4771-9a4f-28618433133a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:02.444338 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c93dac-25f7-4771-9a4f-28618433133a None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:02.444634 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c93dac-25f7-4771-9a4f-28618433133a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:02.444913 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c93dac-25f7-4771-9a4f-28618433133a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:02.445396 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e765b-f675-49bf-99b7-7bf97bdcc536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:02.446484 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e765b-f675-49bf-99b7-7bf97bdcc536 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:02.446777 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e765b-f675-49bf-99b7-7bf97bdcc536 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:02.447059 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e765b-f675-49bf-99b7-7bf97bdcc536 None admin] PATH_INFO: `/v3/groups/e476c135909a4d1b9e7efc70b73b8a6c` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:02.448282 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0e765b-f675-49bf-99b7-7bf97bdcc536 None admin] RBAC: Authorizing `identity:get_group(group_id=e476c135909a4d1b9e7efc70b73b8a6c)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:02.450343 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0e765b-f675-49bf-99b7-7bf97bdcc536 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:02.451961 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 227/445] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Jun 8 11:53:02 2022] GET /identity/v3/groups/e476c135909a4d1b9e7efc70b73b8a6c => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:02.456800 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e765b-f675-49bf-99b7-7bf97bdcc536 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:02.484627 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:02.512582 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c93dac-25f7-4771-9a4f-28618433133a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:02.513988 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c93dac-25f7-4771-9a4f-28618433133a None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:02.554173 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e765b-f675-49bf-99b7-7bf97bdcc536 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:02.565981 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:02.592356 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862bffc0-e03d-47cd-b9f1-9dc6ff766564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:02.593034 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862bffc0-e03d-47cd-b9f1-9dc6ff766564 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:02.593321 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862bffc0-e03d-47cd-b9f1-9dc6ff766564 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:02.593604 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862bffc0-e03d-47cd-b9f1-9dc6ff766564 None admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:02.594338 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862bffc0-e03d-47cd-b9f1-9dc6ff766564 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:02.594646 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862bffc0-e03d-47cd-b9f1-9dc6ff766564 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:02.596028 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862bffc0-e03d-47cd-b9f1-9dc6ff766564 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:02.604518 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 228/446] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:53:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:02.605828 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862bffc0-e03d-47cd-b9f1-9dc6ff766564 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:02.618855 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 219/447] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:53:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 11:53:02.619555 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c93dac-25f7-4771-9a4f-28618433133a None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:02.701529 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:02.710258 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862bffc0-e03d-47cd-b9f1-9dc6ff766564 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:02.716482 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c93dac-25f7-4771-9a4f-28618433133a None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:02.744766 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf64c0-9a23-467c-afc5-9539f4a908f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:02.745422 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf64c0-9a23-467c-afc5-9539f4a908f1 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:02.745708 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf64c0-9a23-467c-afc5-9539f4a908f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:02.745983 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf64c0-9a23-467c-afc5-9539f4a908f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:02.746815 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf64c0-9a23-467c-afc5-9539f4a908f1 None admin] RBAC: Adding query filter params (group.id=e476c135909a4d1b9e7efc70b73b8a6c, role.id=3682372ab3c145ba87e8baa5c520625f, scope.project.id=226a798c297d4f20b3999a94a6dbe9d5) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:02.747130 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf64c0-9a23-467c-afc5-9539f4a908f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:02.748588 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf64c0-9a23-467c-afc5-9539f4a908f1 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:02.751066 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597438a2-bc68-4a47-af48-3007f039dfa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:02.751713 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597438a2-bc68-4a47-af48-3007f039dfa5 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:02.751997 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597438a2-bc68-4a47-af48-3007f039dfa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:02.752305 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597438a2-bc68-4a47-af48-3007f039dfa5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:02.754625 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 229/448] 10.222.0.39 () {56 vars in 1376 bytes} [Wed Jun 8 11:53:02 2022] GET /identity/v3/role_assignments?group.id=e476c135909a4d1b9e7efc70b73b8a6c&scope.project.id=226a798c297d4f20b3999a94a6dbe9d5&role.id=3682372ab3c145ba87e8baa5c520625f => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:02.755318 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf64c0-9a23-467c-afc5-9539f4a908f1 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:02.781553 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:02.835568 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597438a2-bc68-4a47-af48-3007f039dfa5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:02.837136 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597438a2-bc68-4a47-af48-3007f039dfa5 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:02.874720 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf64c0-9a23-467c-afc5-9539f4a908f1 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:02.910726 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb4b6b-2b19-459a-97cf-41ba9414d8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:02.911614 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb4b6b-2b19-459a-97cf-41ba9414d8c4 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:02.911902 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb4b6b-2b19-459a-97cf-41ba9414d8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:02.912205 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb4b6b-2b19-459a-97cf-41ba9414d8c4 None admin] PATH_INFO: `/v3/projects/226a798c297d4f20b3999a94a6dbe9d5` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:02.913579 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb4b6b-2b19-459a-97cf-41ba9414d8c4 None admin] RBAC: Authorizing `identity:get_project(project_id=226a798c297d4f20b3999a94a6dbe9d5)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:02.915211 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb4b6b-2b19-459a-97cf-41ba9414d8c4 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:02.921939 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 230/449] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Jun 8 11:53:02 2022] GET /identity/v3/projects/226a798c297d4f20b3999a94a6dbe9d5 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:02.923064 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb4b6b-2b19-459a-97cf-41ba9414d8c4 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:02.951190 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 220/450] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:53:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 11:53:02.952788 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:02.956747 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597438a2-bc68-4a47-af48-3007f039dfa5 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:03.021532 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:03.051275 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb4b6b-2b19-459a-97cf-41ba9414d8c4 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:03.077352 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597438a2-bc68-4a47-af48-3007f039dfa5 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:03.089285 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e617c3-e908-4e85-a5d8-8ba49d5f87d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:03.090844 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e617c3-e908-4e85-a5d8-8ba49d5f87d4 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:03.090844 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e617c3-e908-4e85-a5d8-8ba49d5f87d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:03.090844 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e617c3-e908-4e85-a5d8-8ba49d5f87d4 None admin] PATH_INFO: `/v3/groups/e476c135909a4d1b9e7efc70b73b8a6c` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:03.091895 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e617c3-e908-4e85-a5d8-8ba49d5f87d4 None admin] RBAC: Authorizing `identity:get_group(group_id=e476c135909a4d1b9e7efc70b73b8a6c)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:03.093384 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e617c3-e908-4e85-a5d8-8ba49d5f87d4 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:03.095194 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 231/451] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Jun 8 11:53:02 2022] GET /identity/v3/groups/e476c135909a4d1b9e7efc70b73b8a6c => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:03.101086 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e617c3-e908-4e85-a5d8-8ba49d5f87d4 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:03.121333 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb8fa0-a76a-4d71-9778-038ff7aae11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:03.122219 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb8fa0-a76a-4d71-9778-038ff7aae11b None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:03.122505 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb8fa0-a76a-4d71-9778-038ff7aae11b None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:03.122782 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb8fa0-a76a-4d71-9778-038ff7aae11b None admin] PATH_INFO: `/v3/projects/8f8cde9fd1b644e687e4b80b620e4c44` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:03.125784 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bb8fa0-a76a-4d71-9778-038ff7aae11b None admin] RBAC: Authorizing `identity:get_project(project_id=8f8cde9fd1b644e687e4b80b620e4c44)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:03.125784 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bb8fa0-a76a-4d71-9778-038ff7aae11b None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:03.127182 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 221/452] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Jun 8 11:53:02 2022] GET /identity/v3/projects/8f8cde9fd1b644e687e4b80b620e4c44 => generated 344 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:53:03.133154 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb8fa0-a76a-4d71-9778-038ff7aae11b None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:03.201066 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:03.210926 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e617c3-e908-4e85-a5d8-8ba49d5f87d4 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:03.241166 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb8fa0-a76a-4d71-9778-038ff7aae11b None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:03.244630 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ceda50-96b3-4f39-9648-970b047c71c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:03.245904 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ceda50-96b3-4f39-9648-970b047c71c7 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:03.246236 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ceda50-96b3-4f39-9648-970b047c71c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:03.246551 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ceda50-96b3-4f39-9648-970b047c71c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:03.247392 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ceda50-96b3-4f39-9648-970b047c71c7 None admin] RBAC: Adding query filter params (group.id=e476c135909a4d1b9e7efc70b73b8a6c, role.id=b3d7a91b614d49a3bc751e1d330a67cf, scope.project.id=226a798c297d4f20b3999a94a6dbe9d5) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:03.247709 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ceda50-96b3-4f39-9648-970b047c71c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:03.249168 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ceda50-96b3-4f39-9648-970b047c71c7 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:03.255040 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 232/453] 10.222.0.39 () {56 vars in 1376 bytes} [Wed Jun 8 11:53:03 2022] GET /identity/v3/role_assignments?group.id=e476c135909a4d1b9e7efc70b73b8a6c&scope.project.id=226a798c297d4f20b3999a94a6dbe9d5&role.id=b3d7a91b614d49a3bc751e1d330a67cf => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:53:03.264607 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:03.277786 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5965d7bf-e079-44c9-a0f5-ddc697d9d50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:03.278666 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965d7bf-e079-44c9-a0f5-ddc697d9d50d None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:03.278948 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965d7bf-e079-44c9-a0f5-ddc697d9d50d None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:03.279223 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965d7bf-e079-44c9-a0f5-ddc697d9d50d None admin] PATH_INFO: `/v3/groups/928736aafaa042e688747ef80a0f707a` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:03.280501 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5965d7bf-e079-44c9-a0f5-ddc697d9d50d None admin] RBAC: Authorizing `identity:get_group(group_id=928736aafaa042e688747ef80a0f707a)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:03.281981 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5965d7bf-e079-44c9-a0f5-ddc697d9d50d None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:03.283673 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 222/454] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Jun 8 11:53:03 2022] GET /identity/v3/groups/928736aafaa042e688747ef80a0f707a => generated 229 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:53:03.289713 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ceda50-96b3-4f39-9648-970b047c71c7 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:03.396373 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ceda50-96b3-4f39-9648-970b047c71c7 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:03.432034 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc2bec6-ae1e-48b4-8ad0-f867338fd720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:03.432785 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2bec6-ae1e-48b4-8ad0-f867338fd720 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:03.433067 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2bec6-ae1e-48b4-8ad0-f867338fd720 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:03.433349 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2bec6-ae1e-48b4-8ad0-f867338fd720 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:03.434204 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc2bec6-ae1e-48b4-8ad0-f867338fd720 None admin] RBAC: Adding query filter params (group.id=928736aafaa042e688747ef80a0f707a, role.id=028d4429a4554bbb88b3aec9f6a9d937, scope.project.id=8f8cde9fd1b644e687e4b80b620e4c44) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:03.434522 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc2bec6-ae1e-48b4-8ad0-f867338fd720 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:03.435973 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc2bec6-ae1e-48b4-8ad0-f867338fd720 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:03.442744 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 233/455] 10.222.0.39 () {56 vars in 1376 bytes} [Wed Jun 8 11:53:03 2022] GET /identity/v3/role_assignments?group.id=928736aafaa042e688747ef80a0f707a&scope.project.id=8f8cde9fd1b644e687e4b80b620e4c44&role.id=028d4429a4554bbb88b3aec9f6a9d937 => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:06.132455 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9220ce-22e0-4cdb-950d-e74b59d7dd43 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:06.132982 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9220ce-22e0-4cdb-950d-e74b59d7dd43 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:06.132982 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9220ce-22e0-4cdb-950d-e74b59d7dd43 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:06.134597 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 223/456] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:53:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:53:06.140998 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e742c8-a585-4236-87d1-e068516a4000 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:06.141811 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e742c8-a585-4236-87d1-e068516a4000 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:06.142305 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e742c8-a585-4236-87d1-e068516a4000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:06.169282 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-77e742c8-a585-4236-87d1-e068516a4000 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:53:06.170809 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-77e742c8-a585-4236-87d1-e068516a4000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:53:06.191839 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:06.241919 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482bb08-20c9-4e89-ba14-6ce09fc023c6 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:06.242269 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482bb08-20c9-4e89-ba14-6ce09fc023c6 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:06.242465 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482bb08-20c9-4e89-ba14-6ce09fc023c6 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:06.243813 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 224/457] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:53:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 11:53:06.251003 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d99e5f-5410-4edc-b4b8-114265385140 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:06.251285 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d99e5f-5410-4edc-b4b8-114265385140 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:06.251562 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d99e5f-5410-4edc-b4b8-114265385140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:06.272951 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-51d99e5f-5410-4edc-b4b8-114265385140 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:53:06.280272 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 234/458] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:53:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 11:53:06.281386 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-51d99e5f-5410-4edc-b4b8-114265385140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:53:06.346641 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e742c8-a585-4236-87d1-e068516a4000 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:06.376608 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 225/459] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:53:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:53:06.405811 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d99e5f-5410-4edc-b4b8-114265385140 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:06.524393 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e742c8-a585-4236-87d1-e068516a4000 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:06.562057 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23cc499-2fd7-484d-b9f6-dd1c072e8cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:06.563240 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23cc499-2fd7-484d-b9f6-dd1c072e8cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:06.563757 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23cc499-2fd7-484d-b9f6-dd1c072e8cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:06.564281 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23cc499-2fd7-484d-b9f6-dd1c072e8cc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:06.572275 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d99e5f-5410-4edc-b4b8-114265385140 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:06.576691 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23cc499-2fd7-484d-b9f6-dd1c072e8cc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:06.578401 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23cc499-2fd7-484d-b9f6-dd1c072e8cc3 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:06.605392 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-e23cc499-2fd7-484d-b9f6-dd1c072e8cc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:06.605392 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:06.605392 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:06.605392 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:06.605392 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:06.605392 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:06.605392 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:06.605392 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:06.605392 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:06.605392 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:06.605392 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:06.605392 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:06.605392 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:53:06.605392 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:53:06.605392 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:53:06.606386 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:53:06.606386 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:06.606386 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:06.606386 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:06.606386 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:06.606386 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:06.606386 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:06.606386 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:06.606386 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:06.606386 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:06.606386 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:06.606386 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:06.606386 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:06.606386 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:06.606386 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:06.606386 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:06.606386 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:06.607228 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:53:06.607228 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:53:06.607228 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:06.607228 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:06.612214 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 235/460] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:53:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 11:53:06.614696 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d92d57-c21b-4eec-9c81-16969b599d25 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:06.615259 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d92d57-c21b-4eec-9c81-16969b599d25 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:06.615695 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d92d57-c21b-4eec-9c81-16969b599d25 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:06.616676 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:06.617769 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 236/461] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:53:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:53:06.618827 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d92d57-c21b-4eec-9c81-16969b599d25 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:06.624840 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:06.646130 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc11783-e436-44f3-b4a7-fc76ee3e7a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:06.647315 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc11783-e436-44f3-b4a7-fc76ee3e7a5a None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:06.647599 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc11783-e436-44f3-b4a7-fc76ee3e7a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:06.647872 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc11783-e436-44f3-b4a7-fc76ee3e7a5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:06.663009 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc11783-e436-44f3-b4a7-fc76ee3e7a5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:06.664487 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc11783-e436-44f3-b4a7-fc76ee3e7a5a None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:06.689689 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-ffc11783-e436-44f3-b4a7-fc76ee3e7a5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:06.689689 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:06.689689 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:06.689689 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:06.689689 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:06.689689 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:06.689689 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:06.689689 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:06.689689 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:06.689689 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:06.689689 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:06.689689 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:06.689689 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:53:06.689689 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:53:06.689689 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:53:06.690763 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:53:06.690763 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:06.690763 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:06.690763 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:06.690763 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:06.690763 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:06.690763 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:06.690763 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:06.690763 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:06.690763 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:06.690763 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:06.690763 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:06.690763 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:06.690763 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:06.690763 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:06.690763 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:06.690763 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:06.691723 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:53:06.691723 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:53:06.691723 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:06.691723 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:06.691723 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 226/462] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:53:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 11:53:06.696352 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96b4dd-6b37-4b0f-abb3-e767aa205863 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:06.696352 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96b4dd-6b37-4b0f-abb3-e767aa205863 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:06.696352 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96b4dd-6b37-4b0f-abb3-e767aa205863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:06.715505 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-ed96b4dd-6b37-4b0f-abb3-e767aa205863 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:53:06.716731 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ed96b4dd-6b37-4b0f-abb3-e767aa205863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:53:06.747173 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d92d57-c21b-4eec-9c81-16969b599d25 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:06.783194 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a48509-fc8c-4245-81df-90a283f37cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:06.784235 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a48509-fc8c-4245-81df-90a283f37cc4 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:06.784728 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a48509-fc8c-4245-81df-90a283f37cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:06.785210 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a48509-fc8c-4245-81df-90a283f37cc4 None admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:06.786163 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a48509-fc8c-4245-81df-90a283f37cc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:06.786676 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a48509-fc8c-4245-81df-90a283f37cc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:06.788317 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a48509-fc8c-4245-81df-90a283f37cc4 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:06.800309 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 227/463] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:53:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:53:06.801251 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed96b4dd-6b37-4b0f-abb3-e767aa205863 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:06.802182 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 237/464] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:53:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:06.807774 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a48509-fc8c-4245-81df-90a283f37cc4 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:06.884492 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:06.924036 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed96b4dd-6b37-4b0f-abb3-e767aa205863 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:06.925797 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:06.926315 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a48509-fc8c-4245-81df-90a283f37cc4 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:06.962220 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dcb634-0c80-4a60-8d7f-e394ea0a7bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:06.963124 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a87c2-2c74-45de-90b4-7671dbfc4df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:06.963367 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dcb634-0c80-4a60-8d7f-e394ea0a7bd1 None admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:06.964344 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a87c2-2c74-45de-90b4-7671dbfc4df2 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:06.964704 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dcb634-0c80-4a60-8d7f-e394ea0a7bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:06.964844 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a87c2-2c74-45de-90b4-7671dbfc4df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:06.965263 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a87c2-2c74-45de-90b4-7671dbfc4df2 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:06.965501 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dcb634-0c80-4a60-8d7f-e394ea0a7bd1 None admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:06.965983 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a87c2-2c74-45de-90b4-7671dbfc4df2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:06.966288 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a87c2-2c74-45de-90b4-7671dbfc4df2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:06.966660 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dcb634-0c80-4a60-8d7f-e394ea0a7bd1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:06.967664 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a87c2-2c74-45de-90b4-7671dbfc4df2 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:06.968414 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dcb634-0c80-4a60-8d7f-e394ea0a7bd1 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:06.990818 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 228/465] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:53:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:06.990818 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a87c2-2c74-45de-90b4-7671dbfc4df2 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:06.993482 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 238/466] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Jun 8 11:53:06 2022] POST /identity/v3/users => generated 246 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 11:53:06.994382 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e2a5b-6116-4817-be5a-9b6c8146bf23 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:06.994656 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e2a5b-6116-4817-be5a-9b6c8146bf23 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:06.995472 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e2a5b-6116-4817-be5a-9b6c8146bf23 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:06.996876 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 239/467] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:53:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:53:07.001099 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e2a5b-6116-4817-be5a-9b6c8146bf23 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:07.120500 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a87c2-2c74-45de-90b4-7671dbfc4df2 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:07.125841 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e2a5b-6116-4817-be5a-9b6c8146bf23 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:07.144951 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:07.163217 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b36d17-6423-43c8-87ef-73479aa42e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:07.165087 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b36d17-6423-43c8-87ef-73479aa42e43 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:07.165657 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b36d17-6423-43c8-87ef-73479aa42e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:07.166230 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b36d17-6423-43c8-87ef-73479aa42e43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:07.167255 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe53637-e19b-4448-883a-7412ca5d8278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:07.167976 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe53637-e19b-4448-883a-7412ca5d8278 None admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:07.168247 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe53637-e19b-4448-883a-7412ca5d8278 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:07.168526 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe53637-e19b-4448-883a-7412ca5d8278 None admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:07.169248 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe53637-e19b-4448-883a-7412ca5d8278 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:07.170710 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe53637-e19b-4448-883a-7412ca5d8278 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:07.180615 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b36d17-6423-43c8-87ef-73479aa42e43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:07.183539 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b36d17-6423-43c8-87ef-73479aa42e43 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:07.196214 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 240/468] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Jun 8 11:53:06 2022] POST /identity/v3/users => generated 248 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 11:53:07.201694 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10efd43d-507b-4ebf-a535-bbc282543ee3 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:07.201694 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10efd43d-507b-4ebf-a535-bbc282543ee3 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:07.201694 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10efd43d-507b-4ebf-a535-bbc282543ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:07.210714 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-08b36d17-6423-43c8-87ef-73479aa42e43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:07.210714 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:07.210714 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:07.210714 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:07.210714 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:07.210714 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:07.210714 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:07.210714 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:07.210714 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:07.210714 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:07.210714 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:07.210714 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:07.210714 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:53:07.210714 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:53:07.210714 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:53:07.211741 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:53:07.211741 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:07.211741 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:07.211741 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:07.211741 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:07.211741 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:07.211741 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:07.211741 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:07.211741 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:07.211741 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:07.211741 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:07.211741 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:07.211741 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:07.211741 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:07.211741 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:07.211741 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:07.211741 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:07.212631 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:53:07.212631 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:53:07.212631 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:07.212631 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:07.214107 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 229/469] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:53:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:07.219577 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-10efd43d-507b-4ebf-a535-bbc282543ee3 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:53:07.220870 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-10efd43d-507b-4ebf-a535-bbc282543ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:53:07.221234 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b36d17-6423-43c8-87ef-73479aa42e43 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:07.245594 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:07.303875 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 241/470] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:53:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:53:07.330379 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10efd43d-507b-4ebf-a535-bbc282543ee3 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:07.351230 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b36d17-6423-43c8-87ef-73479aa42e43 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:07.393876 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb5b25-ccd4-4f06-b4f6-df2adfc41ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:07.394975 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb5b25-ccd4-4f06-b4f6-df2adfc41ca0 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:07.395466 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb5b25-ccd4-4f06-b4f6-df2adfc41ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:07.395949 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb5b25-ccd4-4f06-b4f6-df2adfc41ca0 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:07.397016 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcb5b25-ccd4-4f06-b4f6-df2adfc41ca0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:07.397569 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcb5b25-ccd4-4f06-b4f6-df2adfc41ca0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:07.399281 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcb5b25-ccd4-4f06-b4f6-df2adfc41ca0 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:07.412954 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 230/471] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:53:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:53:07.419412 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb5b25-ccd4-4f06-b4f6-df2adfc41ca0 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:07.453389 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10efd43d-507b-4ebf-a535-bbc282543ee3 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:07.456575 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:07.505202 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a6598-96e5-4e11-8066-276b59010503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:07.506030 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a6598-96e5-4e11-8066-276b59010503 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:07.506310 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a6598-96e5-4e11-8066-276b59010503 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:07.506583 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a6598-96e5-4e11-8066-276b59010503 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:07.520911 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2a6598-96e5-4e11-8066-276b59010503 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:07.522396 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2a6598-96e5-4e11-8066-276b59010503 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:07.544019 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-da2a6598-96e5-4e11-8066-276b59010503 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:07.544019 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:07.544019 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:07.544019 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:07.544019 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:07.544019 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:07.544019 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:07.544019 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:07.544019 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:07.544019 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:07.544019 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:07.544019 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:07.544019 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:53:07.544019 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:53:07.544019 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:53:07.545097 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:53:07.545097 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:07.545097 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:07.545097 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:07.545097 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:07.545097 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:07.545097 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:07.545097 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:07.545097 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:07.545097 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:07.545097 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:07.545097 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:07.545097 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:07.545097 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:07.545097 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:07.545097 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:07.545097 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:07.545921 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:53:07.545921 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:53:07.545921 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:07.545921 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:07.545921 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 242/472] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:53:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:07.553199 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a6598-96e5-4e11-8066-276b59010503 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:07.633251 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:07.662152 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb5b25-ccd4-4f06-b4f6-df2adfc41ca0 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:07.674815 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a6598-96e5-4e11-8066-276b59010503 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:07.698589 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe1e53-c2b4-4916-9e40-6ef049e51fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:07.699525 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe1e53-c2b4-4916-9e40-6ef049e51fa4 None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:07.699982 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe1e53-c2b4-4916-9e40-6ef049e51fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:07.700438 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe1e53-c2b4-4916-9e40-6ef049e51fa4 None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:07.701310 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fe1e53-c2b4-4916-9e40-6ef049e51fa4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:07.702934 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fe1e53-c2b4-4916-9e40-6ef049e51fa4 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:07.714946 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1059965b-e0b1-40bb-a369-be39de470956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:07.716000 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059965b-e0b1-40bb-a369-be39de470956 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:07.716328 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059965b-e0b1-40bb-a369-be39de470956 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:07.716642 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059965b-e0b1-40bb-a369-be39de470956 None admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:07.718423 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1059965b-e0b1-40bb-a369-be39de470956 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:07.718681 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1059965b-e0b1-40bb-a369-be39de470956 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:07.720220 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1059965b-e0b1-40bb-a369-be39de470956 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:07.727276 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 231/473] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Jun 8 11:53:07 2022] POST /identity/v3/users => generated 248 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 11:53:07.734173 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 243/474] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:53:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:07.739723 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe1e53-c2b4-4916-9e40-6ef049e51fa4 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:07.853963 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb90c4-9d01-4dc3-ae04-92b5ccaa2074 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:07.854457 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb90c4-9d01-4dc3-ae04-92b5ccaa2074 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:07.854841 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb90c4-9d01-4dc3-ae04-92b5ccaa2074 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:07.856738 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 244/475] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:53:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:53:07.860754 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe1e53-c2b4-4916-9e40-6ef049e51fa4 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:07.867422 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9a7c1-8156-4142-acf7-79a13e63f5d4 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:07.867422 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9a7c1-8156-4142-acf7-79a13e63f5d4 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:07.867422 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9a7c1-8156-4142-acf7-79a13e63f5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:07.900896 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-d0b9a7c1-8156-4142-acf7-79a13e63f5d4 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:53:07.903244 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-d0b9a7c1-8156-4142-acf7-79a13e63f5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:53:07.917909 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:07.919088 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:07.938502 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ebe3b0-86de-4d19-b1d3-67f2e5d455c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:07.940891 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebe3b0-86de-4d19-b1d3-67f2e5d455c2 None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:07.942156 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebe3b0-86de-4d19-b1d3-67f2e5d455c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:07.942788 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebe3b0-86de-4d19-b1d3-67f2e5d455c2 None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:07.944665 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ebe3b0-86de-4d19-b1d3-67f2e5d455c2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:07.947502 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ebe3b0-86de-4d19-b1d3-67f2e5d455c2 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:07.986431 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 232/476] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Jun 8 11:53:07 2022] POST /identity/v3/users => generated 249 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 11:53:08.010591 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 245/477] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:53:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 11:53:08.038561 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ebe3b0-86de-4d19-b1d3-67f2e5d455c2 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:08.173113 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ebe3b0-86de-4d19-b1d3-67f2e5d455c2 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:08.212858 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19520eb0-dc27-4ac8-b043-ad2a9ad8e6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:08.213676 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19520eb0-dc27-4ac8-b043-ad2a9ad8e6d6 None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:08.214050 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19520eb0-dc27-4ac8-b043-ad2a9ad8e6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:08.214540 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19520eb0-dc27-4ac8-b043-ad2a9ad8e6d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:08.215463 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19520eb0-dc27-4ac8-b043-ad2a9ad8e6d6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:08.216867 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19520eb0-dc27-4ac8-b043-ad2a9ad8e6d6 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:08.224923 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.sql.core [None req-19520eb0-dc27-4ac8-b043-ad2a9ad8e6d6 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 08 11:53:08.224923 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 08 11:53:08.224923 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [parameters: {'id': '4c1e65881c954e6fbdbe8608956fd0fb', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 08 11:53:08.224923 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80217) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 08 11:53:08.243246 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-19520eb0-dc27-4ac8-b043-ad2a9ad8e6d6 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 08 11:53:08.243246 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:08.243246 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 08 11:53:08.243246 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 08 11:53:08.243246 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 08 11:53:08.243246 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 08 11:53:08.243246 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 08 11:53:08.243246 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application result = self._query(query) Jun 08 11:53:08.243246 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 08 11:53:08.243246 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application conn.query(q) Jun 08 11:53:08.243246 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 08 11:53:08.243246 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 08 11:53:08.243246 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 08 11:53:08.243246 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application result.read() Jun 08 11:53:08.243246 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 08 11:53:08.244242 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 08 11:53:08.244242 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 08 11:53:08.244242 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 08 11:53:08.244242 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 08 11:53:08.244242 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 08 11:53:08.244242 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 08 11:53:08.244242 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 08 11:53:08.244242 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 08 11:53:08.244242 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:08.244242 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 08 11:53:08.244242 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:08.244242 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:08.244242 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 08 11:53:08.244242 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 08 11:53:08.244242 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 08 11:53:08.244242 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return ref.to_dict() Jun 08 11:53:08.244242 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 08 11:53:08.244242 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application next(self.gen) Jun 08 11:53:08.245276 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 08 11:53:08.245276 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application yield resource Jun 08 11:53:08.245276 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 08 11:53:08.245276 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application next(self.gen) Jun 08 11:53:08.245276 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 08 11:53:08.245276 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self.session.rollback() Jun 08 11:53:08.245276 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 08 11:53:08.245276 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self.force_reraise() Jun 08 11:53:08.245276 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 08 11:53:08.245276 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise self.value Jun 08 11:53:08.245276 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 08 11:53:08.245276 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 08 11:53:08.245276 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 08 11:53:08.245276 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application session.commit() Jun 08 11:53:08.245276 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 08 11:53:08.245276 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 08 11:53:08.245276 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 08 11:53:08.246339 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._prepare_impl() Jun 08 11:53:08.246339 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 08 11:53:08.246339 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self.session.flush() Jun 08 11:53:08.246339 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 08 11:53:08.246339 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._flush(objects) Jun 08 11:53:08.246339 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 08 11:53:08.246339 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 08 11:53:08.246339 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 08 11:53:08.246339 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application compat.raise_( Jun 08 11:53:08.246339 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 08 11:53:08.246339 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception Jun 08 11:53:08.246339 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 08 11:53:08.246339 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application flush_context.execute() Jun 08 11:53:08.246339 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 08 11:53:08.246339 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rec.execute(self) Jun 08 11:53:08.246339 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 08 11:53:08.246339 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 08 11:53:08.247508 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 08 11:53:08.247508 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 08 11:53:08.247508 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 08 11:53:08.247508 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 08 11:53:08.247508 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 08 11:53:08.247508 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 08 11:53:08.247508 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 08 11:53:08.247508 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 08 11:53:08.247508 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 08 11:53:08.247508 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 08 11:53:08.247508 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 08 11:53:08.247508 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 08 11:53:08.247508 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 08 11:53:08.247508 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 08 11:53:08.247508 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 08 11:53:08.247508 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception Jun 08 11:53:08.249057 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 08 11:53:08.249057 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 08 11:53:08.249057 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 08 11:53:08.249057 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 08 11:53:08.249057 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 08 11:53:08.249057 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application result = self._query(query) Jun 08 11:53:08.249057 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 08 11:53:08.249057 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application conn.query(q) Jun 08 11:53:08.249057 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 08 11:53:08.249057 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 08 11:53:08.249057 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 08 11:53:08.249057 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application result.read() Jun 08 11:53:08.249057 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 08 11:53:08.249057 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 08 11:53:08.249057 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 08 11:53:08.249057 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 08 11:53:08.250496 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 08 11:53:08.250496 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 08 11:53:08.250496 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 08 11:53:08.250496 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 08 11:53:08.250496 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 08 11:53:08.250496 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 08 11:53:08.250496 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [parameters: {'id': '4c1e65881c954e6fbdbe8608956fd0fb', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 08 11:53:08.250496 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 08 11:53:08.250496 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:08.250496 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 11:53:08.250496 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:08.250496 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:08.250496 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:08.250496 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:08.250496 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:08.250496 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:08.251886 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:08.251886 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:08.251886 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:08.251886 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:08.251886 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:08.251886 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:08.251886 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 08 11:53:08.251886 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 08 11:53:08.251886 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:08.251886 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:08.251886 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 08 11:53:08.251886 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 08 11:53:08.251886 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 08 11:53:08.251886 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 08 11:53:08.251886 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 08 11:53:08.251886 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:08.259036 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 233/478] 10.222.0.39 () {60 vars in 1131 bytes} [Wed Jun 8 11:53:08 2022] POST /identity/v3/roles => generated 144 bytes in 207 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:08.259191 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b9a7c1-8156-4142-acf7-79a13e63f5d4 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:08.363799 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b9a7c1-8156-4142-acf7-79a13e63f5d4 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:08.399814 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79207d67-263c-48f7-887f-bd27e8aadd97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:08.400653 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79207d67-263c-48f7-887f-bd27e8aadd97 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:08.400936 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79207d67-263c-48f7-887f-bd27e8aadd97 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:08.401287 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79207d67-263c-48f7-887f-bd27e8aadd97 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:08.414011 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79207d67-263c-48f7-887f-bd27e8aadd97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:53:08.433690 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-79207d67-263c-48f7-887f-bd27e8aadd97 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 11:53:08.433690 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:08.433690 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:08.433690 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:08.433690 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:08.433690 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:08.433690 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:08.433690 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:08.433690 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:08.433690 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:08.433690 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:08.433690 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:08.433690 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:53:08.433690 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:53:08.433690 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:53:08.433690 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:53:08.435433 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:53:08.435433 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:53:08.435433 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:53:08.435433 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:53:08.435433 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:08.435433 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:08.435433 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:08.435433 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:08.435433 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:08.435433 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:08.435433 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:08.435433 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:08.435433 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:08.435433 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:08.435433 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:08.435433 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:08.436282 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:08.436282 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:08.436282 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:08.436282 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:08.436282 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:53:08.436282 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:53:08.436282 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:53:08.436282 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:53:08.436282 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:53:08.436282 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:53:08.436282 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 08 11:53:08.436282 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:08.436282 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 246/479] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Jun 8 11:53:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:08.440915 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19520eb0-dc27-4ac8-b043-ad2a9ad8e6d6 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:08.505791 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:08.552406 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19520eb0-dc27-4ac8-b043-ad2a9ad8e6d6 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:08.607774 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965798f-87c0-4d14-84c2-b8b62e117caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:08.608511 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965798f-87c0-4d14-84c2-b8b62e117caf None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:08.608800 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965798f-87c0-4d14-84c2-b8b62e117caf None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:08.609080 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965798f-87c0-4d14-84c2-b8b62e117caf None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:08.609843 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1965798f-87c0-4d14-84c2-b8b62e117caf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:08.610154 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1965798f-87c0-4d14-84c2-b8b62e117caf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:08.611539 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1965798f-87c0-4d14-84c2-b8b62e117caf None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:08.624678 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 234/480] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Jun 8 11:53:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:09.967050 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d301b5-89e5-463d-aff1-2aee6ff5bb2d None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:09.967543 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d301b5-89e5-463d-aff1-2aee6ff5bb2d None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:09.967543 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d301b5-89e5-463d-aff1-2aee6ff5bb2d None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:09.969226 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 247/481] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:53:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:53:09.974412 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8604fa-d99b-458e-81ca-040ba2fe4b5f None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:09.974832 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8604fa-d99b-458e-81ca-040ba2fe4b5f None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:09.975007 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8604fa-d99b-458e-81ca-040ba2fe4b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:09.997328 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-5d8604fa-d99b-458e-81ca-040ba2fe4b5f None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:53:09.998536 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-5d8604fa-d99b-458e-81ca-040ba2fe4b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:53:10.101818 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 235/482] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:53:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:53:10.150314 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d301b5-89e5-463d-aff1-2aee6ff5bb2d None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:10.161127 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:10.253282 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb30203-dbf4-4007-a3e4-bbda35c5f004 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:10.253577 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb30203-dbf4-4007-a3e4-bbda35c5f004 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:10.253756 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb30203-dbf4-4007-a3e4-bbda35c5f004 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:10.255121 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 236/483] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:53:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 11:53:10.265427 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39d3ea-de8b-45cb-800d-0e31d544948c None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:10.265720 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39d3ea-de8b-45cb-800d-0e31d544948c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:10.265992 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39d3ea-de8b-45cb-800d-0e31d544948c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:10.302153 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-ec39d3ea-de8b-45cb-800d-0e31d544948c None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:53:10.303895 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ec39d3ea-de8b-45cb-800d-0e31d544948c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:53:10.315527 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d301b5-89e5-463d-aff1-2aee6ff5bb2d None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:10.364597 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8dda22-33c0-43c8-9fbc-7dab79984244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:10.365907 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8dda22-33c0-43c8-9fbc-7dab79984244 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:10.366622 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8dda22-33c0-43c8-9fbc-7dab79984244 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:10.367254 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8dda22-33c0-43c8-9fbc-7dab79984244 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:10.381460 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8dda22-33c0-43c8-9fbc-7dab79984244 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:53:10.390805 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-0d8dda22-33c0-43c8-9fbc-7dab79984244 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 11:53:10.390805 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:10.390805 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:10.390805 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:10.390805 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:10.390805 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:10.390805 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:10.390805 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:10.390805 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:10.390805 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:10.390805 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:10.390805 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:10.390805 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:53:10.390805 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:53:10.390805 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:53:10.390805 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:53:10.391686 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:53:10.391686 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:53:10.391686 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:53:10.391686 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:53:10.391686 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:10.391686 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:10.391686 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:10.391686 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:10.391686 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:10.391686 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:10.391686 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:10.391686 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:10.391686 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:10.391686 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:10.391686 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:10.391686 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:10.392485 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:10.392485 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:10.392485 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:10.392485 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:10.392485 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:53:10.392485 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:53:10.392485 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:53:10.392485 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:53:10.392485 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:53:10.392485 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:53:10.392485 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 11:53:10.392485 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:10.395231 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 248/484] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Jun 8 11:53:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:10.403322 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8dda22-33c0-43c8-9fbc-7dab79984244 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:10.409285 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:10.478185 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:10.502436 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 237/485] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:53:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 11:53:10.518453 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8dda22-33c0-43c8-9fbc-7dab79984244 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:10.540579 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec39d3ea-de8b-45cb-800d-0e31d544948c None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:10.561559 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc22dfe-1584-42e4-9e6f-d28665c54caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:10.562243 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc22dfe-1584-42e4-9e6f-d28665c54caa None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:10.562529 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc22dfe-1584-42e4-9e6f-d28665c54caa None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:10.562804 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc22dfe-1584-42e4-9e6f-d28665c54caa None admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:10.563563 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc22dfe-1584-42e4-9e6f-d28665c54caa None admin] RBAC: Adding query filter params (name=service) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:10.563871 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc22dfe-1584-42e4-9e6f-d28665c54caa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:10.566342 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc22dfe-1584-42e4-9e6f-d28665c54caa None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:10.584346 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 249/486] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Jun 8 11:53:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:10.590707 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc22dfe-1584-42e4-9e6f-d28665c54caa None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:10.715538 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec39d3ea-de8b-45cb-800d-0e31d544948c None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:10.738634 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc22dfe-1584-42e4-9e6f-d28665c54caa None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:10.760686 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b4e99-d0b8-49ed-83e7-47e7b25acd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:10.761598 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b4e99-d0b8-49ed-83e7-47e7b25acd44 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:10.762050 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b4e99-d0b8-49ed-83e7-47e7b25acd44 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:10.762337 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b4e99-d0b8-49ed-83e7-47e7b25acd44 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:10.765841 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:10.775602 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f59efb3-5845-48e8-b46c-50d94b7cdbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:10.776922 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b4e99-d0b8-49ed-83e7-47e7b25acd44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:53:10.777392 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59efb3-5845-48e8-b46c-50d94b7cdbfc None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:10.777838 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59efb3-5845-48e8-b46c-50d94b7cdbfc None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:10.778263 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59efb3-5845-48e8-b46c-50d94b7cdbfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:10.785819 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-bc5b4e99-d0b8-49ed-83e7-47e7b25acd44 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 11:53:10.785819 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:10.785819 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:10.785819 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:10.785819 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:10.785819 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:10.785819 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:10.785819 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:10.785819 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:10.785819 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:10.785819 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:10.785819 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:10.785819 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:53:10.785819 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:53:10.785819 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:53:10.785819 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:53:10.787010 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:53:10.787010 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:53:10.787010 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:53:10.787010 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:53:10.787010 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:10.787010 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:10.787010 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:10.787010 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:10.787010 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:10.787010 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:10.787010 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:10.787010 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:10.787010 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:10.787010 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:10.787010 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:10.787010 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:10.787952 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:10.787952 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:10.787952 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:10.787952 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:10.787952 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:53:10.787952 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:53:10.787952 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:53:10.787952 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:53:10.787952 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:53:10.787952 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:53:10.787952 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 11:53:10.787952 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:10.787952 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 238/487] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Jun 8 11:53:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 11:53:10.796278 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d297a2-75ef-49fe-b194-f55eb15f0963 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:10.796278 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d297a2-75ef-49fe-b194-f55eb15f0963 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:10.796278 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d297a2-75ef-49fe-b194-f55eb15f0963 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:10.796278 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 239/488] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:53:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:53:10.796278 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d297a2-75ef-49fe-b194-f55eb15f0963 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:10.805164 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f59efb3-5845-48e8-b46c-50d94b7cdbfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:10.807724 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f59efb3-5845-48e8-b46c-50d94b7cdbfc None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:10.828774 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-2f59efb3-5845-48e8-b46c-50d94b7cdbfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:10.828774 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:10.828774 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:10.828774 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:10.828774 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:10.828774 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:10.828774 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:10.828774 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:10.828774 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:10.828774 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:10.828774 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:10.828774 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:10.828774 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:53:10.828774 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:53:10.828774 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:53:10.829696 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:53:10.829696 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:10.829696 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:10.829696 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:10.829696 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:10.829696 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:10.829696 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:10.829696 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:10.829696 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:10.829696 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:10.829696 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:10.829696 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:10.829696 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:10.829696 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:10.829696 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:10.829696 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:10.829696 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:10.830620 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:53:10.830620 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:53:10.830620 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:10.830620 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:10.833054 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 250/489] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:53:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 11:53:10.833740 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:10.835845 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473368a-399b-4f5d-a9a9-6df6a88152a2 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:10.836365 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473368a-399b-4f5d-a9a9-6df6a88152a2 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:10.836878 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473368a-399b-4f5d-a9a9-6df6a88152a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:10.856017 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-b473368a-399b-4f5d-a9a9-6df6a88152a2 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:53:10.857538 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-b473368a-399b-4f5d-a9a9-6df6a88152a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:53:10.910381 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d297a2-75ef-49fe-b194-f55eb15f0963 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:10.940249 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 251/490] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:53:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:53:10.941336 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b473368a-399b-4f5d-a9a9-6df6a88152a2 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:10.947757 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9341e839-6b3b-4e91-b51c-3549e2149417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:10.949104 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341e839-6b3b-4e91-b51c-3549e2149417 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:10.949553 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341e839-6b3b-4e91-b51c-3549e2149417 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:10.949966 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341e839-6b3b-4e91-b51c-3549e2149417 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:10.950871 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9341e839-6b3b-4e91-b51c-3549e2149417 None admin] RBAC: Adding query filter params (name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:10.951304 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9341e839-6b3b-4e91-b51c-3549e2149417 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:10.952834 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9341e839-6b3b-4e91-b51c-3549e2149417 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:10.961894 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 240/491] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Jun 8 11:53:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:10.973301 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9341e839-6b3b-4e91-b51c-3549e2149417 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:11.054854 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b473368a-399b-4f5d-a9a9-6df6a88152a2 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:11.066430 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:11.089252 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:11.092876 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d18b47c-34c1-41f8-b65f-f8125d892c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:11.093889 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18b47c-34c1-41f8-b65f-f8125d892c67 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:11.094036 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18b47c-34c1-41f8-b65f-f8125d892c67 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:11.094391 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18b47c-34c1-41f8-b65f-f8125d892c67 None admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:11.095264 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d18b47c-34c1-41f8-b65f-f8125d892c67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:11.095675 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d18b47c-34c1-41f8-b65f-f8125d892c67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:11.097195 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d18b47c-34c1-41f8-b65f-f8125d892c67 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:11.097783 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9341e839-6b3b-4e91-b51c-3549e2149417 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:11.110483 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 252/492] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:53:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:11.111685 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d18b47c-34c1-41f8-b65f-f8125d892c67 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:11.147108 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59510d3d-546f-4c17-8ee4-9525e3c88bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:11.147911 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59510d3d-546f-4c17-8ee4-9525e3c88bfc None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:11.148204 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59510d3d-546f-4c17-8ee4-9525e3c88bfc None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:11.148476 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59510d3d-546f-4c17-8ee4-9525e3c88bfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:11.159944 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59510d3d-546f-4c17-8ee4-9525e3c88bfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:11.161434 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59510d3d-546f-4c17-8ee4-9525e3c88bfc None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:11.179232 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-59510d3d-546f-4c17-8ee4-9525e3c88bfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:11.179232 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:11.179232 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:11.179232 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:11.179232 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:11.179232 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:11.179232 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:11.179232 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:11.179232 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:11.179232 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:11.179232 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:11.179232 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:11.179232 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:53:11.179232 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:53:11.179232 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:53:11.180327 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:53:11.180327 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:11.180327 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:11.180327 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:11.180327 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:11.180327 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:11.180327 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:11.180327 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:11.180327 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:11.180327 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:11.180327 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:11.180327 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:11.180327 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:11.180327 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:11.180327 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:11.180327 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:11.180327 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:11.181168 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:53:11.181168 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:53:11.181168 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:11.181168 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:11.185949 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 241/493] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:53:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:11.186725 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59510d3d-546f-4c17-8ee4-9525e3c88bfc None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:11.220068 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d18b47c-34c1-41f8-b65f-f8125d892c67 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:11.257108 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a09b2-7d32-4fb5-b274-36e47648f742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:11.257947 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a09b2-7d32-4fb5-b274-36e47648f742 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:11.258348 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a09b2-7d32-4fb5-b274-36e47648f742 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:11.258625 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a09b2-7d32-4fb5-b274-36e47648f742 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:11.271546 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a09b2-7d32-4fb5-b274-36e47648f742 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:53:11.280290 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-005a09b2-7d32-4fb5-b274-36e47648f742 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 11:53:11.280290 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:11.280290 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:11.280290 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:11.280290 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:11.280290 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:11.280290 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:11.280290 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:11.280290 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:11.280290 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:11.280290 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:11.280290 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:11.280290 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:53:11.280290 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:53:11.280290 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:53:11.280290 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:53:11.281335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:53:11.281335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:53:11.281335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:53:11.281335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:53:11.281335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:11.281335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:11.281335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:11.281335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:11.281335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:11.281335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:11.281335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:11.281335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:11.281335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:11.281335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:11.281335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:11.281335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:11.282137 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:11.282137 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:11.282137 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:11.282137 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:11.282137 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:53:11.282137 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:53:11.282137 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:53:11.282137 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:53:11.282137 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:53:11.282137 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:53:11.282137 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 11:53:11.282137 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:11.282137 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 253/494] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Jun 8 11:53:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:11.283277 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0bc9e-6712-4c7c-94ea-3cba8f13ad49 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:11.283277 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0bc9e-6712-4c7c-94ea-3cba8f13ad49 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:11.283430 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0bc9e-6712-4c7c-94ea-3cba8f13ad49 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:11.284797 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 254/495] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:53:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:53:11.285554 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0bc9e-6712-4c7c-94ea-3cba8f13ad49 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:11.304119 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59510d3d-546f-4c17-8ee4-9525e3c88bfc None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:11.320400 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:11.341028 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b7816-9de4-4ced-b78f-1ba99506e465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:11.341822 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b7816-9de4-4ced-b78f-1ba99506e465 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:11.342105 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b7816-9de4-4ced-b78f-1ba99506e465 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:11.342381 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b7816-9de4-4ced-b78f-1ba99506e465 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:11.350316 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8b7816-9de4-4ced-b78f-1ba99506e465 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:11.351787 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8b7816-9de4-4ced-b78f-1ba99506e465 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:11.367722 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-6d8b7816-9de4-4ced-b78f-1ba99506e465 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 08 11:53:11.367722 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:11.367722 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:11.367722 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:11.367722 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:11.367722 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:11.367722 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:11.367722 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:11.367722 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:11.367722 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:11.367722 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:11.367722 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:11.367722 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 11:53:11.367722 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 11:53:11.367722 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 11:53:11.367722 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 11:53:11.368935 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:11.368935 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:11.368935 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 11:53:11.368935 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:53:11.368935 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 11:53:11.368935 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:53:11.368935 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:11.368935 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:11.368935 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:11.368935 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:11.368935 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:11.368935 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:11.368935 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:11.368935 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:11.368935 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:11.368935 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:11.368935 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:11.368935 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:11.374585 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:11.374585 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:11.374585 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 11:53:11.374585 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 11:53:11.374585 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 11:53:11.374585 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 11:53:11.374585 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 11:53:11.374585 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 11:53:11.374585 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 08 11:53:11.374585 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:11.374585 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 242/496] 10.222.0.39 () {56 vars in 1093 bytes} [Wed Jun 8 11:53:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:11.374585 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b7816-9de4-4ced-b78f-1ba99506e465 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:11.382937 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:11.405332 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0bc9e-6712-4c7c-94ea-3cba8f13ad49 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:11.440492 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c829aa1d-986e-4b46-909d-8831b27094da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:11.441160 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c829aa1d-986e-4b46-909d-8831b27094da None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:11.441444 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c829aa1d-986e-4b46-909d-8831b27094da None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:11.441727 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c829aa1d-986e-4b46-909d-8831b27094da None admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:11.442449 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c829aa1d-986e-4b46-909d-8831b27094da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:11.442758 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c829aa1d-986e-4b46-909d-8831b27094da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:11.444124 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c829aa1d-986e-4b46-909d-8831b27094da None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:11.461038 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 255/497] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:53:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:11.461038 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f9a59-8651-43bb-88fb-1bdaf577828d None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:11.461038 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f9a59-8651-43bb-88fb-1bdaf577828d None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:11.461038 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f9a59-8651-43bb-88fb-1bdaf577828d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:11.477446 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-2f0f9a59-8651-43bb-88fb-1bdaf577828d None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:53:11.478697 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-2f0f9a59-8651-43bb-88fb-1bdaf577828d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:53:11.488089 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b7816-9de4-4ced-b78f-1ba99506e465 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:11.523903 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad19ff37-5fd4-4839-ac05-366b7744beff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:11.524626 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19ff37-5fd4-4839-ac05-366b7744beff None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:11.524912 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19ff37-5fd4-4839-ac05-366b7744beff None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:11.525190 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19ff37-5fd4-4839-ac05-366b7744beff None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:11.526639 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad19ff37-5fd4-4839-ac05-366b7744beff None admin] RBAC: Adding query filter params (name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:11.526959 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad19ff37-5fd4-4839-ac05-366b7744beff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:11.528376 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad19ff37-5fd4-4839-ac05-366b7744beff None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:11.536921 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 243/498] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Jun 8 11:53:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:11.537669 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad19ff37-5fd4-4839-ac05-366b7744beff None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:11.552234 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 256/499] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:53:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:53:11.553144 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f9a59-8651-43bb-88fb-1bdaf577828d None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:11.577179 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:11.622149 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:11.656249 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad19ff37-5fd4-4839-ac05-366b7744beff None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:11.660448 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f9a59-8651-43bb-88fb-1bdaf577828d None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:11.691664 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2cfccd-091e-48c7-b6ab-10db7d254a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:11.692377 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2cfccd-091e-48c7-b6ab-10db7d254a05 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:11.692661 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2cfccd-091e-48c7-b6ab-10db7d254a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:11.692937 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2cfccd-091e-48c7-b6ab-10db7d254a05 None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:11.693781 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2cfccd-091e-48c7-b6ab-10db7d254a05 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:11.694093 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2cfccd-091e-48c7-b6ab-10db7d254a05 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:11.695271 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea199716-0198-4459-855f-2f39d1da3f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:11.695525 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2cfccd-091e-48c7-b6ab-10db7d254a05 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:11.696066 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea199716-0198-4459-855f-2f39d1da3f80 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:11.696387 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea199716-0198-4459-855f-2f39d1da3f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:11.696665 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea199716-0198-4459-855f-2f39d1da3f80 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:11.705771 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea199716-0198-4459-855f-2f39d1da3f80 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:11.707225 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea199716-0198-4459-855f-2f39d1da3f80 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:11.723735 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-ea199716-0198-4459-855f-2f39d1da3f80 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 08 11:53:11.723735 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:11.723735 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:11.723735 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:11.723735 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:11.723735 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:11.723735 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:11.723735 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:11.723735 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:11.723735 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:11.723735 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:11.723735 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:11.723735 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 11:53:11.723735 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 11:53:11.723735 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 11:53:11.723735 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 11:53:11.724876 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:11.724876 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:11.724876 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 11:53:11.724876 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:53:11.724876 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 11:53:11.724876 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:53:11.724876 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:11.724876 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:11.724876 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:11.724876 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:11.724876 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:11.724876 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:11.724876 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:11.724876 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:11.724876 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:11.724876 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:11.724876 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:11.724876 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:11.725780 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:11.725780 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:11.725780 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 11:53:11.725780 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 11:53:11.725780 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 11:53:11.725780 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 11:53:11.725780 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 11:53:11.725780 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 11:53:11.725780 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 08 11:53:11.725780 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:11.725780 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 257/500] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:53:11 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:11.725780 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea199716-0198-4459-855f-2f39d1da3f80 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:11.737526 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 244/501] 10.222.0.39 () {56 vars in 1133 bytes} [Wed Jun 8 11:53:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:11.737526 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2cfccd-091e-48c7-b6ab-10db7d254a05 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:11.810650 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:11.829371 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea199716-0198-4459-855f-2f39d1da3f80 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:11.834977 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2cfccd-091e-48c7-b6ab-10db7d254a05 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:11.860813 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:11.863750 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b92648-b930-4150-9dd0-2c446e1c9c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:11.864565 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b92648-b930-4150-9dd0-2c446e1c9c94 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:11.864845 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b92648-b930-4150-9dd0-2c446e1c9c94 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:11.865117 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b92648-b930-4150-9dd0-2c446e1c9c94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:11.870797 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a946b0b-20c5-4cec-83af-c5bda2fe6db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:11.871587 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a946b0b-20c5-4cec-83af-c5bda2fe6db4 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:11.871870 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a946b0b-20c5-4cec-83af-c5bda2fe6db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:11.872156 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a946b0b-20c5-4cec-83af-c5bda2fe6db4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:11.875663 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b92648-b930-4150-9dd0-2c446e1c9c94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:11.877176 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b92648-b930-4150-9dd0-2c446e1c9c94 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:11.882124 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a946b0b-20c5-4cec-83af-c5bda2fe6db4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:53:11.889911 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-4a946b0b-20c5-4cec-83af-c5bda2fe6db4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 11:53:11.889911 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:11.889911 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:11.889911 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:11.889911 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:11.889911 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:11.889911 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:11.889911 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:11.889911 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:11.889911 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:11.889911 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:11.889911 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:11.889911 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:53:11.889911 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:53:11.889911 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:53:11.889911 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:53:11.890855 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:53:11.890855 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:53:11.890855 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:53:11.890855 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:53:11.890855 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:11.890855 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:11.890855 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:11.890855 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:11.890855 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:11.890855 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:11.890855 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:11.890855 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:11.890855 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:11.890855 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:11.890855 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:11.890855 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:11.891923 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:11.891923 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:11.891923 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:11.891923 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:11.891923 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:53:11.891923 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:53:11.891923 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:53:11.891923 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:53:11.891923 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:53:11.891923 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:53:11.891923 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 11:53:11.891923 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:11.891923 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 245/502] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Jun 8 11:53:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:11.892754 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75eb8e-11fe-4da8-9107-a007cf795b51 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:11.892923 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75eb8e-11fe-4da8-9107-a007cf795b51 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:11.893171 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75eb8e-11fe-4da8-9107-a007cf795b51 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:11.894566 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 246/503] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:53:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:53:11.894662 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-f7b92648-b930-4150-9dd0-2c446e1c9c94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:11.894662 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:11.894662 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:11.894662 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:11.894662 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:11.894662 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:11.894662 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:11.894662 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:11.894662 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:11.894662 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:11.894662 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:11.894662 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:11.894662 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:53:11.894662 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:53:11.894662 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:53:11.895409 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:53:11.895409 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:11.895409 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:11.895409 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:11.895409 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:11.895409 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:11.895409 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:11.895409 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:11.895409 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:11.895409 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:11.895409 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:11.895409 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:11.895409 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:11.895409 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:11.895409 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:11.895409 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:11.895409 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:11.900198 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:53:11.900198 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:53:11.900198 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:11.900198 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:11.900198 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 258/504] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:53:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:11.900198 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b92648-b930-4150-9dd0-2c446e1c9c94 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:11.900542 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd75eb8e-11fe-4da8-9107-a007cf795b51 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:11.995171 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b92648-b930-4150-9dd0-2c446e1c9c94 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:12.002181 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd75eb8e-11fe-4da8-9107-a007cf795b51 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:12.024436 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:12.030945 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c8c123-12fe-4a5f-8fb9-ffb478bce664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:12.031605 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8c123-12fe-4a5f-8fb9-ffb478bce664 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:12.031893 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8c123-12fe-4a5f-8fb9-ffb478bce664 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:12.032189 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8c123-12fe-4a5f-8fb9-ffb478bce664 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:12.036830 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4991c012-0aca-46fe-b23e-53f766d9f46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:12.037495 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991c012-0aca-46fe-b23e-53f766d9f46f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:12.037777 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991c012-0aca-46fe-b23e-53f766d9f46f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:12.038052 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991c012-0aca-46fe-b23e-53f766d9f46f None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:12.038884 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4991c012-0aca-46fe-b23e-53f766d9f46f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:12.039190 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4991c012-0aca-46fe-b23e-53f766d9f46f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:12.041053 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4991c012-0aca-46fe-b23e-53f766d9f46f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:12.059761 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 247/505] 10.222.0.39 () {56 vars in 1137 bytes} [Wed Jun 8 11:53:11 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:12.060599 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4991c012-0aca-46fe-b23e-53f766d9f46f None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:12.104987 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c8c123-12fe-4a5f-8fb9-ffb478bce664 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:12.105950 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c8c123-12fe-4a5f-8fb9-ffb478bce664 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:12.107785 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:12.161968 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4991c012-0aca-46fe-b23e-53f766d9f46f None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:12.196614 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a12b4a-e845-43f0-8970-ddcb977d64a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:12.197288 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a12b4a-e845-43f0-8970-ddcb977d64a4 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:12.197566 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a12b4a-e845-43f0-8970-ddcb977d64a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:12.198456 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a12b4a-e845-43f0-8970-ddcb977d64a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:12.199485 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a12b4a-e845-43f0-8970-ddcb977d64a4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:12.199794 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a12b4a-e845-43f0-8970-ddcb977d64a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:12.201217 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a12b4a-e845-43f0-8970-ddcb977d64a4 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:12.203809 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 259/506] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:53:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 11:53:12.205124 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe028bc-a7d4-4cf9-ae2e-91826985c461 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:12.205416 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe028bc-a7d4-4cf9-ae2e-91826985c461 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:12.205693 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe028bc-a7d4-4cf9-ae2e-91826985c461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:12.211602 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 248/507] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Jun 8 11:53:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:12.212485 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a12b4a-e845-43f0-8970-ddcb977d64a4 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:12.221954 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-bbe028bc-a7d4-4cf9-ae2e-91826985c461 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:53:12.223149 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-bbe028bc-a7d4-4cf9-ae2e-91826985c461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:53:12.249369 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:12.294234 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 260/508] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:53:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:53:12.295080 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe028bc-a7d4-4cf9-ae2e-91826985c461 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:12.325197 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a12b4a-e845-43f0-8970-ddcb977d64a4 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:12.332621 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:12.359824 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86729e-8684-4401-92ec-58a0e601cbdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:12.360457 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86729e-8684-4401-92ec-58a0e601cbdd None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:12.360743 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86729e-8684-4401-92ec-58a0e601cbdd None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:12.361024 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86729e-8684-4401-92ec-58a0e601cbdd None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:12.361744 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c86729e-8684-4401-92ec-58a0e601cbdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:12.362056 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c86729e-8684-4401-92ec-58a0e601cbdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:12.363457 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c86729e-8684-4401-92ec-58a0e601cbdd None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:12.375575 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 249/509] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:53:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:12.376396 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86729e-8684-4401-92ec-58a0e601cbdd None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:12.395500 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe028bc-a7d4-4cf9-ae2e-91826985c461 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:12.429025 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66cd4dd-b3d2-4e13-972c-aba94a2aca41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:12.429772 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66cd4dd-b3d2-4e13-972c-aba94a2aca41 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:12.429957 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66cd4dd-b3d2-4e13-972c-aba94a2aca41 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:12.430233 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66cd4dd-b3d2-4e13-972c-aba94a2aca41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:12.461198 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:12.475061 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86729e-8684-4401-92ec-58a0e601cbdd None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:12.500129 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66cd4dd-b3d2-4e13-972c-aba94a2aca41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:12.501635 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66cd4dd-b3d2-4e13-972c-aba94a2aca41 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:12.509042 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a441b9a-8fce-4f95-b004-c0ad763c89c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:12.509830 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a441b9a-8fce-4f95-b004-c0ad763c89c9 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:12.510198 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a441b9a-8fce-4f95-b004-c0ad763c89c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:12.511016 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a441b9a-8fce-4f95-b004-c0ad763c89c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:12.520948 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a441b9a-8fce-4f95-b004-c0ad763c89c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:12.522385 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a441b9a-8fce-4f95-b004-c0ad763c89c9 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:12.539484 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-3a441b9a-8fce-4f95-b004-c0ad763c89c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:12.539484 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:12.539484 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:12.539484 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:12.539484 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:12.539484 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:12.539484 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:12.539484 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:12.539484 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:12.539484 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:12.539484 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:12.539484 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:12.539484 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:53:12.539484 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:53:12.539484 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:53:12.540392 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:53:12.540392 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:12.540392 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:12.540392 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:12.540392 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:12.540392 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:12.540392 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:12.540392 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:12.540392 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:12.540392 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:12.540392 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:12.540392 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:12.540392 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:12.540392 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:12.540392 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:12.540392 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:12.540392 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:12.541233 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:53:12.541233 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:53:12.541233 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:12.541233 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:12.541233 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 250/510] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:53:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:12.542211 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a441b9a-8fce-4f95-b004-c0ad763c89c9 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:12.560677 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:12.608076 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 261/511] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:53:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 11:53:12.608953 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66cd4dd-b3d2-4e13-972c-aba94a2aca41 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:12.647101 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a441b9a-8fce-4f95-b004-c0ad763c89c9 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:12.674460 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:12.680346 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7d65e-384a-48b5-b333-d8a8cb6e86b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:12.681140 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7d65e-384a-48b5-b333-d8a8cb6e86b9 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:12.681420 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7d65e-384a-48b5-b333-d8a8cb6e86b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:12.681693 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7d65e-384a-48b5-b333-d8a8cb6e86b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:12.692663 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f7d65e-384a-48b5-b333-d8a8cb6e86b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:12.694098 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f7d65e-384a-48b5-b333-d8a8cb6e86b9 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:12.712391 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-64f7d65e-384a-48b5-b333-d8a8cb6e86b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:12.712391 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:12.712391 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:12.712391 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:12.712391 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:12.712391 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:12.712391 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:12.712391 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:12.712391 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:12.712391 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:12.712391 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:12.712391 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:12.712391 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:53:12.712391 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:53:12.712391 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:53:12.713918 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:53:12.713918 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:12.713918 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:12.713918 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:12.713918 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:12.713918 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:12.713918 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:12.713918 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:12.713918 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:12.713918 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:12.713918 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:12.713918 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:12.713918 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:12.713918 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:12.713918 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:12.713918 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:12.713918 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:12.714806 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:53:12.714806 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:53:12.714806 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:12.714806 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:12.714806 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 251/512] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:53:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:12.715075 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66cd4dd-b3d2-4e13-972c-aba94a2aca41 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:12.715145 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7d65e-384a-48b5-b333-d8a8cb6e86b9 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:12.749251 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb023e-6887-4ffa-a8a1-e7767e9fcc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:12.750030 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb023e-6887-4ffa-a8a1-e7767e9fcc6d None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:12.750313 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb023e-6887-4ffa-a8a1-e7767e9fcc6d None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:12.750581 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb023e-6887-4ffa-a8a1-e7767e9fcc6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:12.761013 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb023e-6887-4ffa-a8a1-e7767e9fcc6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:12.762485 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb023e-6887-4ffa-a8a1-e7767e9fcc6d None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:12.779929 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-6cbb023e-6887-4ffa-a8a1-e7767e9fcc6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:12.779929 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:12.779929 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:12.779929 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:12.779929 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:12.779929 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:12.779929 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:12.779929 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:12.779929 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:12.779929 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:12.779929 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:12.779929 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:12.779929 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:53:12.779929 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:53:12.779929 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:53:12.780838 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:53:12.780838 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:12.780838 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:12.780838 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:12.780838 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:12.780838 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:12.780838 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:12.780838 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:12.780838 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:12.780838 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:12.780838 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:12.780838 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:12.780838 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:12.780838 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:12.780838 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:12.780838 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:12.780838 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:12.781666 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:53:12.781666 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:53:12.781666 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:12.781666 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:12.781666 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 262/513] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:53:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:12.781985 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb023e-6887-4ffa-a8a1-e7767e9fcc6d None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:12.790161 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:12.820023 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7d65e-384a-48b5-b333-d8a8cb6e86b9 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:12.854828 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd45fd-748b-4354-9478-404d85e8f700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:12.855611 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd45fd-748b-4354-9478-404d85e8f700 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:12.855890 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd45fd-748b-4354-9478-404d85e8f700 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:12.856159 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd45fd-748b-4354-9478-404d85e8f700 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:12.863119 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dd45fd-748b-4354-9478-404d85e8f700 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:12.864580 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dd45fd-748b-4354-9478-404d85e8f700 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:12.878695 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-77dd45fd-748b-4354-9478-404d85e8f700 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 08 11:53:12.878695 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:12.878695 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:12.878695 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:12.878695 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:12.878695 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:12.878695 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:12.878695 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:12.878695 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:12.878695 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:12.878695 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:12.878695 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:12.878695 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 11:53:12.878695 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 11:53:12.878695 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 11:53:12.878695 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 11:53:12.879600 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:12.879600 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:12.879600 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 11:53:12.879600 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:53:12.879600 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 11:53:12.879600 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:53:12.879600 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:12.879600 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:12.879600 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:12.879600 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:12.879600 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:12.879600 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:12.879600 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:12.879600 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:12.879600 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:12.879600 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:12.879600 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:12.879600 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:12.880520 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:12.880520 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:12.880520 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 11:53:12.880520 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 11:53:12.880520 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 11:53:12.880520 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 11:53:12.880520 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 11:53:12.880520 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 11:53:12.880520 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 08 11:53:12.880520 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:12.881032 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb023e-6887-4ffa-a8a1-e7767e9fcc6d None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:12.884308 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 252/514] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:53:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:12.885976 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd45fd-748b-4354-9478-404d85e8f700 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:12.893964 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:12.914532 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e4448-2771-450a-803b-a0f39b7c1c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:12.915135 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e4448-2771-450a-803b-a0f39b7c1c7b None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:12.915419 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e4448-2771-450a-803b-a0f39b7c1c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:12.915698 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e4448-2771-450a-803b-a0f39b7c1c7b None admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:12.917035 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444e4448-2771-450a-803b-a0f39b7c1c7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:12.917385 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444e4448-2771-450a-803b-a0f39b7c1c7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:12.918753 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444e4448-2771-450a-803b-a0f39b7c1c7b None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:12.929654 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 263/515] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:53:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:12.930488 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e4448-2771-450a-803b-a0f39b7c1c7b None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:12.984871 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd45fd-748b-4354-9478-404d85e8f700 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:13.018761 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:13.024773 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1c6db1-c439-487e-b61f-226257e4e502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:13.025571 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c6db1-c439-487e-b61f-226257e4e502 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:13.025936 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c6db1-c439-487e-b61f-226257e4e502 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:13.026345 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c6db1-c439-487e-b61f-226257e4e502 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:13.035389 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e4448-2771-450a-803b-a0f39b7c1c7b None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:13.036514 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1c6db1-c439-487e-b61f-226257e4e502 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:13.038002 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1c6db1-c439-487e-b61f-226257e4e502 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:13.055004 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-bc1c6db1-c439-487e-b61f-226257e4e502 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:13.055004 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:13.055004 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:13.055004 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:13.055004 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:13.055004 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:13.055004 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:13.055004 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:13.055004 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:13.055004 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:13.055004 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:13.055004 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:13.055004 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:53:13.055004 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:53:13.055004 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:53:13.055842 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:53:13.055842 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:13.055842 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:13.055842 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:13.055842 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:13.055842 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:13.055842 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:13.055842 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:13.055842 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:13.055842 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:13.055842 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:13.055842 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:13.055842 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:13.055842 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:13.055842 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:13.055842 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:13.055842 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:13.056733 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:53:13.056733 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:53:13.056733 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:13.056733 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:13.056733 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 253/516] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:53:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:13.057979 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1c6db1-c439-487e-b61f-226257e4e502 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:13.072106 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b79445-c8cc-4f7d-a223-dacce2a537ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:13.073556 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b79445-c8cc-4f7d-a223-dacce2a537ae None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:13.073977 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b79445-c8cc-4f7d-a223-dacce2a537ae None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:13.074257 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b79445-c8cc-4f7d-a223-dacce2a537ae None admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:13.074979 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b79445-c8cc-4f7d-a223-dacce2a537ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:13.075285 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b79445-c8cc-4f7d-a223-dacce2a537ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:13.076691 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b79445-c8cc-4f7d-a223-dacce2a537ae None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:13.160816 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1c6db1-c439-487e-b61f-226257e4e502 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:13.196940 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2918677e-1c03-4a52-9b0a-f2db2c91c8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:13.197532 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918677e-1c03-4a52-9b0a-f2db2c91c8e5 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:13.198384 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918677e-1c03-4a52-9b0a-f2db2c91c8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:13.198766 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918677e-1c03-4a52-9b0a-f2db2c91c8e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:13.199500 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2918677e-1c03-4a52-9b0a-f2db2c91c8e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:13.199802 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2918677e-1c03-4a52-9b0a-f2db2c91c8e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:13.201227 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2918677e-1c03-4a52-9b0a-f2db2c91c8e5 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:13.208773 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 264/517] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:53:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:13.209426 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b79445-c8cc-4f7d-a223-dacce2a537ae None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:13.213140 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 254/518] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:53:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:13.214132 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2918677e-1c03-4a52-9b0a-f2db2c91c8e5 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:13.243827 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:13.258288 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:13.311268 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b79445-c8cc-4f7d-a223-dacce2a537ae None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:13.314957 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2918677e-1c03-4a52-9b0a-f2db2c91c8e5 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:13.345815 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47623919-3f72-45e5-9c9c-fdaa84d269a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:13.346510 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47623919-3f72-45e5-9c9c-fdaa84d269a2 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:13.346793 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47623919-3f72-45e5-9c9c-fdaa84d269a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:13.347067 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47623919-3f72-45e5-9c9c-fdaa84d269a2 None admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:13.347905 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47623919-3f72-45e5-9c9c-fdaa84d269a2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:13.348247 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47623919-3f72-45e5-9c9c-fdaa84d269a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:13.349375 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c52008-a420-4bac-a774-cd2e316509fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:13.349957 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47623919-3f72-45e5-9c9c-fdaa84d269a2 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:13.350170 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c52008-a420-4bac-a774-cd2e316509fc None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:13.350455 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c52008-a420-4bac-a774-cd2e316509fc None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:13.350730 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c52008-a420-4bac-a774-cd2e316509fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:13.357434 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c52008-a420-4bac-a774-cd2e316509fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:13.358868 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c52008-a420-4bac-a774-cd2e316509fc None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:13.373562 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-84c52008-a420-4bac-a774-cd2e316509fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:53:13.373562 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:13.373562 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:13.373562 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:13.373562 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:13.373562 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:13.373562 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:13.373562 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:13.373562 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:13.373562 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:13.373562 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:13.373562 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:13.373562 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 11:53:13.373562 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 11:53:13.373562 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 11:53:13.374381 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 11:53:13.374381 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:13.374381 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:13.374381 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:13.374381 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:13.374381 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:13.374381 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:13.374381 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:13.374381 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:13.374381 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:13.374381 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:13.374381 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:13.374381 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:13.374381 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:13.374381 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:13.374381 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:13.374381 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:13.375228 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 11:53:13.375228 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 11:53:13.375228 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 11:53:13.375228 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 11:53:13.375228 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 11:53:13.375228 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 11:53:13.375228 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:53:13.375228 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:13.375228 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 255/519] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Jun 8 11:53:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:13.376264 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c52008-a420-4bac-a774-cd2e316509fc None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:13.386887 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 265/520] 10.222.0.39 () {56 vars in 1137 bytes} [Wed Jun 8 11:53:13 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:13.387716 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47623919-3f72-45e5-9c9c-fdaa84d269a2 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:13.475918 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c52008-a420-4bac-a774-cd2e316509fc None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:13.477388 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:13.478285 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:13.488316 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47623919-3f72-45e5-9c9c-fdaa84d269a2 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:13.512566 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91c3a4-465f-4012-be1b-db1df20872a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:13.513231 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91c3a4-465f-4012-be1b-db1df20872a6 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:13.513519 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91c3a4-465f-4012-be1b-db1df20872a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:13.513802 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91c3a4-465f-4012-be1b-db1df20872a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:13.514527 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a91c3a4-465f-4012-be1b-db1df20872a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:13.514836 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a91c3a4-465f-4012-be1b-db1df20872a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:13.516235 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a91c3a4-465f-4012-be1b-db1df20872a6 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:13.522082 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a0b2d-9bec-4ad1-a14b-ae254fe181a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:13.522876 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a0b2d-9bec-4ad1-a14b-ae254fe181a2 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:13.523159 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a0b2d-9bec-4ad1-a14b-ae254fe181a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:13.523437 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a0b2d-9bec-4ad1-a14b-ae254fe181a2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:13.528232 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 256/521] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:53:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:13.529018 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91c3a4-465f-4012-be1b-db1df20872a6 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:13.531241 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615a0b2d-9bec-4ad1-a14b-ae254fe181a2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:13.532765 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615a0b2d-9bec-4ad1-a14b-ae254fe181a2 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:13.547471 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-615a0b2d-9bec-4ad1-a14b-ae254fe181a2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 08 11:53:13.547471 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:13.547471 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:13.547471 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:13.547471 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:13.547471 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:13.547471 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:13.547471 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:13.547471 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:13.547471 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:13.547471 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:13.547471 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:13.547471 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 11:53:13.547471 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 11:53:13.547471 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 11:53:13.547471 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 11:53:13.548433 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:13.548433 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:13.548433 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 11:53:13.548433 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:53:13.548433 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 11:53:13.548433 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:53:13.548433 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:13.548433 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:13.548433 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:13.548433 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:13.548433 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:13.548433 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:13.548433 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:13.548433 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:13.548433 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:13.548433 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:13.548433 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:13.548433 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:13.549330 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:13.549330 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:13.549330 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 11:53:13.549330 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 11:53:13.549330 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 11:53:13.549330 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 11:53:13.549330 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 11:53:13.549330 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 11:53:13.549330 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 08 11:53:13.549330 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:13.549330 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 266/522] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Jun 8 11:53:13 2022] GET /identity/v3/users/neutron => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:13.549889 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a0b2d-9bec-4ad1-a14b-ae254fe181a2 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:13.633031 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91c3a4-465f-4012-be1b-db1df20872a6 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:13.653302 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a0b2d-9bec-4ad1-a14b-ae254fe181a2 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:13.666667 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d101a0ac-815a-48e4-b32a-943df6fd39a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:13.667340 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101a0ac-815a-48e4-b32a-943df6fd39a6 None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:13.667625 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101a0ac-815a-48e4-b32a-943df6fd39a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:13.667904 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101a0ac-815a-48e4-b32a-943df6fd39a6 None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:13.668644 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d101a0ac-815a-48e4-b32a-943df6fd39a6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:13.670089 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d101a0ac-815a-48e4-b32a-943df6fd39a6 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:13.687611 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d87c3-1b6d-42f2-b3e1-6b6ebfb7a354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:13.688319 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d87c3-1b6d-42f2-b3e1-6b6ebfb7a354 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:13.688608 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d87c3-1b6d-42f2-b3e1-6b6ebfb7a354 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:13.688885 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d87c3-1b6d-42f2-b3e1-6b6ebfb7a354 None admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:13.689686 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d87c3-1b6d-42f2-b3e1-6b6ebfb7a354 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:13.689806 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 257/523] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Jun 8 11:53:13 2022] POST /identity/v3/users => generated 247 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 11:53:13.690000 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d87c3-1b6d-42f2-b3e1-6b6ebfb7a354 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:13.690486 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d101a0ac-815a-48e4-b32a-943df6fd39a6 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:13.691450 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d87c3-1b6d-42f2-b3e1-6b6ebfb7a354 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:13.712306 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 267/524] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Jun 8 11:53:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:13.714588 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d87c3-1b6d-42f2-b3e1-6b6ebfb7a354 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:13.724326 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:13.734222 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:13.822122 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d101a0ac-815a-48e4-b32a-943df6fd39a6 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:13.834709 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d87c3-1b6d-42f2-b3e1-6b6ebfb7a354 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:13.862475 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb21781-8857-4c46-8401-9c20a005a55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:13.863143 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb21781-8857-4c46-8401-9c20a005a55b None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:13.863431 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb21781-8857-4c46-8401-9c20a005a55b None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:13.863711 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb21781-8857-4c46-8401-9c20a005a55b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:13.876935 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c4152-d446-4a14-b3d2-557a76599498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:13.877755 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c4152-d446-4a14-b3d2-557a76599498 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:13.878037 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c4152-d446-4a14-b3d2-557a76599498 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:13.878313 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c4152-d446-4a14-b3d2-557a76599498 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:13.885974 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591c4152-d446-4a14-b3d2-557a76599498 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:13.887435 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591c4152-d446-4a14-b3d2-557a76599498 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:13.902619 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-591c4152-d446-4a14-b3d2-557a76599498 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:53:13.902619 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:13.902619 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:13.902619 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:13.902619 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:13.902619 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:13.902619 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:13.902619 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:13.902619 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:13.902619 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:13.902619 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:13.902619 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:13.902619 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 11:53:13.902619 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 11:53:13.902619 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 11:53:13.903638 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 11:53:13.903638 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:13.903638 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:13.903638 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:13.903638 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:13.903638 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:13.903638 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:13.903638 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:13.903638 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:13.903638 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:13.903638 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:13.903638 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:13.903638 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:13.903638 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:13.903638 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:13.903638 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:13.903638 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:13.904567 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 11:53:13.904567 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 11:53:13.904567 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 11:53:13.904567 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 11:53:13.904567 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 11:53:13.904567 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 11:53:13.904567 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:53:13.904567 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:13.906037 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 268/525] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Jun 8 11:53:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:13.906567 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c4152-d446-4a14-b3d2-557a76599498 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:13.949946 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb21781-8857-4c46-8401-9c20a005a55b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:13.951428 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb21781-8857-4c46-8401-9c20a005a55b None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:13.970178 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:13.990088 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:14.029223 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c4152-d446-4a14-b3d2-557a76599498 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:14.057522 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 258/526] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:53:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 11:53:14.058369 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb21781-8857-4c46-8401-9c20a005a55b None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:14.077741 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b286a-28a5-4ed9-bcf3-adc3acb3a8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:14.078656 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b286a-28a5-4ed9-bcf3-adc3acb3a8ab None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:14.079155 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b286a-28a5-4ed9-bcf3-adc3acb3a8ab None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:14.079696 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b286a-28a5-4ed9-bcf3-adc3acb3a8ab None admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:14.080575 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531b286a-28a5-4ed9-bcf3-adc3acb3a8ab None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:14.080895 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531b286a-28a5-4ed9-bcf3-adc3acb3a8ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:14.082338 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531b286a-28a5-4ed9-bcf3-adc3acb3a8ab None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:14.107485 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 269/527] 10.222.0.39 () {56 vars in 1139 bytes} [Wed Jun 8 11:53:13 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:14.107485 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b286a-28a5-4ed9-bcf3-adc3acb3a8ab None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:14.170724 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb21781-8857-4c46-8401-9c20a005a55b None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:14.189624 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:14.211430 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb71773-6a01-4b6b-9df7-0c5503817120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:14.212097 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb71773-6a01-4b6b-9df7-0c5503817120 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:14.212406 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb71773-6a01-4b6b-9df7-0c5503817120 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:14.212685 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb71773-6a01-4b6b-9df7-0c5503817120 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:14.213663 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b286a-28a5-4ed9-bcf3-adc3acb3a8ab None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:14.214093 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb71773-6a01-4b6b-9df7-0c5503817120 None admin] RBAC: Adding query filter params (role.id=125b7374688b4b009d443f1b34947c49, scope.project.id=6a7fee684e8b43e199c95aeeb92640d4, user.id=7ef7edb5e9ce49e6b098f48bf060b228) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:14.214407 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb71773-6a01-4b6b-9df7-0c5503817120 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:14.215876 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb71773-6a01-4b6b-9df7-0c5503817120 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:14.221936 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 259/528] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Jun 8 11:53:14 2022] GET /identity/v3/role_assignments?user.id=7ef7edb5e9ce49e6b098f48bf060b228&scope.project.id=6a7fee684e8b43e199c95aeeb92640d4&role.id=125b7374688b4b009d443f1b34947c49 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:14.222484 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb71773-6a01-4b6b-9df7-0c5503817120 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:14.275219 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:14.284561 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efcf226-f9cd-4890-9603-97b1d02f0b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:14.286268 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcf226-f9cd-4890-9603-97b1d02f0b72 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:14.286757 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcf226-f9cd-4890-9603-97b1d02f0b72 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:14.287181 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcf226-f9cd-4890-9603-97b1d02f0b72 None admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:14.288485 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efcf226-f9cd-4890-9603-97b1d02f0b72 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:14.289002 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efcf226-f9cd-4890-9603-97b1d02f0b72 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:14.292401 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efcf226-f9cd-4890-9603-97b1d02f0b72 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:14.311571 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 270/529] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Jun 8 11:53:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:14.312876 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efcf226-f9cd-4890-9603-97b1d02f0b72 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:14.349216 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb71773-6a01-4b6b-9df7-0c5503817120 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:14.396842 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe411e8e-d9e8-4d14-83b2-fac41e8b5165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:14.398571 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe411e8e-d9e8-4d14-83b2-fac41e8b5165 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:14.398571 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe411e8e-d9e8-4d14-83b2-fac41e8b5165 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:14.398571 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe411e8e-d9e8-4d14-83b2-fac41e8b5165 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:14.412434 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe411e8e-d9e8-4d14-83b2-fac41e8b5165 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:14.414185 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe411e8e-d9e8-4d14-83b2-fac41e8b5165 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:14.433998 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-fe411e8e-d9e8-4d14-83b2-fac41e8b5165 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:14.433998 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:14.433998 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:14.433998 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:14.433998 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:14.433998 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:14.433998 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:14.433998 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:14.433998 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:14.433998 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:14.433998 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:14.433998 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:14.433998 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:53:14.433998 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:53:14.433998 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:53:14.435091 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:53:14.435091 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:14.435091 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:14.435091 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:14.435091 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:14.435091 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:14.435091 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:14.435091 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:14.435091 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:14.435091 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:14.435091 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:14.435091 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:14.435091 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:14.435091 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:14.435091 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:14.435091 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:14.435091 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:14.436124 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:53:14.436124 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:53:14.436124 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:14.436124 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:14.437510 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 260/530] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:53:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:14.438126 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe411e8e-d9e8-4d14-83b2-fac41e8b5165 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:14.458122 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efcf226-f9cd-4890-9603-97b1d02f0b72 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:14.484378 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:14.501706 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af57820-4a95-4a35-9210-bee22bd7360a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:14.502605 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af57820-4a95-4a35-9210-bee22bd7360a None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:14.503036 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af57820-4a95-4a35-9210-bee22bd7360a None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:14.503529 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af57820-4a95-4a35-9210-bee22bd7360a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:14.554270 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe411e8e-d9e8-4d14-83b2-fac41e8b5165 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:14.574414 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:14.586767 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af57820-4a95-4a35-9210-bee22bd7360a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:14.589713 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af57820-4a95-4a35-9210-bee22bd7360a None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:14.596849 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d6553-41ca-4f28-a755-af45738621c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:14.597575 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d6553-41ca-4f28-a755-af45738621c9 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:14.597857 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d6553-41ca-4f28-a755-af45738621c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:14.598133 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d6553-41ca-4f28-a755-af45738621c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:14.599277 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262d6553-41ca-4f28-a755-af45738621c9 None admin] RBAC: Adding query filter params (role.id=125b7374688b4b009d443f1b34947c49, scope.project.id=6a7fee684e8b43e199c95aeeb92640d4, user.id=2e2f8b5040a048c5bf4eef36f2ecd678) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:14.599586 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262d6553-41ca-4f28-a755-af45738621c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:14.601041 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262d6553-41ca-4f28-a755-af45738621c9 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:14.613429 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 261/531] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Jun 8 11:53:14 2022] GET /identity/v3/role_assignments?user.id=2e2f8b5040a048c5bf4eef36f2ecd678&scope.project.id=6a7fee684e8b43e199c95aeeb92640d4&role.id=125b7374688b4b009d443f1b34947c49 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:14.613429 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d6553-41ca-4f28-a755-af45738621c9 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:14.784659 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:14.788012 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d6553-41ca-4f28-a755-af45738621c9 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:14.803263 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 271/532] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:53:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 11:53:14.808841 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af57820-4a95-4a35-9210-bee22bd7360a None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:14.827698 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04750269-7175-463b-9046-cb7cd06d664b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:14.828409 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04750269-7175-463b-9046-cb7cd06d664b None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:14.828693 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04750269-7175-463b-9046-cb7cd06d664b None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:14.828979 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04750269-7175-463b-9046-cb7cd06d664b None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:14.829700 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04750269-7175-463b-9046-cb7cd06d664b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:14.830007 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04750269-7175-463b-9046-cb7cd06d664b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:14.831394 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04750269-7175-463b-9046-cb7cd06d664b None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:14.844306 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 262/533] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:53:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:14.854835 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04750269-7175-463b-9046-cb7cd06d664b None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:14.976781 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:14.999330 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af57820-4a95-4a35-9210-bee22bd7360a None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:15.049620 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04750269-7175-463b-9046-cb7cd06d664b None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:15.069651 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852860f-38e1-4844-9031-3eff677f5d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:15.070489 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852860f-38e1-4844-9031-3eff677f5d24 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:15.070786 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852860f-38e1-4844-9031-3eff677f5d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:15.071063 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852860f-38e1-4844-9031-3eff677f5d24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:15.090895 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cbd83a-5c44-4891-b424-1185f8554c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:15.091697 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbd83a-5c44-4891-b424-1185f8554c34 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:15.091974 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbd83a-5c44-4891-b424-1185f8554c34 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:15.092267 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbd83a-5c44-4891-b424-1185f8554c34 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:15.093370 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b852860f-38e1-4844-9031-3eff677f5d24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:15.095065 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b852860f-38e1-4844-9031-3eff677f5d24 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:15.099665 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cbd83a-5c44-4891-b424-1185f8554c34 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:15.101120 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cbd83a-5c44-4891-b424-1185f8554c34 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:15.115880 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-80cbd83a-5c44-4891-b424-1185f8554c34 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:53:15.115880 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:15.115880 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:15.115880 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:15.115880 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:15.115880 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:15.115880 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:15.115880 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:15.115880 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:15.115880 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:15.115880 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:15.115880 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:15.115880 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 11:53:15.115880 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 11:53:15.115880 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 11:53:15.116798 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 11:53:15.116798 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:15.116798 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:15.116798 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:15.116798 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:15.116798 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:15.116798 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:15.116798 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:15.116798 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:15.116798 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:15.116798 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:15.116798 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:15.116798 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:15.116798 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:15.116798 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:15.116798 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:15.116798 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:15.117622 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 11:53:15.117622 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 11:53:15.117622 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 11:53:15.117622 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 11:53:15.117622 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 11:53:15.117622 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 11:53:15.117622 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:53:15.117622 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:15.117622 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 263/534] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Jun 8 11:53:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:15.123006 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cbd83a-5c44-4891-b424-1185f8554c34 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:15.139330 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-b852860f-38e1-4844-9031-3eff677f5d24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:15.139330 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:15.139330 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:15.139330 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:15.139330 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:15.139330 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:15.139330 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:15.139330 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:15.139330 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:15.139330 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:15.139330 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:15.139330 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:15.139330 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:53:15.139330 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:53:15.139330 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:53:15.140245 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:53:15.140245 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:15.140245 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:15.140245 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:15.140245 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:15.140245 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:15.140245 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:15.140245 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:15.140245 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:15.140245 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:15.140245 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:15.140245 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:15.140245 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:15.140245 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:15.140245 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:15.140245 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:15.140245 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:15.142474 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:53:15.142474 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:53:15.142474 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:15.142474 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:15.142474 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 272/535] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:53:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:15.145975 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852860f-38e1-4844-9031-3eff677f5d24 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:15.164530 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:15.258029 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cbd83a-5c44-4891-b424-1185f8554c34 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:15.293159 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d33ba-7049-4bdc-a75a-68617c2fb298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:15.293826 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d33ba-7049-4bdc-a75a-68617c2fb298 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:15.294224 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d33ba-7049-4bdc-a75a-68617c2fb298 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:15.294507 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d33ba-7049-4bdc-a75a-68617c2fb298 None admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:15.300197 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d33ba-7049-4bdc-a75a-68617c2fb298 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:15.300197 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d33ba-7049-4bdc-a75a-68617c2fb298 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:15.300197 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d33ba-7049-4bdc-a75a-68617c2fb298 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:15.315708 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 264/536] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Jun 8 11:53:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:15.325169 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d33ba-7049-4bdc-a75a-68617c2fb298 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:15.378316 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852860f-38e1-4844-9031-3eff677f5d24 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:15.425701 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:15.446158 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d33ba-7049-4bdc-a75a-68617c2fb298 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:15.453503 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efe420-0eb8-4609-b1f4-6afaf77c79f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:15.454180 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efe420-0eb8-4609-b1f4-6afaf77c79f1 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:15.454857 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efe420-0eb8-4609-b1f4-6afaf77c79f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:15.455162 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efe420-0eb8-4609-b1f4-6afaf77c79f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:15.455892 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41efe420-0eb8-4609-b1f4-6afaf77c79f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:15.456218 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41efe420-0eb8-4609-b1f4-6afaf77c79f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:15.457597 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41efe420-0eb8-4609-b1f4-6afaf77c79f1 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:15.478639 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 273/537] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:53:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:15.488467 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efe420-0eb8-4609-b1f4-6afaf77c79f1 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:15.491391 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:15.523481 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d459d-94a5-460a-87f9-9bed74701fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:15.524161 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d459d-94a5-460a-87f9-9bed74701fae None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:15.524467 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d459d-94a5-460a-87f9-9bed74701fae None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:15.524743 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d459d-94a5-460a-87f9-9bed74701fae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:15.525638 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523d459d-94a5-460a-87f9-9bed74701fae None admin] RBAC: Adding query filter params (role.id=125b7374688b4b009d443f1b34947c49, scope.project.id=6a7fee684e8b43e199c95aeeb92640d4, user.id=a2d235956e984676be738414b948bde3) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:15.526178 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523d459d-94a5-460a-87f9-9bed74701fae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:15.527904 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523d459d-94a5-460a-87f9-9bed74701fae None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:15.539943 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 265/538] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Jun 8 11:53:15 2022] GET /identity/v3/role_assignments?user.id=a2d235956e984676be738414b948bde3&scope.project.id=6a7fee684e8b43e199c95aeeb92640d4&role.id=125b7374688b4b009d443f1b34947c49 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:15.654919 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efe420-0eb8-4609-b1f4-6afaf77c79f1 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:15.716972 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d8a11c-703a-4f79-a6cb-edb181c7fd9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:15.717808 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8a11c-703a-4f79-a6cb-edb181c7fd9a None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:15.718094 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8a11c-703a-4f79-a6cb-edb181c7fd9a None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:15.718373 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8a11c-703a-4f79-a6cb-edb181c7fd9a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:15.726476 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d8a11c-703a-4f79-a6cb-edb181c7fd9a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:15.727958 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d8a11c-703a-4f79-a6cb-edb181c7fd9a None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:15.743982 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-16d8a11c-703a-4f79-a6cb-edb181c7fd9a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:53:15.743982 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:15.743982 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:15.743982 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:15.743982 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:15.743982 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:15.743982 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:15.743982 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:15.743982 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:15.743982 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:15.743982 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:15.743982 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:15.743982 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 11:53:15.743982 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 11:53:15.743982 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 11:53:15.745795 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 11:53:15.745795 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:15.745795 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:15.745795 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:15.745795 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:15.745795 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:15.745795 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:15.745795 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:15.745795 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:15.745795 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:15.745795 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:15.745795 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:15.745795 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:15.745795 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:15.745795 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:15.745795 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:15.745795 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:15.746882 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 11:53:15.746882 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 11:53:15.746882 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 11:53:15.746882 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 11:53:15.746882 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 11:53:15.746882 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 11:53:15.746882 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:53:15.746882 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:15.746882 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 274/539] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Jun 8 11:53:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:15.757397 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d459d-94a5-460a-87f9-9bed74701fae None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:15.890047 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d459d-94a5-460a-87f9-9bed74701fae None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:15.934188 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5aeb9-adef-461a-a5e0-b5e558108d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:15.934860 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5aeb9-adef-461a-a5e0-b5e558108d1f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:15.935154 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5aeb9-adef-461a-a5e0-b5e558108d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:15.935431 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5aeb9-adef-461a-a5e0-b5e558108d1f None admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:15.936244 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c5aeb9-adef-461a-a5e0-b5e558108d1f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:15.936558 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c5aeb9-adef-461a-a5e0-b5e558108d1f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:15.937995 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c5aeb9-adef-461a-a5e0-b5e558108d1f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:15.961466 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 266/540] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Jun 8 11:53:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:15.967364 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d8a11c-703a-4f79-a6cb-edb181c7fd9a None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:16.057848 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:16.109104 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d8a11c-703a-4f79-a6cb-edb181c7fd9a None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:16.145325 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce618e6c-6307-4d4b-a53e-6597f1c18074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:16.145905 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce618e6c-6307-4d4b-a53e-6597f1c18074 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:16.146188 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce618e6c-6307-4d4b-a53e-6597f1c18074 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:16.146524 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce618e6c-6307-4d4b-a53e-6597f1c18074 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:16.147387 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce618e6c-6307-4d4b-a53e-6597f1c18074 None admin] RBAC: Adding query filter params (role.id=125b7374688b4b009d443f1b34947c49, scope.project.id=6a7fee684e8b43e199c95aeeb92640d4, user.id=2fef074aa2ea4570928109f62ea1aa96) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:16.147709 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce618e6c-6307-4d4b-a53e-6597f1c18074 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:16.149177 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce618e6c-6307-4d4b-a53e-6597f1c18074 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:16.156111 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 275/541] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Jun 8 11:53:15 2022] GET /identity/v3/role_assignments?user.id=2fef074aa2ea4570928109f62ea1aa96&scope.project.id=6a7fee684e8b43e199c95aeeb92640d4&role.id=125b7374688b4b009d443f1b34947c49 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:16.179697 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0409f-ba46-4ae0-8151-e85cb7b98f0c None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:16.180037 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0409f-ba46-4ae0-8151-e85cb7b98f0c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:16.180295 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0409f-ba46-4ae0-8151-e85cb7b98f0c None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:16.182321 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 267/542] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:53:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:53:16.187857 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befdf17-86b5-41e6-850a-7c339b635929 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:16.188140 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befdf17-86b5-41e6-850a-7c339b635929 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:16.188444 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befdf17-86b5-41e6-850a-7c339b635929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:16.211549 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-1befdf17-86b5-41e6-850a-7c339b635929 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:53:16.212780 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-1befdf17-86b5-41e6-850a-7c339b635929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:53:16.304199 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 276/543] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:53:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:53:16.342696 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0409f-ba46-4ae0-8151-e85cb7b98f0c None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:16.346370 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:16.486478 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0409f-ba46-4ae0-8151-e85cb7b98f0c None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:16.523564 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68d7773-707d-47c7-8f78-d76b224aa665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:16.524428 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d7773-707d-47c7-8f78-d76b224aa665 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:16.524711 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d7773-707d-47c7-8f78-d76b224aa665 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:16.524983 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d7773-707d-47c7-8f78-d76b224aa665 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:16.536253 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68d7773-707d-47c7-8f78-d76b224aa665 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:53:16.544766 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-b68d7773-707d-47c7-8f78-d76b224aa665 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 11:53:16.544766 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:16.544766 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:16.544766 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:16.544766 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:16.544766 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:16.544766 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:16.544766 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:16.544766 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:16.544766 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:16.544766 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:16.544766 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:16.544766 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:53:16.544766 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:53:16.544766 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:53:16.544766 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:53:16.545630 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:53:16.545630 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:53:16.545630 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:53:16.545630 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:53:16.545630 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:16.545630 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:16.545630 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:16.545630 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:16.545630 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:16.545630 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:16.545630 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:16.545630 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:16.545630 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:16.545630 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:16.545630 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:16.545630 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:16.546404 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:16.546404 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:16.546404 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:16.546404 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:16.546404 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:53:16.546404 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:53:16.546404 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:53:16.546404 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:53:16.546404 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:53:16.546404 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:53:16.546404 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 11:53:16.546404 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:16.546404 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 268/544] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Jun 8 11:53:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:16.552897 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1befdf17-86b5-41e6-850a-7c339b635929 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:16.668014 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:16.725425 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1befdf17-86b5-41e6-850a-7c339b635929 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:16.771307 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e11dc-3ae0-4185-ae7e-7fe048bd3330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:16.771895 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e11dc-3ae0-4185-ae7e-7fe048bd3330 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:16.772190 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e11dc-3ae0-4185-ae7e-7fe048bd3330 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:16.772495 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e11dc-3ae0-4185-ae7e-7fe048bd3330 None admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:16.773352 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e11dc-3ae0-4185-ae7e-7fe048bd3330 None admin] RBAC: Adding query filter params (name=service) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:16.773664 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e11dc-3ae0-4185-ae7e-7fe048bd3330 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:16.775027 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e11dc-3ae0-4185-ae7e-7fe048bd3330 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:16.787683 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 277/545] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Jun 8 11:53:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:16.795621 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68d7773-707d-47c7-8f78-d76b224aa665 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:16.862248 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:16.905360 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68d7773-707d-47c7-8f78-d76b224aa665 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:16.939816 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f39b8-10dc-44fc-9ee4-3b872f73a7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:16.940650 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f39b8-10dc-44fc-9ee4-3b872f73a7fe None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:16.940940 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f39b8-10dc-44fc-9ee4-3b872f73a7fe None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:16.941217 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f39b8-10dc-44fc-9ee4-3b872f73a7fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:16.952861 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f39b8-10dc-44fc-9ee4-3b872f73a7fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:16.954324 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f39b8-10dc-44fc-9ee4-3b872f73a7fe None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:16.971709 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-4e1f39b8-10dc-44fc-9ee4-3b872f73a7fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:16.971709 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:16.971709 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:16.971709 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:16.971709 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:16.971709 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:16.971709 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:16.971709 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:16.971709 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:16.971709 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:16.971709 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:16.971709 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:16.971709 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:53:16.971709 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:53:16.971709 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:53:16.972632 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:53:16.972632 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:16.972632 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:16.972632 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:16.972632 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:16.972632 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:16.972632 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:16.972632 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:16.972632 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:16.972632 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:16.972632 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:16.972632 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:16.972632 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:16.972632 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:16.972632 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:16.972632 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:16.972632 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:16.973724 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:53:16.973724 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:53:16.973724 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:16.973724 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:16.973724 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 269/546] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:53:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:16.981275 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e11dc-3ae0-4185-ae7e-7fe048bd3330 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:17.103186 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e11dc-3ae0-4185-ae7e-7fe048bd3330 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:17.128264 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:17.148462 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea2c87-b7d5-420f-9f1a-bea79cb9b3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:17.149467 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea2c87-b7d5-420f-9f1a-bea79cb9b3be None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:17.149890 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea2c87-b7d5-420f-9f1a-bea79cb9b3be None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:17.150320 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea2c87-b7d5-420f-9f1a-bea79cb9b3be None admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:17.151848 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbea2c87-b7d5-420f-9f1a-bea79cb9b3be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:17.152321 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbea2c87-b7d5-420f-9f1a-bea79cb9b3be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:17.153845 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbea2c87-b7d5-420f-9f1a-bea79cb9b3be None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:17.162423 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76472aa3-57a4-47bb-9d47-343b95d5fc02 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:17.162940 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76472aa3-57a4-47bb-9d47-343b95d5fc02 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:17.163359 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76472aa3-57a4-47bb-9d47-343b95d5fc02 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:17.165131 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 270/547] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:53:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:53:17.172358 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c62c6b-1ba0-4e33-853d-cad8dafbe98c None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:17.172829 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c62c6b-1ba0-4e33-853d-cad8dafbe98c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:17.173244 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c62c6b-1ba0-4e33-853d-cad8dafbe98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:17.193165 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 278/548] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:53:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:17.199477 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-a4c62c6b-1ba0-4e33-853d-cad8dafbe98c None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:53:17.200558 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea2c87-b7d5-420f-9f1a-bea79cb9b3be None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:17.211367 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a4c62c6b-1ba0-4e33-853d-cad8dafbe98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:53:17.372800 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 271/549] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:53:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 11:53:17.395521 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea2c87-b7d5-420f-9f1a-bea79cb9b3be None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:17.410175 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c62c6b-1ba0-4e33-853d-cad8dafbe98c None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:17.455885 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d29370-709b-42e9-b2a0-a15da242421f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:17.457285 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d29370-709b-42e9-b2a0-a15da242421f None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:17.457802 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d29370-709b-42e9-b2a0-a15da242421f None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:17.458315 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d29370-709b-42e9-b2a0-a15da242421f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:17.469668 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d29370-709b-42e9-b2a0-a15da242421f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:17.471962 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d29370-709b-42e9-b2a0-a15da242421f None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:17.492836 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-f8d29370-709b-42e9-b2a0-a15da242421f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 08 11:53:17.492836 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:17.492836 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:17.492836 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:17.492836 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:17.492836 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:17.492836 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:17.492836 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:17.492836 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:17.492836 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:17.492836 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:17.492836 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:17.492836 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 11:53:17.492836 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 11:53:17.492836 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 11:53:17.492836 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 11:53:17.495110 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:17.495110 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:17.495110 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 11:53:17.495110 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:53:17.495110 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 11:53:17.495110 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:53:17.495110 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:17.495110 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:17.495110 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:17.495110 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:17.495110 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:17.495110 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:17.495110 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:17.495110 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:17.495110 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:17.495110 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:17.495110 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:17.495110 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:17.499568 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:17.499568 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:17.499568 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 11:53:17.499568 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 11:53:17.499568 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 11:53:17.499568 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 11:53:17.499568 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 11:53:17.499568 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 11:53:17.499568 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 08 11:53:17.499568 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:17.503627 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 279/550] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Jun 8 11:53:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 11:53:17.508653 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d29370-709b-42e9-b2a0-a15da242421f None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:17.522195 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:17.604283 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:17.608488 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c62c6b-1ba0-4e33-853d-cad8dafbe98c None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:17.654342 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc54ebe-09d7-430c-847a-f99faae808a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:17.655952 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc54ebe-09d7-430c-847a-f99faae808a3 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:17.656371 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc54ebe-09d7-430c-847a-f99faae808a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:17.656758 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc54ebe-09d7-430c-847a-f99faae808a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:17.668726 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d29370-709b-42e9-b2a0-a15da242421f None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:17.673228 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc54ebe-09d7-430c-847a-f99faae808a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:53:17.683495 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-dfc54ebe-09d7-430c-847a-f99faae808a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 11:53:17.683495 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:17.683495 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:17.683495 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:17.683495 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:17.683495 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:17.683495 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:17.683495 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:17.683495 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:17.683495 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:17.683495 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:17.683495 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:17.683495 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:53:17.683495 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:53:17.683495 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:53:17.683495 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:53:17.684611 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:53:17.684611 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:53:17.684611 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:53:17.684611 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:53:17.684611 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:17.684611 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:17.684611 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:17.684611 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:17.684611 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:17.684611 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:17.684611 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:17.684611 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:17.684611 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:17.684611 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:17.684611 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:17.684611 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:17.685585 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:17.685585 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:17.685585 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:17.685585 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:17.685585 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:53:17.685585 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:53:17.685585 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:53:17.685585 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:53:17.685585 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:53:17.685585 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:53:17.685585 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 11:53:17.685585 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:17.688240 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 272/551] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Jun 8 11:53:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 11:53:17.689741 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10568d66-bc5a-4d0a-b36b-0ce76146a90c None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:17.690218 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10568d66-bc5a-4d0a-b36b-0ce76146a90c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:17.690661 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10568d66-bc5a-4d0a-b36b-0ce76146a90c None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:17.692554 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 273/552] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:53:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:53:17.694487 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10568d66-bc5a-4d0a-b36b-0ce76146a90c None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:17.734188 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e4999-8ed6-4e1c-a120-d4310e53e4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:17.735507 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e4999-8ed6-4e1c-a120-d4310e53e4fc None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:17.735794 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e4999-8ed6-4e1c-a120-d4310e53e4fc None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:17.736067 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e4999-8ed6-4e1c-a120-d4310e53e4fc None admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:17.737104 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92e4999-8ed6-4e1c-a120-d4310e53e4fc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:17.737420 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92e4999-8ed6-4e1c-a120-d4310e53e4fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:17.738902 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92e4999-8ed6-4e1c-a120-d4310e53e4fc None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:17.767486 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 280/553] 10.222.0.39 () {56 vars in 1135 bytes} [Wed Jun 8 11:53:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:53:17.769112 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12b25e-0773-4cc6-8d05-0e20ea043906 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:17.769501 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12b25e-0773-4cc6-8d05-0e20ea043906 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:17.770705 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12b25e-0773-4cc6-8d05-0e20ea043906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:17.794217 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-8b12b25e-0773-4cc6-8d05-0e20ea043906 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:53:17.795588 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-8b12b25e-0773-4cc6-8d05-0e20ea043906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:53:17.845677 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10568d66-bc5a-4d0a-b36b-0ce76146a90c None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:17.849193 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:17.892215 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 281/554] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:53:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:53:17.893625 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b12b25e-0773-4cc6-8d05-0e20ea043906 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:17.899301 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad6644-583f-4f70-ab6e-d69a3651fc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:17.900345 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad6644-583f-4f70-ab6e-d69a3651fc26 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:17.901277 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad6644-583f-4f70-ab6e-d69a3651fc26 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:17.901537 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad6644-583f-4f70-ab6e-d69a3651fc26 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:17.902789 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad6644-583f-4f70-ab6e-d69a3651fc26 None admin] RBAC: Adding query filter params (name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:17.903157 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad6644-583f-4f70-ab6e-d69a3651fc26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:17.904675 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad6644-583f-4f70-ab6e-d69a3651fc26 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:17.924206 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 274/555] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Jun 8 11:53:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:17.924206 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad6644-583f-4f70-ab6e-d69a3651fc26 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:17.943898 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:18.029024 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b12b25e-0773-4cc6-8d05-0e20ea043906 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:18.057885 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad6644-583f-4f70-ab6e-d69a3651fc26 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:18.068835 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e73e1-a5c2-4762-a97f-d019395d0986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:18.069589 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e73e1-a5c2-4762-a97f-d019395d0986 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:18.069874 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e73e1-a5c2-4762-a97f-d019395d0986 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:18.070155 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e73e1-a5c2-4762-a97f-d019395d0986 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:18.106660 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd2bb2-b756-4328-a550-8b5dcc5f7c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:18.107507 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd2bb2-b756-4328-a550-8b5dcc5f7c78 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:18.107783 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd2bb2-b756-4328-a550-8b5dcc5f7c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:18.108195 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd2bb2-b756-4328-a550-8b5dcc5f7c78 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:18.123289 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd2bb2-b756-4328-a550-8b5dcc5f7c78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:53:18.131848 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-acfd2bb2-b756-4328-a550-8b5dcc5f7c78 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 11:53:18.131848 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:18.131848 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:18.131848 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:18.131848 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:18.131848 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:18.131848 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:18.131848 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:18.131848 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:18.131848 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:18.131848 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:18.131848 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:18.131848 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:53:18.131848 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:53:18.131848 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:53:18.131848 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:53:18.132805 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:53:18.132805 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:53:18.132805 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:53:18.132805 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:53:18.132805 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:18.132805 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:18.132805 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:18.132805 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:18.132805 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:18.132805 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:18.132805 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:18.132805 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:18.132805 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:18.132805 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:18.132805 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:18.132805 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:18.133597 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:18.133597 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:18.133597 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:18.133597 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:18.133597 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:53:18.133597 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:53:18.133597 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:53:18.133597 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:53:18.133597 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:53:18.133597 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:53:18.133597 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 11:53:18.133597 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:18.133597 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 275/556] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Jun 8 11:53:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:18.134264 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd2bb2-b756-4328-a550-8b5dcc5f7c78 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:18.165150 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9e73e1-a5c2-4762-a97f-d019395d0986 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:18.167706 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9e73e1-a5c2-4762-a97f-d019395d0986 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:18.173801 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:18.201271 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:18.276149 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd2bb2-b756-4328-a550-8b5dcc5f7c78 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:18.293332 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 282/557] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:53:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 11:53:18.294591 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e73e1-a5c2-4762-a97f-d019395d0986 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:18.331084 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7bb835-dfb3-4e4c-afc4-bc328c9d0eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:18.332461 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7bb835-dfb3-4e4c-afc4-bc328c9d0eab None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:18.333190 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7bb835-dfb3-4e4c-afc4-bc328c9d0eab None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:18.333658 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7bb835-dfb3-4e4c-afc4-bc328c9d0eab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:18.349759 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7bb835-dfb3-4e4c-afc4-bc328c9d0eab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:18.351997 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7bb835-dfb3-4e4c-afc4-bc328c9d0eab None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:18.377135 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-be7bb835-dfb3-4e4c-afc4-bc328c9d0eab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:18.377135 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:18.377135 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:18.377135 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:18.377135 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:18.377135 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:18.377135 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:18.377135 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:18.377135 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:18.377135 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:18.377135 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:18.377135 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:18.377135 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:53:18.377135 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:53:18.377135 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:53:18.379181 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:53:18.379181 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:18.379181 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:18.379181 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:18.379181 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:18.379181 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:18.379181 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:18.379181 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:18.379181 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:18.379181 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:18.379181 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:18.379181 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:18.379181 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:18.379181 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:18.379181 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:18.379181 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:18.379181 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:18.380277 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:53:18.380277 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:53:18.380277 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:18.380277 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:18.383074 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 276/558] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:53:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:18.384353 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7bb835-dfb3-4e4c-afc4-bc328c9d0eab None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:18.425191 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e73e1-a5c2-4762-a97f-d019395d0986 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:18.453084 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:18.462377 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff723c7e-d6c5-49ee-9030-ad0d4b3bb649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:18.463132 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff723c7e-d6c5-49ee-9030-ad0d4b3bb649 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:18.463601 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff723c7e-d6c5-49ee-9030-ad0d4b3bb649 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:18.463885 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff723c7e-d6c5-49ee-9030-ad0d4b3bb649 None admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:18.464677 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff723c7e-d6c5-49ee-9030-ad0d4b3bb649 None admin] RBAC: Adding query filter params (name=service) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:18.464992 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff723c7e-d6c5-49ee-9030-ad0d4b3bb649 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:18.466377 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff723c7e-d6c5-49ee-9030-ad0d4b3bb649 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:18.475160 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 283/559] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Jun 8 11:53:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:18.476416 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff723c7e-d6c5-49ee-9030-ad0d4b3bb649 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:18.481207 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:18.507016 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7bb835-dfb3-4e4c-afc4-bc328c9d0eab None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:18.544431 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7169f019-2929-4427-860d-b6bde09501f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:18.545245 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169f019-2929-4427-860d-b6bde09501f7 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:18.545652 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169f019-2929-4427-860d-b6bde09501f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:18.545931 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169f019-2929-4427-860d-b6bde09501f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:18.557934 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7169f019-2929-4427-860d-b6bde09501f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:18.559506 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7169f019-2929-4427-860d-b6bde09501f7 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:18.580957 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-7169f019-2929-4427-860d-b6bde09501f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:18.580957 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:18.580957 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:18.580957 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:18.580957 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:18.580957 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:18.580957 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:18.580957 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:18.580957 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:18.580957 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:18.580957 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:18.580957 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:18.580957 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:53:18.580957 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:53:18.580957 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:53:18.582007 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:53:18.582007 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:18.582007 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:18.582007 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:18.582007 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:18.582007 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:18.582007 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:18.582007 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:18.582007 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:18.582007 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:18.582007 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:18.582007 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:18.582007 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:18.582007 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:18.582007 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:18.582007 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:18.582007 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:18.582892 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:53:18.582892 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:53:18.582892 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:18.582892 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:18.582892 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 277/560] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:53:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:18.588399 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6b391-b618-4961-90b0-743df9bf43e6 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:18.588399 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6b391-b618-4961-90b0-743df9bf43e6 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:18.588399 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6b391-b618-4961-90b0-743df9bf43e6 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:18.588399 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 278/561] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:53:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:53:18.588399 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6b391-b618-4961-90b0-743df9bf43e6 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:18.604910 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff723c7e-d6c5-49ee-9030-ad0d4b3bb649 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:18.644627 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de39f39-f464-48ce-877f-6275a563edbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:18.645674 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de39f39-f464-48ce-877f-6275a563edbf None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:18.645962 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de39f39-f464-48ce-877f-6275a563edbf None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:18.646503 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de39f39-f464-48ce-877f-6275a563edbf None admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:18.647336 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de39f39-f464-48ce-877f-6275a563edbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:18.647751 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de39f39-f464-48ce-877f-6275a563edbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:18.649454 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de39f39-f464-48ce-877f-6275a563edbf None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:18.667419 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 284/562] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:53:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:18.668420 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de39f39-f464-48ce-877f-6275a563edbf None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:18.706561 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6b391-b618-4961-90b0-743df9bf43e6 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:18.718546 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:18.740092 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:18.747522 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc0437d-b403-4227-856f-2524be81eec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:18.748369 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0437d-b403-4227-856f-2524be81eec1 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:18.748655 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0437d-b403-4227-856f-2524be81eec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:18.749139 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0437d-b403-4227-856f-2524be81eec1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:18.761574 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc0437d-b403-4227-856f-2524be81eec1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:18.762977 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc0437d-b403-4227-856f-2524be81eec1 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:18.772918 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de39f39-f464-48ce-877f-6275a563edbf None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:18.781401 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-acc0437d-b403-4227-856f-2524be81eec1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:18.781401 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:18.781401 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:18.781401 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:18.781401 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:18.781401 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:18.781401 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:18.781401 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:18.781401 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:18.781401 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:18.781401 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:18.781401 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:18.781401 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:53:18.781401 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:53:18.781401 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:53:18.782294 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:53:18.782294 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:18.782294 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:18.782294 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:18.782294 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:18.782294 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:18.782294 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:18.782294 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:18.782294 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:18.782294 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:18.782294 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:18.782294 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:18.782294 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:18.782294 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:18.782294 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:18.782294 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:18.782294 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:18.788065 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:53:18.788065 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:53:18.788065 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:18.788065 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:18.788065 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 279/563] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:53:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:18.788065 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d34a1a-d74d-47d9-879e-194c5ab7907f None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:18.788065 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d34a1a-d74d-47d9-879e-194c5ab7907f None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:18.788065 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d34a1a-d74d-47d9-879e-194c5ab7907f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:18.805381 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-22d34a1a-d74d-47d9-879e-194c5ab7907f None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:53:18.806569 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-22d34a1a-d74d-47d9-879e-194c5ab7907f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:53:18.809458 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d0d73-afed-4454-a01b-5aadc9175671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:18.810134 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d0d73-afed-4454-a01b-5aadc9175671 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:18.810417 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d0d73-afed-4454-a01b-5aadc9175671 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:18.810689 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d0d73-afed-4454-a01b-5aadc9175671 None admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:18.811415 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3d0d73-afed-4454-a01b-5aadc9175671 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:18.811722 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3d0d73-afed-4454-a01b-5aadc9175671 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:18.813122 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3d0d73-afed-4454-a01b-5aadc9175671 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:18.830084 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 285/564] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:53:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:18.830084 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d0d73-afed-4454-a01b-5aadc9175671 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:18.896195 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 280/565] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:53:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:53:18.896195 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d34a1a-d74d-47d9-879e-194c5ab7907f None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:18.948010 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d0d73-afed-4454-a01b-5aadc9175671 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:18.956937 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:18.983478 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab17cf01-5d2b-45a9-8b6f-6bab1722b14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:18.984310 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17cf01-5d2b-45a9-8b6f-6bab1722b14b None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:18.984594 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17cf01-5d2b-45a9-8b6f-6bab1722b14b None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:18.984868 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17cf01-5d2b-45a9-8b6f-6bab1722b14b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:18.987263 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d34a1a-d74d-47d9-879e-194c5ab7907f None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:18.992131 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab17cf01-5d2b-45a9-8b6f-6bab1722b14b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:18.993596 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab17cf01-5d2b-45a9-8b6f-6bab1722b14b None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:19.000140 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:19.007699 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-ab17cf01-5d2b-45a9-8b6f-6bab1722b14b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 08 11:53:19.007699 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:19.007699 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:19.007699 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:19.007699 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:19.007699 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:19.007699 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:19.007699 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:19.007699 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:19.007699 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:19.007699 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:19.007699 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:19.007699 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 11:53:19.007699 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 11:53:19.007699 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 11:53:19.007699 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 11:53:19.008764 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:19.008764 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:19.008764 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 11:53:19.008764 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:53:19.008764 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 11:53:19.008764 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:53:19.008764 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:19.008764 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:19.008764 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:19.008764 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:19.008764 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:19.008764 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:19.008764 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:19.008764 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:19.008764 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:19.008764 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:19.008764 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:19.008764 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:19.009761 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:19.009761 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:19.009761 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 11:53:19.009761 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 11:53:19.009761 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 11:53:19.009761 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 11:53:19.009761 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 11:53:19.009761 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 11:53:19.009761 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 08 11:53:19.009761 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:19.009761 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 286/566] 10.222.0.39 () {56 vars in 1093 bytes} [Wed Jun 8 11:53:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:19.009761 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab17cf01-5d2b-45a9-8b6f-6bab1722b14b None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:19.023250 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c0f7e-fb88-4723-bc08-18f69435623a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:19.024261 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c0f7e-fb88-4723-bc08-18f69435623a None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:19.024564 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c0f7e-fb88-4723-bc08-18f69435623a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:19.024843 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c0f7e-fb88-4723-bc08-18f69435623a None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:19.026083 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5c0f7e-fb88-4723-bc08-18f69435623a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:19.026389 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5c0f7e-fb88-4723-bc08-18f69435623a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:19.027763 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5c0f7e-fb88-4723-bc08-18f69435623a None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:19.039203 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 281/567] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:53:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:19.039983 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c0f7e-fb88-4723-bc08-18f69435623a None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:19.116389 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab17cf01-5d2b-45a9-8b6f-6bab1722b14b None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:19.140132 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c0f7e-fb88-4723-bc08-18f69435623a None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:19.150903 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d0c2a-a80c-452f-8449-fa1e38f2e968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:19.151704 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d0c2a-a80c-452f-8449-fa1e38f2e968 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:19.151994 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d0c2a-a80c-452f-8449-fa1e38f2e968 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:19.152308 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d0c2a-a80c-452f-8449-fa1e38f2e968 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:19.158880 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8d0c2a-a80c-452f-8449-fa1e38f2e968 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:19.160352 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8d0c2a-a80c-452f-8449-fa1e38f2e968 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:19.172542 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034aee99-06bf-4379-9755-410889765269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:19.173332 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034aee99-06bf-4379-9755-410889765269 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:19.173614 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034aee99-06bf-4379-9755-410889765269 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:19.173891 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034aee99-06bf-4379-9755-410889765269 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:19.174465 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-be8d0c2a-a80c-452f-8449-fa1e38f2e968 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:53:19.174465 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:19.174465 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:19.174465 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:19.174465 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:19.174465 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:19.174465 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:19.174465 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:19.174465 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:19.174465 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:19.174465 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:19.174465 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:19.174465 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 11:53:19.174465 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 11:53:19.174465 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 11:53:19.175339 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 11:53:19.175339 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:19.175339 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:19.175339 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:19.175339 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:19.175339 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:19.175339 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:19.175339 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:19.175339 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:19.175339 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:19.175339 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:19.175339 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:19.175339 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:19.175339 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:19.175339 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:19.175339 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:19.175339 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:19.176527 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 11:53:19.176527 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 11:53:19.176527 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 11:53:19.176527 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 11:53:19.176527 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 11:53:19.176527 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 11:53:19.176527 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:53:19.176527 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:19.176527 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 287/568] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Jun 8 11:53:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:19.177054 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4da58-02c2-4bc7-8d21-307cac22d0b1 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:19.177278 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4da58-02c2-4bc7-8d21-307cac22d0b1 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:19.177560 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4da58-02c2-4bc7-8d21-307cac22d0b1 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:19.178794 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 288/569] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:53:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:53:19.179495 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac4da58-02c2-4bc7-8d21-307cac22d0b1 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:19.189766 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034aee99-06bf-4379-9755-410889765269 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:53:19.197648 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-034aee99-06bf-4379-9755-410889765269 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 11:53:19.197648 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:19.197648 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:19.197648 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:19.197648 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:19.197648 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:19.197648 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:19.197648 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:19.197648 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:19.197648 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:19.197648 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:19.197648 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:19.197648 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:53:19.197648 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:53:19.197648 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:53:19.197648 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:53:19.198761 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:53:19.198761 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:53:19.198761 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:53:19.198761 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:53:19.198761 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:19.198761 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:19.198761 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:19.198761 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:19.198761 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:19.198761 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:19.198761 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:19.198761 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:19.198761 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:19.198761 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:19.198761 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:19.198761 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:19.199609 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:19.199609 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:19.199609 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:19.199609 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:19.199609 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:53:19.199609 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:53:19.199609 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:53:19.199609 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:53:19.199609 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:53:19.199609 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:53:19.199609 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 11:53:19.199609 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:19.199609 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 282/570] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Jun 8 11:53:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:19.201154 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034aee99-06bf-4379-9755-410889765269 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:19.209301 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:19.231972 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:19.284691 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac4da58-02c2-4bc7-8d21-307cac22d0b1 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:19.300127 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034aee99-06bf-4379-9755-410889765269 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:19.318124 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed3105-0932-497f-8b3a-f37cfd72db5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:19.318793 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed3105-0932-497f-8b3a-f37cfd72db5c None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:19.319080 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed3105-0932-497f-8b3a-f37cfd72db5c None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:19.319357 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed3105-0932-497f-8b3a-f37cfd72db5c None admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:19.320208 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed3105-0932-497f-8b3a-f37cfd72db5c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:19.320520 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed3105-0932-497f-8b3a-f37cfd72db5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:19.321944 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed3105-0932-497f-8b3a-f37cfd72db5c None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:19.334299 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a188d-00e2-43c4-b50b-4e21d63d3c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:19.335088 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a188d-00e2-43c4-b50b-4e21d63d3c32 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:19.335368 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a188d-00e2-43c4-b50b-4e21d63d3c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:19.335633 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a188d-00e2-43c4-b50b-4e21d63d3c32 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:19.340563 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 289/571] 10.222.0.39 () {56 vars in 1133 bytes} [Wed Jun 8 11:53:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:19.341372 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed3105-0932-497f-8b3a-f37cfd72db5c None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:19.346322 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981a188d-00e2-43c4-b50b-4e21d63d3c32 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:19.347767 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981a188d-00e2-43c4-b50b-4e21d63d3c32 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:19.362493 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-981a188d-00e2-43c4-b50b-4e21d63d3c32 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 08 11:53:19.362493 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:19.362493 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:19.362493 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:19.362493 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:19.362493 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:19.362493 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:19.362493 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:19.362493 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:19.362493 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:19.362493 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:19.362493 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:19.362493 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 11:53:19.362493 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 11:53:19.362493 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 11:53:19.362493 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 11:53:19.363592 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:19.363592 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:19.363592 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 11:53:19.363592 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:53:19.363592 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 11:53:19.363592 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:53:19.363592 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:19.363592 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:19.363592 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:19.363592 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:19.363592 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:19.363592 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:19.363592 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:19.363592 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:19.363592 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:19.363592 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:19.363592 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:19.363592 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:19.364562 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:19.364562 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:19.364562 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 11:53:19.364562 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 11:53:19.364562 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 11:53:19.364562 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 11:53:19.364562 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 11:53:19.364562 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 11:53:19.364562 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 08 11:53:19.364562 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:19.364562 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 283/572] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:53:19 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:19.365406 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c89adb-a191-4f0c-9fcd-689959d8bd6b None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:19.365406 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c89adb-a191-4f0c-9fcd-689959d8bd6b None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:19.365406 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c89adb-a191-4f0c-9fcd-689959d8bd6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:19.381535 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-87c89adb-a191-4f0c-9fcd-689959d8bd6b None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:53:19.382708 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-87c89adb-a191-4f0c-9fcd-689959d8bd6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:53:19.430029 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:19.445461 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed3105-0932-497f-8b3a-f37cfd72db5c None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:19.450619 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 284/573] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:53:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:53:19.451286 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c89adb-a191-4f0c-9fcd-689959d8bd6b None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:19.475449 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:19.484586 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dbfd22-f1f2-4b48-947b-7d3bd514f98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:19.485253 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dbfd22-f1f2-4b48-947b-7d3bd514f98c None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:19.485609 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dbfd22-f1f2-4b48-947b-7d3bd514f98c None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:19.485886 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dbfd22-f1f2-4b48-947b-7d3bd514f98c None admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:19.486676 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dbfd22-f1f2-4b48-947b-7d3bd514f98c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:19.486979 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dbfd22-f1f2-4b48-947b-7d3bd514f98c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:19.488514 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dbfd22-f1f2-4b48-947b-7d3bd514f98c None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:19.501219 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 290/574] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Jun 8 11:53:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:19.502039 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dbfd22-f1f2-4b48-947b-7d3bd514f98c None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:19.559452 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c89adb-a191-4f0c-9fcd-689959d8bd6b None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:19.592860 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434daf7-88d2-4aad-9ad2-353956405a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:19.593540 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434daf7-88d2-4aad-9ad2-353956405a18 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:19.594207 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434daf7-88d2-4aad-9ad2-353956405a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:19.594207 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434daf7-88d2-4aad-9ad2-353956405a18 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:19.594818 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b434daf7-88d2-4aad-9ad2-353956405a18 None admin] RBAC: Adding query filter params (name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:19.595124 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b434daf7-88d2-4aad-9ad2-353956405a18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:19.596537 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b434daf7-88d2-4aad-9ad2-353956405a18 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:19.602551 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dbfd22-f1f2-4b48-947b-7d3bd514f98c None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:19.605585 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 285/575] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Jun 8 11:53:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:19.606242 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434daf7-88d2-4aad-9ad2-353956405a18 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:19.636741 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44a661-9bdc-4d4a-9509-d575fd163b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:19.637535 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44a661-9bdc-4d4a-9509-d575fd163b28 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:19.637815 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44a661-9bdc-4d4a-9509-d575fd163b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:19.638091 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44a661-9bdc-4d4a-9509-d575fd163b28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:19.648343 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f44a661-9bdc-4d4a-9509-d575fd163b28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:19.649782 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f44a661-9bdc-4d4a-9509-d575fd163b28 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:19.655923 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:19.668160 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-3f44a661-9bdc-4d4a-9509-d575fd163b28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:19.668160 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:19.668160 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:19.668160 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:19.668160 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:19.668160 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:19.668160 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:19.668160 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:19.668160 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:19.668160 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:19.668160 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:19.668160 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:19.668160 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:53:19.668160 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:53:19.668160 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:53:19.669148 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:53:19.669148 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:19.669148 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:19.669148 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:19.669148 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:19.669148 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:19.669148 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:19.669148 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:19.669148 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:19.669148 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:19.669148 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:19.669148 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:19.669148 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:19.669148 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:19.669148 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:19.669148 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:19.669148 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:19.670627 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:53:19.670627 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:53:19.670627 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:19.670627 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:19.670627 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 291/576] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:53:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:19.670627 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44a661-9bdc-4d4a-9509-d575fd163b28 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:19.695618 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:19.712713 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434daf7-88d2-4aad-9ad2-353956405a18 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:19.747420 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f0c79-3444-405d-a496-adff8bfe6e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:19.748028 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f0c79-3444-405d-a496-adff8bfe6e0c None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:19.748371 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f0c79-3444-405d-a496-adff8bfe6e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:19.748647 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f0c79-3444-405d-a496-adff8bfe6e0c None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:19.749506 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410f0c79-3444-405d-a496-adff8bfe6e0c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:19.749818 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410f0c79-3444-405d-a496-adff8bfe6e0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:19.751249 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410f0c79-3444-405d-a496-adff8bfe6e0c None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:19.769056 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 286/577] 10.222.0.39 () {56 vars in 1137 bytes} [Wed Jun 8 11:53:19 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:19.769888 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f0c79-3444-405d-a496-adff8bfe6e0c None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:19.778087 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44a661-9bdc-4d4a-9509-d575fd163b28 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:19.813161 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e901d3-235c-4846-b2c1-79e6381a8f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:19.813956 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e901d3-235c-4846-b2c1-79e6381a8f37 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:19.814241 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e901d3-235c-4846-b2c1-79e6381a8f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:19.814512 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e901d3-235c-4846-b2c1-79e6381a8f37 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:19.824682 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e901d3-235c-4846-b2c1-79e6381a8f37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:53:19.832287 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-41e901d3-235c-4846-b2c1-79e6381a8f37 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 11:53:19.832287 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:19.832287 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:19.832287 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:19.832287 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:19.832287 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:19.832287 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:19.832287 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:19.832287 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:19.832287 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:19.832287 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:19.832287 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:19.832287 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:53:19.832287 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:53:19.832287 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:53:19.832287 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:53:19.833225 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:53:19.833225 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:53:19.833225 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:53:19.833225 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:53:19.833225 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:19.833225 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:19.833225 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:19.833225 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:19.833225 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:19.833225 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:19.833225 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:19.833225 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:19.833225 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:19.833225 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:19.833225 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:19.833225 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:19.834039 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:19.834039 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:19.834039 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:19.834039 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:19.834039 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:53:19.834039 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:53:19.834039 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:53:19.834039 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:53:19.834039 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:53:19.834039 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:53:19.834039 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 11:53:19.834039 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:19.834039 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 292/578] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Jun 8 11:53:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:19.834721 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e901d3-235c-4846-b2c1-79e6381a8f37 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:19.872902 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f0c79-3444-405d-a496-adff8bfe6e0c None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:19.892766 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:19.907219 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac610d-7f06-4629-a1c0-0cfd5381b812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:19.907871 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac610d-7f06-4629-a1c0-0cfd5381b812 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:19.908151 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac610d-7f06-4629-a1c0-0cfd5381b812 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:19.908453 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac610d-7f06-4629-a1c0-0cfd5381b812 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:19.909278 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac610d-7f06-4629-a1c0-0cfd5381b812 None admin] RBAC: Adding query filter params (role.id=125b7374688b4b009d443f1b34947c49, scope.project.id=6a7fee684e8b43e199c95aeeb92640d4, user.id=753bde6a72d64045abd3ad44b9b0de04) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:19.909586 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac610d-7f06-4629-a1c0-0cfd5381b812 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:19.911009 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac610d-7f06-4629-a1c0-0cfd5381b812 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:19.916482 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 287/579] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Jun 8 11:53:19 2022] GET /identity/v3/role_assignments?user.id=753bde6a72d64045abd3ad44b9b0de04&scope.project.id=6a7fee684e8b43e199c95aeeb92640d4&role.id=125b7374688b4b009d443f1b34947c49 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:19.917249 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac610d-7f06-4629-a1c0-0cfd5381b812 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:19.936636 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e901d3-235c-4846-b2c1-79e6381a8f37 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:19.940754 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:19.976513 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821b567-0bd5-470a-980e-ea46e598199b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:19.977347 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821b567-0bd5-470a-980e-ea46e598199b None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:19.977632 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821b567-0bd5-470a-980e-ea46e598199b None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:19.977911 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821b567-0bd5-470a-980e-ea46e598199b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:19.990334 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821b567-0bd5-470a-980e-ea46e598199b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:19.991824 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821b567-0bd5-470a-980e-ea46e598199b None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:20.011532 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-c821b567-0bd5-470a-980e-ea46e598199b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:20.011532 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:20.011532 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:20.011532 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:20.011532 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:20.011532 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:20.011532 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:20.011532 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:20.011532 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:20.011532 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:20.011532 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:20.011532 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:20.011532 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:53:20.011532 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:53:20.011532 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:53:20.012507 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:53:20.012507 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:20.012507 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:20.012507 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:20.012507 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:20.012507 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:20.012507 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:20.012507 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:20.012507 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:20.012507 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:20.012507 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:20.012507 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:20.012507 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:20.012507 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:20.012507 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:20.012507 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:20.012507 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:20.013443 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:53:20.013443 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:53:20.013443 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:20.013443 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:20.013443 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 293/580] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:53:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:20.013736 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821b567-0bd5-470a-980e-ea46e598199b None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:20.052874 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac610d-7f06-4629-a1c0-0cfd5381b812 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:20.091100 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e572aec2-2b15-4f5d-bcc0-6f6d927f7060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:20.091795 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572aec2-2b15-4f5d-bcc0-6f6d927f7060 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:20.092079 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572aec2-2b15-4f5d-bcc0-6f6d927f7060 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:20.092402 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572aec2-2b15-4f5d-bcc0-6f6d927f7060 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:20.093145 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e572aec2-2b15-4f5d-bcc0-6f6d927f7060 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:20.093455 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e572aec2-2b15-4f5d-bcc0-6f6d927f7060 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:20.094878 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e572aec2-2b15-4f5d-bcc0-6f6d927f7060 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:20.109013 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 288/581] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:53:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:20.109811 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e572aec2-2b15-4f5d-bcc0-6f6d927f7060 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:20.127771 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821b567-0bd5-470a-980e-ea46e598199b None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:20.139663 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:20.165462 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc2195-dbbd-45d2-930c-a5800786926f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:20.166777 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc2195-dbbd-45d2-930c-a5800786926f None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:20.167058 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc2195-dbbd-45d2-930c-a5800786926f None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:20.167425 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc2195-dbbd-45d2-930c-a5800786926f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:20.179086 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fc2195-dbbd-45d2-930c-a5800786926f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:20.180638 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fc2195-dbbd-45d2-930c-a5800786926f None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:20.182136 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:20.199939 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-78fc2195-dbbd-45d2-930c-a5800786926f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:20.199939 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:20.199939 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:20.199939 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:20.199939 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:20.199939 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:20.199939 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:20.199939 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:20.199939 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:20.199939 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:20.199939 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:20.199939 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:20.199939 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:53:20.199939 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:53:20.199939 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:53:20.201087 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:53:20.201087 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:20.201087 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:20.201087 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:20.201087 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:20.201087 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:20.201087 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:20.201087 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:20.201087 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:20.201087 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:20.201087 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:20.201087 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:20.201087 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:20.201087 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:20.201087 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:20.201087 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:20.201087 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:20.201956 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:53:20.201956 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:53:20.201956 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:20.201956 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:20.201956 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 294/582] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:53:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:20.201956 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc2195-dbbd-45d2-930c-a5800786926f None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:20.223952 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e572aec2-2b15-4f5d-bcc0-6f6d927f7060 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:20.265208 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4da13-c472-4d86-9ac3-3089f324c5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:20.265844 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4da13-c472-4d86-9ac3-3089f324c5a6 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:20.266133 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4da13-c472-4d86-9ac3-3089f324c5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:20.266412 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4da13-c472-4d86-9ac3-3089f324c5a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:20.267165 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e4da13-c472-4d86-9ac3-3089f324c5a6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:20.267475 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e4da13-c472-4d86-9ac3-3089f324c5a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:20.268878 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e4da13-c472-4d86-9ac3-3089f324c5a6 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:20.277752 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 289/583] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Jun 8 11:53:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:20.283012 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4da13-c472-4d86-9ac3-3089f324c5a6 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:20.313250 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc2195-dbbd-45d2-930c-a5800786926f None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:20.351798 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f95505-7c50-4636-a279-800cbea4a96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:20.352624 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f95505-7c50-4636-a279-800cbea4a96b None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:20.352909 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f95505-7c50-4636-a279-800cbea4a96b None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:20.353310 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f95505-7c50-4636-a279-800cbea4a96b None admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:20.354555 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f95505-7c50-4636-a279-800cbea4a96b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:20.354865 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f95505-7c50-4636-a279-800cbea4a96b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:20.356313 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f95505-7c50-4636-a279-800cbea4a96b None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:20.374420 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 295/584] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:53:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:20.374420 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f95505-7c50-4636-a279-800cbea4a96b None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:20.393148 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4da13-c472-4d86-9ac3-3089f324c5a6 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:20.399538 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:20.423061 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:20.432466 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a9a5d3-5bd0-4615-893b-92d926bd02f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:20.433261 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9a5d3-5bd0-4615-893b-92d926bd02f1 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:20.433539 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9a5d3-5bd0-4615-893b-92d926bd02f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:20.433809 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9a5d3-5bd0-4615-893b-92d926bd02f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:20.440771 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a9a5d3-5bd0-4615-893b-92d926bd02f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:20.442207 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a9a5d3-5bd0-4615-893b-92d926bd02f1 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:20.457506 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-68a9a5d3-5bd0-4615-893b-92d926bd02f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:53:20.457506 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:20.457506 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:20.457506 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:20.457506 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:20.457506 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:20.457506 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:20.457506 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:20.457506 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:20.457506 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:20.457506 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:20.457506 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:20.457506 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 11:53:20.457506 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 11:53:20.457506 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 11:53:20.458441 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 11:53:20.458441 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:20.458441 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:20.458441 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:20.458441 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:20.458441 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:20.458441 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:20.458441 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:20.458441 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:20.458441 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:20.458441 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:20.458441 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:20.458441 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:20.458441 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:20.458441 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:20.458441 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:20.458441 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:20.460022 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 11:53:20.460022 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 11:53:20.460022 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 11:53:20.460022 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 11:53:20.460022 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 11:53:20.460022 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 11:53:20.460022 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:53:20.460022 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:20.460022 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 290/585] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Jun 8 11:53:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:20.460022 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a9a5d3-5bd0-4615-893b-92d926bd02f1 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:20.489647 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f95505-7c50-4636-a279-800cbea4a96b None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:20.525121 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3238d9e-a30d-4793-9c0b-e726a70bde6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:20.526251 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3238d9e-a30d-4793-9c0b-e726a70bde6d None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:20.526553 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3238d9e-a30d-4793-9c0b-e726a70bde6d None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:20.526806 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3238d9e-a30d-4793-9c0b-e726a70bde6d None admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:20.527524 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3238d9e-a30d-4793-9c0b-e726a70bde6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:20.527828 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3238d9e-a30d-4793-9c0b-e726a70bde6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:20.529229 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3238d9e-a30d-4793-9c0b-e726a70bde6d None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:20.545949 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 296/586] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:53:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:20.546690 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3238d9e-a30d-4793-9c0b-e726a70bde6d None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:20.563300 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a9a5d3-5bd0-4615-893b-92d926bd02f1 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:20.605057 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf23ea-ff8e-459c-82de-7ff968c0b05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:20.606473 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf23ea-ff8e-459c-82de-7ff968c0b05d None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:20.606899 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf23ea-ff8e-459c-82de-7ff968c0b05d None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:20.607180 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf23ea-ff8e-459c-82de-7ff968c0b05d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:20.621410 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf23ea-ff8e-459c-82de-7ff968c0b05d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:20.623452 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf23ea-ff8e-459c-82de-7ff968c0b05d None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:20.636345 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:20.641458 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-20bf23ea-ff8e-459c-82de-7ff968c0b05d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:20.641458 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:20.641458 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:20.641458 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:20.641458 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:20.641458 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:20.641458 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:20.641458 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:20.641458 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:20.641458 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:20.641458 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:20.641458 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:20.641458 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:53:20.641458 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:53:20.641458 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:53:20.642389 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:53:20.642389 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:20.642389 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:20.642389 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:20.642389 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:20.642389 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:20.642389 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:20.642389 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:20.642389 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:20.642389 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:20.642389 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:20.642389 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:20.642389 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:20.642389 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:20.642389 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:20.642389 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:20.642389 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:20.648757 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:53:20.648757 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:53:20.648757 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:20.648757 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:20.648757 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 291/587] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:53:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:20.648757 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf23ea-ff8e-459c-82de-7ff968c0b05d None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:20.661077 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3238d9e-a30d-4793-9c0b-e726a70bde6d None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:20.694120 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:20.699957 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b6c86c-5ddf-47ff-aa23-dd86d7e8c9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:20.700797 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6c86c-5ddf-47ff-aa23-dd86d7e8c9a1 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:20.701078 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6c86c-5ddf-47ff-aa23-dd86d7e8c9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:20.701352 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6c86c-5ddf-47ff-aa23-dd86d7e8c9a1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:20.709025 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b6c86c-5ddf-47ff-aa23-dd86d7e8c9a1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:20.710473 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b6c86c-5ddf-47ff-aa23-dd86d7e8c9a1 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:20.726580 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-66b6c86c-5ddf-47ff-aa23-dd86d7e8c9a1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 08 11:53:20.726580 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:20.726580 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:20.726580 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:20.726580 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:20.726580 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:20.726580 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:20.726580 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:20.726580 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:20.726580 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:20.726580 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:20.726580 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:20.726580 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 11:53:20.726580 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 11:53:20.726580 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 11:53:20.726580 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 11:53:20.727572 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:20.727572 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:20.727572 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 11:53:20.727572 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:53:20.727572 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 11:53:20.727572 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:53:20.727572 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:20.727572 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:20.727572 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:20.727572 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:20.727572 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:20.727572 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:20.727572 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:20.727572 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:20.727572 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:20.727572 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:20.727572 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:20.727572 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:20.728654 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:20.728654 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:20.728654 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 11:53:20.728654 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 11:53:20.728654 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 11:53:20.728654 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 11:53:20.728654 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 11:53:20.728654 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 11:53:20.728654 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 08 11:53:20.728654 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:20.728654 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 297/588] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:53:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:20.729860 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b6c86c-5ddf-47ff-aa23-dd86d7e8c9a1 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:20.767552 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf23ea-ff8e-459c-82de-7ff968c0b05d None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:20.803449 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b5ff1-287c-41b9-95bd-e3bc722458ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:20.804033 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b5ff1-287c-41b9-95bd-e3bc722458ec None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:20.804348 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b5ff1-287c-41b9-95bd-e3bc722458ec None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:20.805033 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b5ff1-287c-41b9-95bd-e3bc722458ec None admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:20.805922 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88b5ff1-287c-41b9-95bd-e3bc722458ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:20.806236 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88b5ff1-287c-41b9-95bd-e3bc722458ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:20.808114 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88b5ff1-287c-41b9-95bd-e3bc722458ec None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:20.826993 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 292/589] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Jun 8 11:53:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:20.826993 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b5ff1-287c-41b9-95bd-e3bc722458ec None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:20.837436 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b6c86c-5ddf-47ff-aa23-dd86d7e8c9a1 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:20.874841 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd543f6e-0317-4ae7-b3df-4668ae11aaae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:20.875987 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd543f6e-0317-4ae7-b3df-4668ae11aaae None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:20.876301 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd543f6e-0317-4ae7-b3df-4668ae11aaae None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:20.876581 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd543f6e-0317-4ae7-b3df-4668ae11aaae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:20.883724 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd543f6e-0317-4ae7-b3df-4668ae11aaae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:20.885698 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd543f6e-0317-4ae7-b3df-4668ae11aaae None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:20.899813 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-dd543f6e-0317-4ae7-b3df-4668ae11aaae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:53:20.899813 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:20.899813 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:20.899813 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:20.899813 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:20.899813 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:20.899813 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:20.899813 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:20.899813 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:20.899813 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:20.899813 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:20.899813 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:20.899813 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 11:53:20.899813 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 11:53:20.899813 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 11:53:20.901660 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 11:53:20.901660 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:20.901660 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:20.901660 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:20.901660 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:20.901660 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:20.901660 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:20.901660 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:20.901660 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:20.901660 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:20.901660 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:20.901660 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:20.901660 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:20.901660 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:20.901660 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:20.901660 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:20.901660 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:20.902917 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 11:53:20.902917 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 11:53:20.902917 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 11:53:20.902917 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 11:53:20.902917 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 11:53:20.902917 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 11:53:20.902917 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:53:20.902917 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:20.902917 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 298/590] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Jun 8 11:53:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:20.902917 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd543f6e-0317-4ae7-b3df-4668ae11aaae None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:20.905711 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:20.942173 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:20.945407 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b5ff1-287c-41b9-95bd-e3bc722458ec None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:20.985074 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e9dd1-149d-4267-97b4-e6af65b17197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:20.985745 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e9dd1-149d-4267-97b4-e6af65b17197 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:20.986031 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e9dd1-149d-4267-97b4-e6af65b17197 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:20.986540 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e9dd1-149d-4267-97b4-e6af65b17197 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:20.987013 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e9dd1-149d-4267-97b4-e6af65b17197 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:20.987392 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e9dd1-149d-4267-97b4-e6af65b17197 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:20.988835 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e9dd1-149d-4267-97b4-e6af65b17197 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:21.005101 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 293/591] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:53:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:21.005101 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e9dd1-149d-4267-97b4-e6af65b17197 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:21.010367 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd543f6e-0317-4ae7-b3df-4668ae11aaae None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:21.050170 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0669623-7dde-4411-a61a-f66830eac30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:21.050867 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0669623-7dde-4411-a61a-f66830eac30e None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:21.051318 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0669623-7dde-4411-a61a-f66830eac30e None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:21.051601 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0669623-7dde-4411-a61a-f66830eac30e None admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:21.052863 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0669623-7dde-4411-a61a-f66830eac30e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:21.053448 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0669623-7dde-4411-a61a-f66830eac30e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:21.055380 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0669623-7dde-4411-a61a-f66830eac30e None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:21.077578 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 299/592] 10.222.0.39 () {56 vars in 1137 bytes} [Wed Jun 8 11:53:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:21.078406 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0669623-7dde-4411-a61a-f66830eac30e None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:21.109331 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e9dd1-149d-4267-97b4-e6af65b17197 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:21.140694 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:21.150501 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62f3fa-beff-4212-9ebb-218ac99f2317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:21.151394 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62f3fa-beff-4212-9ebb-218ac99f2317 None admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:21.151674 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62f3fa-beff-4212-9ebb-218ac99f2317 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:21.151945 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62f3fa-beff-4212-9ebb-218ac99f2317 None admin] PATH_INFO: `/v3/projects/6a7fee684e8b43e199c95aeeb92640d4/users/7ef7edb5e9ce49e6b098f48bf060b228/roles/125b7374688b4b009d443f1b34947c49` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:21.167144 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62f3fa-beff-4212-9ebb-218ac99f2317 None admin] RBAC: Authorizing `identity:create_grant(project_id=6a7fee684e8b43e199c95aeeb92640d4, user_id=7ef7edb5e9ce49e6b098f48bf060b228, role_id=125b7374688b4b009d443f1b34947c49)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:21.168634 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62f3fa-beff-4212-9ebb-218ac99f2317 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:21.182216 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 294/593] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Jun 8 11:53:21 2022] PUT /identity/v3/projects/6a7fee684e8b43e199c95aeeb92640d4/users/7ef7edb5e9ce49e6b098f48bf060b228/roles/125b7374688b4b009d443f1b34947c49 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 11:53:21.186263 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0669623-7dde-4411-a61a-f66830eac30e None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:21.190280 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62f3fa-beff-4212-9ebb-218ac99f2317 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:21.208807 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:21.229659 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87a80c-8a16-48ea-9bb7-fcb542d55236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:21.230541 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87a80c-8a16-48ea-9bb7-fcb542d55236 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:21.230826 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87a80c-8a16-48ea-9bb7-fcb542d55236 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:21.231156 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87a80c-8a16-48ea-9bb7-fcb542d55236 None admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:21.231970 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a87a80c-8a16-48ea-9bb7-fcb542d55236 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:21.232323 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a87a80c-8a16-48ea-9bb7-fcb542d55236 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:21.233992 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a87a80c-8a16-48ea-9bb7-fcb542d55236 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:21.253508 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 300/594] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Jun 8 11:53:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:21.254507 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87a80c-8a16-48ea-9bb7-fcb542d55236 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:21.331187 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62f3fa-beff-4212-9ebb-218ac99f2317 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:21.378918 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e566166-2a5a-4a56-9167-9ca2320d998c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:21.380451 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e566166-2a5a-4a56-9167-9ca2320d998c None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:21.380951 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e566166-2a5a-4a56-9167-9ca2320d998c None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:21.381626 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e566166-2a5a-4a56-9167-9ca2320d998c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:21.387980 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87a80c-8a16-48ea-9bb7-fcb542d55236 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:21.391700 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e566166-2a5a-4a56-9167-9ca2320d998c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:21.393519 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e566166-2a5a-4a56-9167-9ca2320d998c None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:21.411963 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-8e566166-2a5a-4a56-9167-9ca2320d998c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 08 11:53:21.411963 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:21.411963 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:21.411963 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:21.411963 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:21.411963 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:21.411963 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:21.411963 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:21.411963 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:21.411963 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:21.411963 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:21.411963 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:21.411963 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 11:53:21.411963 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 11:53:21.411963 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 11:53:21.411963 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 11:53:21.413018 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:21.413018 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:21.413018 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 11:53:21.413018 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:53:21.413018 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 11:53:21.413018 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:53:21.413018 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:21.413018 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:21.413018 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:21.413018 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:21.413018 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:21.413018 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:21.413018 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:21.413018 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:21.413018 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:21.413018 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:21.413018 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:21.413018 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:21.414679 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:21.414679 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:21.414679 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 11:53:21.414679 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 11:53:21.414679 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 11:53:21.414679 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 11:53:21.414679 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 11:53:21.414679 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 11:53:21.414679 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 08 11:53:21.414679 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:21.414679 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 295/595] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Jun 8 11:53:21 2022] GET /identity/v3/users/neutron => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:21.414679 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e566166-2a5a-4a56-9167-9ca2320d998c None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:21.416129 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:21.447178 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1165c2-a178-440b-b308-9b503ffef2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:21.449209 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1165c2-a178-440b-b308-9b503ffef2a0 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:21.449741 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1165c2-a178-440b-b308-9b503ffef2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:21.450226 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1165c2-a178-440b-b308-9b503ffef2a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:21.474739 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1165c2-a178-440b-b308-9b503ffef2a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:21.477590 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1165c2-a178-440b-b308-9b503ffef2a0 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:21.490307 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:21.504021 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-bb1165c2-a178-440b-b308-9b503ffef2a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:21.504021 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:21.504021 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:21.504021 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:21.504021 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:21.504021 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:21.504021 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:21.504021 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:21.504021 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:21.504021 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:21.504021 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:21.504021 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:21.504021 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:53:21.504021 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:53:21.504021 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:53:21.504983 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:53:21.504983 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:21.504983 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:21.504983 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:21.504983 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:21.504983 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:21.504983 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:21.504983 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:21.504983 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:21.504983 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:21.504983 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:21.504983 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:21.504983 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:21.504983 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:21.504983 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:21.504983 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:21.504983 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:21.505869 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:53:21.505869 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:53:21.505869 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:21.505869 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:21.508400 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 301/596] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:53:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:21.509911 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1165c2-a178-440b-b308-9b503ffef2a0 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:21.528615 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e566166-2a5a-4a56-9167-9ca2320d998c None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:21.565088 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2327fdd-0072-4932-a905-e923cae616b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:21.566159 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2327fdd-0072-4932-a905-e923cae616b7 None admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:21.566541 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2327fdd-0072-4932-a905-e923cae616b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:21.566911 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2327fdd-0072-4932-a905-e923cae616b7 None admin] PATH_INFO: `/v3/projects/6a7fee684e8b43e199c95aeeb92640d4/users/2e2f8b5040a048c5bf4eef36f2ecd678/roles/125b7374688b4b009d443f1b34947c49` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:21.594591 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2327fdd-0072-4932-a905-e923cae616b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=6a7fee684e8b43e199c95aeeb92640d4, user_id=2e2f8b5040a048c5bf4eef36f2ecd678, role_id=125b7374688b4b009d443f1b34947c49)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:21.596260 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2327fdd-0072-4932-a905-e923cae616b7 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:21.613236 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 296/597] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Jun 8 11:53:21 2022] PUT /identity/v3/projects/6a7fee684e8b43e199c95aeeb92640d4/users/2e2f8b5040a048c5bf4eef36f2ecd678/roles/125b7374688b4b009d443f1b34947c49 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 11:53:21.614849 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2327fdd-0072-4932-a905-e923cae616b7 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:21.645614 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1165c2-a178-440b-b308-9b503ffef2a0 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:21.687872 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae50e8d8-64d5-450d-b925-3229242237af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:21.689370 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae50e8d8-64d5-450d-b925-3229242237af None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:21.689886 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae50e8d8-64d5-450d-b925-3229242237af None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:21.690312 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae50e8d8-64d5-450d-b925-3229242237af None admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:21.691455 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae50e8d8-64d5-450d-b925-3229242237af None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:21.692060 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae50e8d8-64d5-450d-b925-3229242237af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:21.693818 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae50e8d8-64d5-450d-b925-3229242237af None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:21.721026 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 302/598] 10.222.0.39 () {56 vars in 1139 bytes} [Wed Jun 8 11:53:21 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:21.722775 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae50e8d8-64d5-450d-b925-3229242237af None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:21.751154 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2327fdd-0072-4932-a905-e923cae616b7 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:21.782999 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:21.803407 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:21.827360 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593fd994-bacf-4e8a-834f-009077d50e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:21.828543 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593fd994-bacf-4e8a-834f-009077d50e65 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:21.829088 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593fd994-bacf-4e8a-834f-009077d50e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:21.829606 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593fd994-bacf-4e8a-834f-009077d50e65 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:21.830594 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593fd994-bacf-4e8a-834f-009077d50e65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:21.831160 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593fd994-bacf-4e8a-834f-009077d50e65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:21.832800 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593fd994-bacf-4e8a-834f-009077d50e65 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:21.856907 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 297/599] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:53:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:21.862218 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593fd994-bacf-4e8a-834f-009077d50e65 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:21.920442 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae50e8d8-64d5-450d-b925-3229242237af None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:21.968485 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f74b0f-a8dc-4794-aa53-a371db6ebc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:21.969395 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f74b0f-a8dc-4794-aa53-a371db6ebc15 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:21.969754 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f74b0f-a8dc-4794-aa53-a371db6ebc15 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:21.970122 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f74b0f-a8dc-4794-aa53-a371db6ebc15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:21.991115 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f74b0f-a8dc-4794-aa53-a371db6ebc15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:21.992611 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f74b0f-a8dc-4794-aa53-a371db6ebc15 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:22.034189 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-41f74b0f-a8dc-4794-aa53-a371db6ebc15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:22.034189 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:22.034189 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:22.034189 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:22.034189 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:22.034189 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:22.034189 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:22.034189 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:22.034189 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:22.034189 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:22.034189 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:22.034189 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:22.034189 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:53:22.034189 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:53:22.034189 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:53:22.035158 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:53:22.035158 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:22.035158 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:22.035158 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:22.035158 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:22.035158 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:22.035158 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:22.035158 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:22.035158 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:22.035158 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:22.035158 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:22.035158 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:22.035158 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:22.035158 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:22.035158 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:22.035158 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:22.035158 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:22.036692 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:53:22.036692 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:53:22.036692 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:22.036692 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:22.036692 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 303/600] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:53:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 11:53:22.037013 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593fd994-bacf-4e8a-834f-009077d50e65 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:22.041502 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f74b0f-a8dc-4794-aa53-a371db6ebc15 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:22.121173 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b0c11-3e9d-419d-bc1b-89f3c971b3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:22.121920 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b0c11-3e9d-419d-bc1b-89f3c971b3a6 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:22.122204 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b0c11-3e9d-419d-bc1b-89f3c971b3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:22.122478 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b0c11-3e9d-419d-bc1b-89f3c971b3a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:22.137299 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b0c11-3e9d-419d-bc1b-89f3c971b3a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:22.138769 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b0c11-3e9d-419d-bc1b-89f3c971b3a6 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:22.153231 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:22.171519 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f74b0f-a8dc-4794-aa53-a371db6ebc15 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:22.172973 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-3f8b0c11-3e9d-419d-bc1b-89f3c971b3a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:53:22.172973 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:22.172973 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:22.172973 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:22.172973 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:22.172973 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:22.172973 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:22.172973 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:22.172973 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:22.172973 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:22.172973 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:22.172973 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:22.172973 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 11:53:22.172973 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 11:53:22.172973 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 11:53:22.173851 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 11:53:22.173851 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:22.173851 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:22.173851 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:22.173851 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:22.173851 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:22.173851 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:22.173851 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:22.173851 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:22.173851 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:22.173851 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:22.173851 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:22.173851 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:22.173851 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:22.173851 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:22.173851 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:22.173851 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:22.174741 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 11:53:22.174741 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 11:53:22.174741 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 11:53:22.174741 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 11:53:22.174741 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 11:53:22.174741 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 11:53:22.174741 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:53:22.174741 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:22.174741 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 298/601] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Jun 8 11:53:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:22.183135 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b0c11-3e9d-419d-bc1b-89f3c971b3a6 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:22.229409 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b18292-c565-46dc-9611-cc16eab3d9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:22.230489 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b18292-c565-46dc-9611-cc16eab3d9f4 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:22.230987 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b18292-c565-46dc-9611-cc16eab3d9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:22.231465 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b18292-c565-46dc-9611-cc16eab3d9f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:22.232622 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b18292-c565-46dc-9611-cc16eab3d9f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:22.233134 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b18292-c565-46dc-9611-cc16eab3d9f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:22.235075 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b18292-c565-46dc-9611-cc16eab3d9f4 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:22.248953 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 304/602] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:53:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:22.250737 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e65087-23bf-4953-9877-90b224506217 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:22.251308 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e65087-23bf-4953-9877-90b224506217 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:22.251790 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e65087-23bf-4953-9877-90b224506217 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:22.253633 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 305/603] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:53:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:53:22.258392 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e65087-23bf-4953-9877-90b224506217 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:22.274430 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:22.342302 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b0c11-3e9d-419d-bc1b-89f3c971b3a6 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:22.379078 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf872d-9a16-4059-8d55-049f0809406e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:22.379891 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf872d-9a16-4059-8d55-049f0809406e None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:22.380263 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf872d-9a16-4059-8d55-049f0809406e None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:22.380608 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf872d-9a16-4059-8d55-049f0809406e None admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:22.381587 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bf872d-9a16-4059-8d55-049f0809406e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:22.381964 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bf872d-9a16-4059-8d55-049f0809406e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:22.383476 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bf872d-9a16-4059-8d55-049f0809406e None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:22.397748 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e65087-23bf-4953-9877-90b224506217 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:22.402743 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 299/604] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Jun 8 11:53:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:22.404312 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b2644-5ce4-41d4-8e9c-e0c272a51335 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:22.404679 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b2644-5ce4-41d4-8e9c-e0c272a51335 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:22.405052 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b2644-5ce4-41d4-8e9c-e0c272a51335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:22.422638 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-419b2644-5ce4-41d4-8e9c-e0c272a51335 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:53:22.424048 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-419b2644-5ce4-41d4-8e9c-e0c272a51335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:53:22.440825 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e29b9f3-22e3-4396-8d3d-c1320c6e8ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:22.442040 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29b9f3-22e3-4396-8d3d-c1320c6e8ed2 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:22.442713 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29b9f3-22e3-4396-8d3d-c1320c6e8ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:22.443629 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29b9f3-22e3-4396-8d3d-c1320c6e8ed2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:22.454116 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e29b9f3-22e3-4396-8d3d-c1320c6e8ed2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:22.456413 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e29b9f3-22e3-4396-8d3d-c1320c6e8ed2 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:22.476353 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-6e29b9f3-22e3-4396-8d3d-c1320c6e8ed2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:53:22.476353 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:22.476353 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:22.476353 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:22.476353 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:22.476353 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:22.476353 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:22.476353 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:22.476353 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:22.476353 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:22.476353 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:22.476353 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:22.476353 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 11:53:22.476353 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 11:53:22.476353 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 11:53:22.477282 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 11:53:22.477282 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:22.477282 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:22.477282 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:22.477282 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:22.477282 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:22.477282 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:22.477282 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:22.477282 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:22.477282 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:22.477282 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:22.477282 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:22.477282 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:22.477282 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:22.477282 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:22.477282 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:22.477282 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:22.478184 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 11:53:22.478184 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 11:53:22.478184 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 11:53:22.478184 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 11:53:22.478184 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 11:53:22.478184 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 11:53:22.478184 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:53:22.478184 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:22.486104 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 306/605] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Jun 8 11:53:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 11:53:22.486104 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e29b9f3-22e3-4396-8d3d-c1320c6e8ed2 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:22.490777 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:22.512531 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 300/606] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:53:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:53:22.513732 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b2644-5ce4-41d4-8e9c-e0c272a51335 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:22.562111 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:22.622435 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e29b9f3-22e3-4396-8d3d-c1320c6e8ed2 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:22.653174 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b2644-5ce4-41d4-8e9c-e0c272a51335 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:22.663089 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e297543-dd20-408d-8432-9be050738f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:22.664345 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e297543-dd20-408d-8432-9be050738f83 None admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:22.664958 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e297543-dd20-408d-8432-9be050738f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:22.665436 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e297543-dd20-408d-8432-9be050738f83 None admin] PATH_INFO: `/v3/projects/6a7fee684e8b43e199c95aeeb92640d4/users/a2d235956e984676be738414b948bde3/roles/125b7374688b4b009d443f1b34947c49` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:22.683950 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e297543-dd20-408d-8432-9be050738f83 None admin] RBAC: Authorizing `identity:create_grant(project_id=6a7fee684e8b43e199c95aeeb92640d4, user_id=a2d235956e984676be738414b948bde3, role_id=125b7374688b4b009d443f1b34947c49)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:22.685780 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e297543-dd20-408d-8432-9be050738f83 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:22.692156 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe379b-1bc4-4f83-b208-8f71b8cd118d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:22.692910 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe379b-1bc4-4f83-b208-8f71b8cd118d None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:22.693202 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe379b-1bc4-4f83-b208-8f71b8cd118d None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:22.693452 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe379b-1bc4-4f83-b208-8f71b8cd118d None admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:22.694245 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe379b-1bc4-4f83-b208-8f71b8cd118d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:22.694539 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe379b-1bc4-4f83-b208-8f71b8cd118d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:22.695962 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe379b-1bc4-4f83-b208-8f71b8cd118d None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:22.704009 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 307/607] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Jun 8 11:53:22 2022] PUT /identity/v3/projects/6a7fee684e8b43e199c95aeeb92640d4/users/a2d235956e984676be738414b948bde3/roles/125b7374688b4b009d443f1b34947c49 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 11:53:22.705679 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e297543-dd20-408d-8432-9be050738f83 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:22.717413 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 301/608] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Jun 8 11:53:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:22.725156 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe379b-1bc4-4f83-b208-8f71b8cd118d None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:22.774545 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:22.876124 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e297543-dd20-408d-8432-9be050738f83 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:22.915209 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d06f1f-6731-4caa-912d-06890e2f6793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:22.916219 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d06f1f-6731-4caa-912d-06890e2f6793 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:22.916664 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d06f1f-6731-4caa-912d-06890e2f6793 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:22.917042 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d06f1f-6731-4caa-912d-06890e2f6793 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:22.929111 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d06f1f-6731-4caa-912d-06890e2f6793 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:53:22.938194 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-97d06f1f-6731-4caa-912d-06890e2f6793 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 11:53:22.938194 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:22.938194 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:22.938194 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:22.938194 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:22.938194 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:22.938194 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:22.938194 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:22.938194 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:22.938194 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:22.938194 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:22.938194 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:22.938194 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:53:22.938194 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:53:22.938194 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:53:22.938194 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:53:22.939461 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:53:22.939461 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:53:22.939461 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:53:22.939461 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:53:22.939461 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:22.939461 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:22.939461 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:22.939461 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:22.939461 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:22.939461 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:22.939461 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:22.939461 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:22.939461 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:22.939461 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:22.939461 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:22.939461 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:22.940529 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:22.940529 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:22.940529 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:22.940529 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:22.940529 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:53:22.940529 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:53:22.940529 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:53:22.940529 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:53:22.940529 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:53:22.940529 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:53:22.940529 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 11:53:22.940529 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:22.942660 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 308/609] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Jun 8 11:53:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:22.948979 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d06f1f-6731-4caa-912d-06890e2f6793 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:22.958535 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:22.974534 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe379b-1bc4-4f83-b208-8f71b8cd118d None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:23.017751 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b740436-5418-4bff-a163-cc474f752843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:23.018940 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b740436-5418-4bff-a163-cc474f752843 None admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:23.019378 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b740436-5418-4bff-a163-cc474f752843 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:23.019797 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b740436-5418-4bff-a163-cc474f752843 None admin] PATH_INFO: `/v3/projects/6a7fee684e8b43e199c95aeeb92640d4/users/2fef074aa2ea4570928109f62ea1aa96/roles/125b7374688b4b009d443f1b34947c49` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:23.037240 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b740436-5418-4bff-a163-cc474f752843 None admin] RBAC: Authorizing `identity:create_grant(project_id=6a7fee684e8b43e199c95aeeb92640d4, user_id=2fef074aa2ea4570928109f62ea1aa96, role_id=125b7374688b4b009d443f1b34947c49)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:23.038898 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b740436-5418-4bff-a163-cc474f752843 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:23.057036 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 302/610] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Jun 8 11:53:22 2022] PUT /identity/v3/projects/6a7fee684e8b43e199c95aeeb92640d4/users/2fef074aa2ea4570928109f62ea1aa96/roles/125b7374688b4b009d443f1b34947c49 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 11:53:23.078039 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d06f1f-6731-4caa-912d-06890e2f6793 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:23.095367 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:23.130542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95921b4-c630-480c-b531-7b91dc9fe984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:23.131605 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95921b4-c630-480c-b531-7b91dc9fe984 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:23.132082 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95921b4-c630-480c-b531-7b91dc9fe984 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:23.132526 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95921b4-c630-480c-b531-7b91dc9fe984 None admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:23.133460 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95921b4-c630-480c-b531-7b91dc9fe984 None admin] RBAC: Adding query filter params (name=service) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:23.133914 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95921b4-c630-480c-b531-7b91dc9fe984 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:23.136488 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95921b4-c630-480c-b531-7b91dc9fe984 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:23.149662 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 309/611] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Jun 8 11:53:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:53:23.155864 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b740436-5418-4bff-a163-cc474f752843 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:23.311298 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b740436-5418-4bff-a163-cc474f752843 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:23.360706 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ff338-74e3-4614-a77b-f2cdeb9ba279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:23.361518 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ff338-74e3-4614-a77b-f2cdeb9ba279 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:23.361806 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ff338-74e3-4614-a77b-f2cdeb9ba279 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:23.362085 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ff338-74e3-4614-a77b-f2cdeb9ba279 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:23.373340 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:23.376476 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ff338-74e3-4614-a77b-f2cdeb9ba279 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:23.378417 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ff338-74e3-4614-a77b-f2cdeb9ba279 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:23.399775 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-9f9ff338-74e3-4614-a77b-f2cdeb9ba279 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:23.399775 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:23.399775 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:23.399775 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:23.399775 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:23.399775 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:23.399775 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:23.399775 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:23.399775 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:23.399775 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:23.399775 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:23.399775 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:23.399775 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:53:23.399775 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:53:23.399775 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:53:23.400888 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:53:23.400888 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:23.400888 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:23.400888 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:23.400888 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:23.400888 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:23.400888 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:23.400888 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:23.400888 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:23.400888 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:23.400888 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:23.400888 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:23.400888 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:23.400888 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:23.400888 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:23.400888 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:23.400888 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:23.401754 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:53:23.401754 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:53:23.401754 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:23.401754 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:23.401754 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 303/612] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:53:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:23.406808 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95921b4-c630-480c-b531-7b91dc9fe984 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:23.543834 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95921b4-c630-480c-b531-7b91dc9fe984 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:23.608996 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7b00c-688c-4932-ab98-fbb2f8ca6019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:23.609699 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7b00c-688c-4932-ab98-fbb2f8ca6019 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:23.609984 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7b00c-688c-4932-ab98-fbb2f8ca6019 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:23.610261 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7b00c-688c-4932-ab98-fbb2f8ca6019 None admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:23.611013 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac7b00c-688c-4932-ab98-fbb2f8ca6019 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:23.611325 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac7b00c-688c-4932-ab98-fbb2f8ca6019 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:23.612754 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac7b00c-688c-4932-ab98-fbb2f8ca6019 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:23.629324 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 310/613] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:53:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:23.635080 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ff338-74e3-4614-a77b-f2cdeb9ba279 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:23.758680 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ff338-74e3-4614-a77b-f2cdeb9ba279 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:23.803630 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a8d023-d79b-4bd3-834e-0ba6ff3962a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:23.804473 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8d023-d79b-4bd3-834e-0ba6ff3962a6 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:23.805108 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8d023-d79b-4bd3-834e-0ba6ff3962a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:23.805391 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8d023-d79b-4bd3-834e-0ba6ff3962a6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:23.813339 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a8d023-d79b-4bd3-834e-0ba6ff3962a6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:23.814821 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a8d023-d79b-4bd3-834e-0ba6ff3962a6 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:23.839979 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-09a8d023-d79b-4bd3-834e-0ba6ff3962a6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 08 11:53:23.839979 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:23.839979 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:23.839979 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:23.839979 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:23.839979 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:23.839979 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:23.839979 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:23.839979 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:23.839979 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:23.839979 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:23.839979 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:23.839979 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 11:53:23.839979 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 11:53:23.839979 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 11:53:23.839979 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 11:53:23.840999 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:23.840999 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:23.840999 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 11:53:23.840999 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:53:23.840999 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 11:53:23.840999 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:53:23.840999 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:23.840999 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:23.840999 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:23.840999 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:23.840999 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:23.840999 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:23.840999 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:23.840999 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:23.840999 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:23.840999 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:23.840999 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:23.840999 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:23.841931 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:23.841931 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:23.841931 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 11:53:23.841931 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 11:53:23.841931 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 11:53:23.841931 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 11:53:23.841931 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 11:53:23.841931 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 11:53:23.841931 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 08 11:53:23.841931 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:23.841931 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 304/614] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Jun 8 11:53:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:23.848841 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7b00c-688c-4932-ab98-fbb2f8ca6019 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:23.931359 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:23.947437 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e4307-ca06-43ff-8b13-dc6b4c085e47 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:23.947911 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e4307-ca06-43ff-8b13-dc6b4c085e47 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:23.948219 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e4307-ca06-43ff-8b13-dc6b4c085e47 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:23.949734 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 305/615] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:53:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:53:23.955972 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167832ab-480c-4aaf-8814-bde669107410 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:23.956295 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167832ab-480c-4aaf-8814-bde669107410 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:23.956578 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167832ab-480c-4aaf-8814-bde669107410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:23.993385 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-167832ab-480c-4aaf-8814-bde669107410 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:53:23.994727 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-167832ab-480c-4aaf-8814-bde669107410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:53:24.010831 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7b00c-688c-4932-ab98-fbb2f8ca6019 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:24.050395 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa03fbf-0f6c-42d5-9a0d-42f9a0f9c28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:24.051468 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa03fbf-0f6c-42d5-9a0d-42f9a0f9c28b None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:24.051980 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa03fbf-0f6c-42d5-9a0d-42f9a0f9c28b None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:24.052494 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa03fbf-0f6c-42d5-9a0d-42f9a0f9c28b None admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:24.053574 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa03fbf-0f6c-42d5-9a0d-42f9a0f9c28b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:24.054119 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa03fbf-0f6c-42d5-9a0d-42f9a0f9c28b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:24.055828 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa03fbf-0f6c-42d5-9a0d-42f9a0f9c28b None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:24.077803 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 311/616] 10.222.0.39 () {56 vars in 1135 bytes} [Wed Jun 8 11:53:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:24.085139 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa03fbf-0f6c-42d5-9a0d-42f9a0f9c28b None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:24.096599 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:24.122887 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 306/617] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:53:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:53:24.201257 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167832ab-480c-4aaf-8814-bde669107410 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:24.213137 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:24.222970 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa03fbf-0f6c-42d5-9a0d-42f9a0f9c28b None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:24.266243 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc353f-f83c-4a7c-b319-99366140ddc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:24.267577 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc353f-f83c-4a7c-b319-99366140ddc4 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:24.268844 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc353f-f83c-4a7c-b319-99366140ddc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:24.269964 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc353f-f83c-4a7c-b319-99366140ddc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:24.292270 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcc353f-f83c-4a7c-b319-99366140ddc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:24.294041 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcc353f-f83c-4a7c-b319-99366140ddc4 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:24.327107 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-2dcc353f-f83c-4a7c-b319-99366140ddc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:24.327107 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:24.327107 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:24.327107 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:24.327107 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:24.327107 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:24.327107 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:24.327107 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:24.327107 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:24.327107 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:24.327107 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:24.327107 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:24.327107 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:53:24.327107 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:53:24.327107 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:53:24.328061 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:53:24.328061 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:24.328061 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:24.328061 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:24.328061 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:24.328061 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:24.328061 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:24.328061 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:24.328061 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:24.328061 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:24.328061 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:24.328061 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:24.328061 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:24.328061 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:24.328061 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:24.328061 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:24.328061 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:24.328957 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:53:24.328957 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:53:24.328957 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:24.328957 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:24.336726 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 312/618] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:53:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:24.343235 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc353f-f83c-4a7c-b319-99366140ddc4 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:24.424574 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167832ab-480c-4aaf-8814-bde669107410 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:24.460194 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f0d0d-80ca-4e20-a1cc-b23644fafa30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:24.461005 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f0d0d-80ca-4e20-a1cc-b23644fafa30 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:24.461346 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f0d0d-80ca-4e20-a1cc-b23644fafa30 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:24.461548 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f0d0d-80ca-4e20-a1cc-b23644fafa30 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:24.479342 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f0d0d-80ca-4e20-a1cc-b23644fafa30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:53:24.486077 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc353f-f83c-4a7c-b319-99366140ddc4 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:24.490073 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-2f2f0d0d-80ca-4e20-a1cc-b23644fafa30 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 11:53:24.490073 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:24.490073 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:24.490073 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:24.490073 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:24.490073 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:24.490073 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:24.490073 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:24.490073 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:24.490073 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:24.490073 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:24.490073 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:24.490073 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:53:24.490073 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:53:24.490073 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:53:24.490073 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:53:24.491003 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:53:24.491003 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:53:24.491003 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:53:24.491003 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:53:24.491003 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:24.491003 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:24.491003 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:24.491003 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:24.491003 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:24.491003 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:24.491003 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:24.491003 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:24.491003 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:24.491003 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:24.491003 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:24.491003 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:24.491848 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:24.491848 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:24.491848 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:24.491848 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:24.491848 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:53:24.491848 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:53:24.491848 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:53:24.491848 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:53:24.491848 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:53:24.491848 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:53:24.491848 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 11:53:24.491848 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:24.491848 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 307/619] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Jun 8 11:53:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:24.493141 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5ed6c-c184-4777-81ca-3fab20b3f0b5 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:24.495621 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5ed6c-c184-4777-81ca-3fab20b3f0b5 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:24.495621 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5ed6c-c184-4777-81ca-3fab20b3f0b5 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:24.496399 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 308/620] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:53:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:53:24.497171 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d5ed6c-c184-4777-81ca-3fab20b3f0b5 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:24.531708 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf1cc1-b14c-4c2c-9c49-d73c66069ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:24.532452 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf1cc1-b14c-4c2c-9c49-d73c66069ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:24.532899 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf1cc1-b14c-4c2c-9c49-d73c66069ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:24.533177 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf1cc1-b14c-4c2c-9c49-d73c66069ab6 None admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:24.534531 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf1cc1-b14c-4c2c-9c49-d73c66069ab6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:24.534852 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf1cc1-b14c-4c2c-9c49-d73c66069ab6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:24.536763 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf1cc1-b14c-4c2c-9c49-d73c66069ab6 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:24.552594 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 313/621] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:53:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:24.553960 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c23cc-37b8-4aca-a5e9-4ac0a6185113 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:24.554253 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c23cc-37b8-4aca-a5e9-4ac0a6185113 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:24.554898 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c23cc-37b8-4aca-a5e9-4ac0a6185113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:24.556020 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:24.563948 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:24.580757 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-579c23cc-37b8-4aca-a5e9-4ac0a6185113 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:53:24.582154 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-579c23cc-37b8-4aca-a5e9-4ac0a6185113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:53:24.638107 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d5ed6c-c184-4777-81ca-3fab20b3f0b5 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:24.667964 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 314/622] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:53:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:53:24.668920 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c23cc-37b8-4aca-a5e9-4ac0a6185113 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:24.683997 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f7f90-1973-469d-b6a6-9d21b5d611d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:24.685265 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f7f90-1973-469d-b6a6-9d21b5d611d5 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:24.685779 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f7f90-1973-469d-b6a6-9d21b5d611d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:24.686531 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f7f90-1973-469d-b6a6-9d21b5d611d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:24.687976 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f7f90-1973-469d-b6a6-9d21b5d611d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:24.688814 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f7f90-1973-469d-b6a6-9d21b5d611d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:24.691039 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f7f90-1973-469d-b6a6-9d21b5d611d5 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:24.703691 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 309/623] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Jun 8 11:53:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:24.705045 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f7f90-1973-469d-b6a6-9d21b5d611d5 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:24.796124 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c23cc-37b8-4aca-a5e9-4ac0a6185113 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:24.844280 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2600f22-1956-4f48-977b-1a2af1aaf8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:24.844727 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f7f90-1973-469d-b6a6-9d21b5d611d5 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:24.845359 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2600f22-1956-4f48-977b-1a2af1aaf8a3 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:24.845742 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2600f22-1956-4f48-977b-1a2af1aaf8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:24.846122 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2600f22-1956-4f48-977b-1a2af1aaf8a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:24.847899 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:24.850674 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:24.856569 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2600f22-1956-4f48-977b-1a2af1aaf8a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:24.858865 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2600f22-1956-4f48-977b-1a2af1aaf8a3 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:24.879007 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-f2600f22-1956-4f48-977b-1a2af1aaf8a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:53:24.879007 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:24.879007 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:24.879007 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:24.879007 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:24.879007 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:24.879007 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:24.879007 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:24.879007 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:24.879007 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:24.879007 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:24.879007 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:24.879007 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 11:53:24.879007 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 11:53:24.879007 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 11:53:24.879984 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 11:53:24.879984 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:24.879984 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:24.879984 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:24.879984 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:24.879984 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:24.879984 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:24.879984 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:24.879984 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:24.879984 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:24.879984 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:24.879984 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:24.879984 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:24.879984 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:24.879984 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:24.879984 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:24.879984 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:24.881125 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 11:53:24.881125 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 11:53:24.881125 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 11:53:24.881125 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 11:53:24.881125 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 11:53:24.881125 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 11:53:24.881125 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:53:24.881125 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:24.881774 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 315/624] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Jun 8 11:53:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:24.883307 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2600f22-1956-4f48-977b-1a2af1aaf8a3 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:24.892058 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2af186-54cb-4850-b9d4-3de3dff83b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:24.893146 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2af186-54cb-4850-b9d4-3de3dff83b70 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:24.893582 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2af186-54cb-4850-b9d4-3de3dff83b70 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:24.894007 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2af186-54cb-4850-b9d4-3de3dff83b70 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:24.908648 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2af186-54cb-4850-b9d4-3de3dff83b70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:53:24.919863 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-8a2af186-54cb-4850-b9d4-3de3dff83b70 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 11:53:24.919863 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:24.919863 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:24.919863 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:24.919863 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:24.919863 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:24.919863 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:24.919863 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:24.919863 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:24.919863 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:24.919863 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:24.919863 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:24.919863 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:53:24.919863 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:53:24.919863 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:53:24.919863 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:53:24.921027 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:53:24.921027 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:53:24.921027 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:53:24.921027 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:53:24.921027 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:24.921027 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:24.921027 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:24.921027 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:24.921027 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:24.921027 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:24.921027 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:24.921027 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:24.921027 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:24.921027 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:24.921027 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:24.921027 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:24.922085 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:24.922085 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:24.922085 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:24.922085 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:24.922085 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:53:24.922085 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:53:24.922085 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:53:24.922085 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:53:24.922085 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:53:24.922085 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:53:24.922085 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 11:53:24.922085 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:24.925422 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 310/625] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Jun 8 11:53:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:24.926421 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2af186-54cb-4850-b9d4-3de3dff83b70 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:25.010587 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2600f22-1956-4f48-977b-1a2af1aaf8a3 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:25.054287 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3afbc2c-bcaa-437e-8ab0-09c0009de5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:25.055520 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afbc2c-bcaa-437e-8ab0-09c0009de5ce None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:25.055929 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afbc2c-bcaa-437e-8ab0-09c0009de5ce None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:25.056981 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afbc2c-bcaa-437e-8ab0-09c0009de5ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:25.064747 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2af186-54cb-4850-b9d4-3de3dff83b70 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:25.071858 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3afbc2c-bcaa-437e-8ab0-09c0009de5ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:25.073793 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3afbc2c-bcaa-437e-8ab0-09c0009de5ce None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:25.097773 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-c3afbc2c-bcaa-437e-8ab0-09c0009de5ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:25.097773 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:25.097773 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:25.097773 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:25.097773 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:25.097773 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:25.097773 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:25.097773 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:25.097773 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:25.097773 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:25.097773 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:25.097773 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:25.097773 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:53:25.097773 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:53:25.097773 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:53:25.099002 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:53:25.099002 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:25.099002 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:25.099002 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:25.099002 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:25.099002 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:25.099002 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:25.099002 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:25.099002 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:25.099002 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:25.099002 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:25.099002 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:25.099002 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:25.099002 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:25.099002 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:25.099002 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:25.099002 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:25.099901 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:53:25.099901 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:53:25.099901 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:25.099901 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:25.099901 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 316/626] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:53:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:25.100898 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3afbc2c-bcaa-437e-8ab0-09c0009de5ce None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:25.110433 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52677302-70c5-4e3b-a3a5-9e46d7c5efec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:25.111127 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52677302-70c5-4e3b-a3a5-9e46d7c5efec None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:25.111415 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52677302-70c5-4e3b-a3a5-9e46d7c5efec None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:25.111696 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52677302-70c5-4e3b-a3a5-9e46d7c5efec None admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:25.112546 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52677302-70c5-4e3b-a3a5-9e46d7c5efec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:25.112860 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52677302-70c5-4e3b-a3a5-9e46d7c5efec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:25.114319 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52677302-70c5-4e3b-a3a5-9e46d7c5efec None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:25.140521 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 311/627] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Jun 8 11:53:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:25.141960 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52677302-70c5-4e3b-a3a5-9e46d7c5efec None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:25.170575 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:25.179327 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:25.253891 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3afbc2c-bcaa-437e-8ab0-09c0009de5ce None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:25.284268 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52677302-70c5-4e3b-a3a5-9e46d7c5efec None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:25.291894 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29472c-77a5-4cfb-bc21-328863b30e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:25.292613 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29472c-77a5-4cfb-bc21-328863b30e70 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:25.292901 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29472c-77a5-4cfb-bc21-328863b30e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:25.293181 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29472c-77a5-4cfb-bc21-328863b30e70 None admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:25.293938 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf29472c-77a5-4cfb-bc21-328863b30e70 None admin] RBAC: Adding query filter params (name=service) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:25.294246 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf29472c-77a5-4cfb-bc21-328863b30e70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:25.295636 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf29472c-77a5-4cfb-bc21-328863b30e70 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:25.304602 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 317/628] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Jun 8 11:53:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:25.305486 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29472c-77a5-4cfb-bc21-328863b30e70 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:25.328120 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d0c60-ee72-4fbf-ab69-54eea050ae02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:25.329315 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d0c60-ee72-4fbf-ab69-54eea050ae02 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:25.329839 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d0c60-ee72-4fbf-ab69-54eea050ae02 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:25.330381 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d0c60-ee72-4fbf-ab69-54eea050ae02 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:25.331387 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741d0c60-ee72-4fbf-ab69-54eea050ae02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:25.331999 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741d0c60-ee72-4fbf-ab69-54eea050ae02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:25.333945 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741d0c60-ee72-4fbf-ab69-54eea050ae02 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:25.349695 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 312/629] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:53:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:25.350898 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d0c60-ee72-4fbf-ab69-54eea050ae02 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:25.414874 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29472c-77a5-4cfb-bc21-328863b30e70 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:25.425856 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:25.454146 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:25.464366 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a34a4-84e1-4758-becc-35aabd463b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:25.465203 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a34a4-84e1-4758-becc-35aabd463b2e None admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:25.465487 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a34a4-84e1-4758-becc-35aabd463b2e None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:25.465832 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a34a4-84e1-4758-becc-35aabd463b2e None admin] PATH_INFO: `/v3/projects/6a7fee684e8b43e199c95aeeb92640d4/users/753bde6a72d64045abd3ad44b9b0de04/roles/125b7374688b4b009d443f1b34947c49` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:25.476130 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d0c60-ee72-4fbf-ab69-54eea050ae02 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:25.483839 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a34a4-84e1-4758-becc-35aabd463b2e None admin] RBAC: Authorizing `identity:create_grant(project_id=6a7fee684e8b43e199c95aeeb92640d4, user_id=753bde6a72d64045abd3ad44b9b0de04, role_id=125b7374688b4b009d443f1b34947c49)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:25.485356 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a34a4-84e1-4758-becc-35aabd463b2e None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:25.501663 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 318/630] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Jun 8 11:53:25 2022] PUT /identity/v3/projects/6a7fee684e8b43e199c95aeeb92640d4/users/753bde6a72d64045abd3ad44b9b0de04/roles/125b7374688b4b009d443f1b34947c49 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 11:53:25.502652 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a34a4-84e1-4758-becc-35aabd463b2e None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:25.518793 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb2976-0aac-423a-a548-8722289f5d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:25.520094 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb2976-0aac-423a-a548-8722289f5d9e None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:25.520660 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb2976-0aac-423a-a548-8722289f5d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:25.521139 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb2976-0aac-423a-a548-8722289f5d9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:25.534361 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb2976-0aac-423a-a548-8722289f5d9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:25.536357 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb2976-0aac-423a-a548-8722289f5d9e None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:25.556755 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-22bb2976-0aac-423a-a548-8722289f5d9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:25.556755 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:25.556755 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:25.556755 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:25.556755 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:25.556755 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:25.556755 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:25.556755 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:25.556755 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:25.556755 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:25.556755 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:25.556755 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:25.556755 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:53:25.556755 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:53:25.556755 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:53:25.557748 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:53:25.557748 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:25.557748 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:25.557748 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:25.557748 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:25.557748 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:25.557748 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:25.557748 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:25.557748 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:25.557748 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:25.557748 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:25.557748 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:25.557748 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:25.557748 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:25.557748 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:25.557748 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:25.557748 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:25.558666 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:53:25.558666 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:53:25.558666 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:25.558666 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:25.561345 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 313/631] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:53:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:25.573945 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb2976-0aac-423a-a548-8722289f5d9e None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:25.618083 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a34a4-84e1-4758-becc-35aabd463b2e None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:25.661176 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c5fa7-8131-4809-a9ca-44dbc13bc849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:25.661993 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c5fa7-8131-4809-a9ca-44dbc13bc849 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:25.662276 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c5fa7-8131-4809-a9ca-44dbc13bc849 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:25.662555 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c5fa7-8131-4809-a9ca-44dbc13bc849 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:25.672010 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71c5fa7-8131-4809-a9ca-44dbc13bc849 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:25.673278 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71c5fa7-8131-4809-a9ca-44dbc13bc849 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:25.689181 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-f71c5fa7-8131-4809-a9ca-44dbc13bc849 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 08 11:53:25.689181 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:25.689181 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:25.689181 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:25.689181 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:25.689181 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:25.689181 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:25.689181 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:25.689181 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:25.689181 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:25.689181 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:25.689181 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:25.689181 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 11:53:25.689181 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 11:53:25.689181 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 11:53:25.689181 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 11:53:25.690224 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:25.690224 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:25.690224 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 11:53:25.690224 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:53:25.690224 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 11:53:25.690224 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:53:25.690224 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:25.690224 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:25.690224 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:25.690224 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:25.690224 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:25.690224 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:25.690224 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:25.690224 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:25.690224 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:25.690224 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:25.690224 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:25.690224 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:25.691201 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:25.691201 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:25.691201 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 11:53:25.691201 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 11:53:25.691201 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 11:53:25.691201 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 11:53:25.691201 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 11:53:25.691201 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 11:53:25.691201 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 08 11:53:25.691201 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:25.691201 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 319/632] 10.222.0.39 () {56 vars in 1093 bytes} [Wed Jun 8 11:53:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:25.691792 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e35f6f-ae83-44cf-b38c-bf638b0e54b0 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:25.692761 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e35f6f-ae83-44cf-b38c-bf638b0e54b0 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:25.692761 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e35f6f-ae83-44cf-b38c-bf638b0e54b0 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:25.694018 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 320/633] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:53:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:53:25.701962 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e35f6f-ae83-44cf-b38c-bf638b0e54b0 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:25.707755 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb2976-0aac-423a-a548-8722289f5d9e None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:25.723547 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:25.760121 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b83e4c-5c7a-4037-a8ec-12f68ca826c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:25.761105 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b83e4c-5c7a-4037-a8ec-12f68ca826c5 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:25.761547 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b83e4c-5c7a-4037-a8ec-12f68ca826c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:25.762002 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b83e4c-5c7a-4037-a8ec-12f68ca826c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:25.762884 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b83e4c-5c7a-4037-a8ec-12f68ca826c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:25.763345 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b83e4c-5c7a-4037-a8ec-12f68ca826c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:25.764980 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b83e4c-5c7a-4037-a8ec-12f68ca826c5 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:25.767689 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:25.778918 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 314/634] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:53:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:25.782500 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65dbe3-1345-4dc7-8d97-610f53b9eb24 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:25.782500 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65dbe3-1345-4dc7-8d97-610f53b9eb24 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:25.782500 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65dbe3-1345-4dc7-8d97-610f53b9eb24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:25.799031 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-7d65dbe3-1345-4dc7-8d97-610f53b9eb24 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:53:25.800134 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-7d65dbe3-1345-4dc7-8d97-610f53b9eb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:53:25.837982 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e35f6f-ae83-44cf-b38c-bf638b0e54b0 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:25.871813 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 315/635] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:53:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:53:25.873521 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f2d786-6bc1-49af-8000-2e836f85c08c None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:25.873811 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f2d786-6bc1-49af-8000-2e836f85c08c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:25.874084 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f2d786-6bc1-49af-8000-2e836f85c08c None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:25.879342 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 316/636] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:53:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:53:25.879342 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f2d786-6bc1-49af-8000-2e836f85c08c None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:25.888189 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137ee20-0bc5-4be7-9b3f-d47187b7f9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:25.888189 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137ee20-0bc5-4be7-9b3f-d47187b7f9a2 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:25.888189 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137ee20-0bc5-4be7-9b3f-d47187b7f9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:25.888189 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137ee20-0bc5-4be7-9b3f-d47187b7f9a2 None admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:25.888929 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b137ee20-0bc5-4be7-9b3f-d47187b7f9a2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:25.888929 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b137ee20-0bc5-4be7-9b3f-d47187b7f9a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:25.888929 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b137ee20-0bc5-4be7-9b3f-d47187b7f9a2 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:25.908588 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 321/637] 10.222.0.39 () {56 vars in 1133 bytes} [Wed Jun 8 11:53:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:25.909878 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe179dc1-5406-404b-8365-7e95c6a7c962 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:25.910230 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe179dc1-5406-404b-8365-7e95c6a7c962 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:25.910514 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe179dc1-5406-404b-8365-7e95c6a7c962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:25.927537 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-fe179dc1-5406-404b-8365-7e95c6a7c962 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:53:25.928752 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-fe179dc1-5406-404b-8365-7e95c6a7c962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:53:26.000916 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f2d786-6bc1-49af-8000-2e836f85c08c None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:26.001507 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 322/638] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:53:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:53:26.002229 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe179dc1-5406-404b-8365-7e95c6a7c962 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:26.011351 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:26.044286 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:26.055359 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ceaa3b-774b-4225-bc1f-94d34ae73407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:26.056781 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ceaa3b-774b-4225-bc1f-94d34ae73407 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:26.057286 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ceaa3b-774b-4225-bc1f-94d34ae73407 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:26.057795 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ceaa3b-774b-4225-bc1f-94d34ae73407 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:26.065500 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ceaa3b-774b-4225-bc1f-94d34ae73407 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:26.066962 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ceaa3b-774b-4225-bc1f-94d34ae73407 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:26.086570 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-32ceaa3b-774b-4225-bc1f-94d34ae73407 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 08 11:53:26.086570 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:26.086570 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:26.086570 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:26.086570 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:26.086570 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:26.086570 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:26.086570 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:26.086570 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:26.086570 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:26.086570 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:26.086570 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:26.086570 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 11:53:26.086570 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 11:53:26.086570 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 11:53:26.086570 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 11:53:26.088408 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:26.088408 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:26.088408 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 11:53:26.088408 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:53:26.088408 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 11:53:26.088408 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:53:26.088408 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:26.088408 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:26.088408 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:26.088408 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:26.088408 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:26.088408 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:26.088408 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:26.088408 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:26.088408 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:26.088408 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:26.088408 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:26.088408 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:26.089320 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:26.089320 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:26.089320 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 11:53:26.089320 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 11:53:26.089320 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 11:53:26.089320 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 11:53:26.089320 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 11:53:26.089320 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 11:53:26.089320 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 08 11:53:26.089320 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:26.089320 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 317/639] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:53:25 2022] GET /identity/v3/users/glance => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:26.090048 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ceaa3b-774b-4225-bc1f-94d34ae73407 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:26.136900 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe179dc1-5406-404b-8365-7e95c6a7c962 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:26.175285 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400113b4-9ace-481f-a8aa-9073e181a693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:26.176218 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400113b4-9ace-481f-a8aa-9073e181a693 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:26.176506 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400113b4-9ace-481f-a8aa-9073e181a693 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:26.176779 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400113b4-9ace-481f-a8aa-9073e181a693 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:26.188019 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400113b4-9ace-481f-a8aa-9073e181a693 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:53:26.196385 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-400113b4-9ace-481f-a8aa-9073e181a693 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 11:53:26.196385 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:26.196385 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:26.196385 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:26.196385 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:26.196385 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:26.196385 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:26.196385 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:26.196385 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:26.196385 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:26.196385 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:26.196385 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:26.196385 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:53:26.196385 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:53:26.196385 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:53:26.196385 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:53:26.197856 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:53:26.197856 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:53:26.197856 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:53:26.197856 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:53:26.197856 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:26.197856 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:26.197856 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:26.197856 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:26.197856 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:26.197856 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:26.197856 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:26.197856 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:26.197856 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:26.197856 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:26.197856 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:26.197856 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:26.198685 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:26.198685 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:26.198685 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:26.198685 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:26.198685 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:53:26.198685 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:53:26.198685 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:53:26.198685 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:53:26.198685 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:53:26.198685 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:53:26.198685 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 11:53:26.198685 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:26.199316 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ceaa3b-774b-4225-bc1f-94d34ae73407 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:26.203193 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 323/640] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Jun 8 11:53:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:26.203798 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400113b4-9ace-481f-a8aa-9073e181a693 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:26.237624 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049ca23-5e90-435a-93d8-c897ba3d1208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:26.238549 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049ca23-5e90-435a-93d8-c897ba3d1208 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:26.238834 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049ca23-5e90-435a-93d8-c897ba3d1208 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:26.239105 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049ca23-5e90-435a-93d8-c897ba3d1208 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:26.273944 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:26.298719 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:26.313858 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d049ca23-5e90-435a-93d8-c897ba3d1208 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:26.314830 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400113b4-9ace-481f-a8aa-9073e181a693 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:26.315522 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d049ca23-5e90-435a-93d8-c897ba3d1208 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:26.357656 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e0ac1-8b9a-45a1-91b3-ac9458de66c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:26.358462 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e0ac1-8b9a-45a1-91b3-ac9458de66c3 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:26.358794 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e0ac1-8b9a-45a1-91b3-ac9458de66c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:26.359072 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e0ac1-8b9a-45a1-91b3-ac9458de66c3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:26.375259 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8e0ac1-8b9a-45a1-91b3-ac9458de66c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:53:26.383611 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-6e8e0ac1-8b9a-45a1-91b3-ac9458de66c3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 11:53:26.383611 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:26.383611 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:26.383611 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:26.383611 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:26.383611 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:26.383611 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:26.383611 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:26.383611 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:26.383611 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:26.383611 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:26.383611 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:26.383611 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:53:26.383611 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:53:26.383611 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:53:26.383611 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:53:26.385153 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:53:26.385153 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:53:26.385153 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:53:26.385153 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:53:26.385153 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:26.385153 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:26.385153 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:26.385153 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:26.385153 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:26.385153 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:26.385153 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:26.385153 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:26.385153 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:26.385153 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:26.385153 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:26.385153 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:26.385998 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:26.385998 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:26.385998 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:26.385998 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:26.385998 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:53:26.385998 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:53:26.385998 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:53:26.385998 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:53:26.385998 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:53:26.385998 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:53:26.385998 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 11:53:26.385998 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:26.385998 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 324/641] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Jun 8 11:53:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:26.386681 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e0ac1-8b9a-45a1-91b3-ac9458de66c3 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:26.436110 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 318/642] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:53:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 11:53:26.436893 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049ca23-5e90-435a-93d8-c897ba3d1208 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:26.499597 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e0ac1-8b9a-45a1-91b3-ac9458de66c3 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:26.524705 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:26.525625 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:26.535798 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823554b3-01dc-426d-90d4-bb3198315a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:26.536718 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823554b3-01dc-426d-90d4-bb3198315a00 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:26.537141 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823554b3-01dc-426d-90d4-bb3198315a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:26.537571 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823554b3-01dc-426d-90d4-bb3198315a00 None admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:26.538406 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823554b3-01dc-426d-90d4-bb3198315a00 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:26.538712 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823554b3-01dc-426d-90d4-bb3198315a00 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:26.540124 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823554b3-01dc-426d-90d4-bb3198315a00 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:26.542495 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049ca23-5e90-435a-93d8-c897ba3d1208 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:26.562881 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 325/643] 10.222.0.39 () {56 vars in 1137 bytes} [Wed Jun 8 11:53:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:26.563732 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823554b3-01dc-426d-90d4-bb3198315a00 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:26.581570 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed0ad1-eb6b-4e4d-a705-a67402f70735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:26.582279 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed0ad1-eb6b-4e4d-a705-a67402f70735 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:26.582562 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed0ad1-eb6b-4e4d-a705-a67402f70735 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:26.582834 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed0ad1-eb6b-4e4d-a705-a67402f70735 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:26.583578 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eed0ad1-eb6b-4e4d-a705-a67402f70735 None admin] RBAC: Adding query filter params (name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:26.583883 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eed0ad1-eb6b-4e4d-a705-a67402f70735 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:26.585304 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eed0ad1-eb6b-4e4d-a705-a67402f70735 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:26.598977 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 319/644] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Jun 8 11:53:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:26.599813 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed0ad1-eb6b-4e4d-a705-a67402f70735 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:26.685070 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823554b3-01dc-426d-90d4-bb3198315a00 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:26.711237 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed0ad1-eb6b-4e4d-a705-a67402f70735 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:26.725498 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9feb79-2f23-4ab0-a1db-be59de93d65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:26.726417 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9feb79-2f23-4ab0-a1db-be59de93d65e None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:26.726886 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9feb79-2f23-4ab0-a1db-be59de93d65e None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:26.727383 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9feb79-2f23-4ab0-a1db-be59de93d65e None admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:26.728888 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9feb79-2f23-4ab0-a1db-be59de93d65e None admin] RBAC: Adding query filter params (name=service) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:26.729383 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9feb79-2f23-4ab0-a1db-be59de93d65e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:26.730940 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9feb79-2f23-4ab0-a1db-be59de93d65e None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:26.739828 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 326/645] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Jun 8 11:53:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:26.740934 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9feb79-2f23-4ab0-a1db-be59de93d65e None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:26.752855 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935fcd3b-8fdb-4459-a60b-d5472bd6502e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:26.753733 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935fcd3b-8fdb-4459-a60b-d5472bd6502e None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:26.754083 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935fcd3b-8fdb-4459-a60b-d5472bd6502e None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:26.754366 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935fcd3b-8fdb-4459-a60b-d5472bd6502e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:26.765779 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935fcd3b-8fdb-4459-a60b-d5472bd6502e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:26.767244 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935fcd3b-8fdb-4459-a60b-d5472bd6502e None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:26.775423 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:26.785717 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-935fcd3b-8fdb-4459-a60b-d5472bd6502e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:26.785717 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:26.785717 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:26.785717 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:26.785717 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:26.785717 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:26.785717 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:26.785717 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:26.785717 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:26.785717 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:26.785717 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:26.785717 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:26.785717 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:53:26.785717 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:53:26.785717 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:53:26.786621 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:53:26.786621 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:26.786621 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:26.786621 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:26.786621 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:26.786621 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:26.786621 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:26.786621 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:26.786621 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:26.786621 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:26.786621 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:26.786621 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:26.786621 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:26.786621 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:26.786621 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:26.786621 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:26.786621 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:26.787676 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:53:26.787676 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:53:26.787676 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:26.787676 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:26.791314 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 320/646] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:53:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:26.792343 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935fcd3b-8fdb-4459-a60b-d5472bd6502e None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:26.803723 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:26.860355 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9feb79-2f23-4ab0-a1db-be59de93d65e None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:26.895794 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e95ff-350a-420c-8c09-dc8976c324b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:26.896584 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e95ff-350a-420c-8c09-dc8976c324b6 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:26.896935 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e95ff-350a-420c-8c09-dc8976c324b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:26.897225 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e95ff-350a-420c-8c09-dc8976c324b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:26.903338 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935fcd3b-8fdb-4459-a60b-d5472bd6502e None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:26.940261 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407f6cc-af1a-4140-b808-88d91c7bb56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:26.941059 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407f6cc-af1a-4140-b808-88d91c7bb56b None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:26.941470 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407f6cc-af1a-4140-b808-88d91c7bb56b None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:26.941749 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407f6cc-af1a-4140-b808-88d91c7bb56b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:26.953142 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3407f6cc-af1a-4140-b808-88d91c7bb56b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:26.954602 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3407f6cc-af1a-4140-b808-88d91c7bb56b None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:26.969635 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e95ff-350a-420c-8c09-dc8976c324b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:26.971313 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e95ff-350a-420c-8c09-dc8976c324b6 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:26.971885 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-3407f6cc-af1a-4140-b808-88d91c7bb56b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:26.971885 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:26.971885 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:26.971885 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:26.971885 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:26.971885 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:26.971885 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:26.971885 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:26.971885 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:26.971885 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:26.971885 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:26.971885 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:26.971885 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:53:26.971885 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:53:26.971885 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:53:26.972930 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:53:26.972930 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:26.972930 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:26.972930 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:26.972930 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:26.972930 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:26.972930 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:26.972930 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:26.972930 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:26.972930 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:26.972930 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:26.972930 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:26.972930 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:26.972930 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:26.972930 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:26.972930 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:26.972930 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:26.974280 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:53:26.974280 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:53:26.974280 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:26.974280 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:26.977839 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 321/647] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:53:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:26.979191 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407f6cc-af1a-4140-b808-88d91c7bb56b None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:27.022221 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:27.033547 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:27.081162 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407f6cc-af1a-4140-b808-88d91c7bb56b None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:27.087531 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 327/648] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:53:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 11:53:27.087531 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e95ff-350a-420c-8c09-dc8976c324b6 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:27.122529 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b50e5-71bb-454a-9931-2193f12a2a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:27.123262 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b50e5-71bb-454a-9931-2193f12a2a86 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:27.123546 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b50e5-71bb-454a-9931-2193f12a2a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:27.123827 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b50e5-71bb-454a-9931-2193f12a2a86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:27.134896 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52b50e5-71bb-454a-9931-2193f12a2a86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:27.136306 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52b50e5-71bb-454a-9931-2193f12a2a86 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:27.154437 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-e52b50e5-71bb-454a-9931-2193f12a2a86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:27.154437 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:27.154437 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:27.154437 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:27.154437 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:27.154437 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:27.154437 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:27.154437 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:27.154437 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:27.154437 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:27.154437 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:27.154437 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:27.154437 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:53:27.154437 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:53:27.154437 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:53:27.155417 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:53:27.155417 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:27.155417 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:27.155417 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:27.155417 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:27.155417 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:27.155417 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:27.155417 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:27.155417 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:27.155417 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:27.155417 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:27.155417 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:27.155417 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:27.155417 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:27.155417 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:27.155417 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:27.155417 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:27.156391 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:53:27.156391 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:53:27.156391 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:27.156391 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:27.156391 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 322/649] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:53:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:27.156663 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b50e5-71bb-454a-9931-2193f12a2a86 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:27.194341 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e95ff-350a-420c-8c09-dc8976c324b6 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:27.235199 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65037473-1c70-41de-973c-4ff4ea060ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:27.235871 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65037473-1c70-41de-973c-4ff4ea060ae4 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:27.236154 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65037473-1c70-41de-973c-4ff4ea060ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:27.236459 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65037473-1c70-41de-973c-4ff4ea060ae4 None admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:27.237185 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65037473-1c70-41de-973c-4ff4ea060ae4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:27.237492 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65037473-1c70-41de-973c-4ff4ea060ae4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:27.238860 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65037473-1c70-41de-973c-4ff4ea060ae4 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:27.256261 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 328/650] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:53:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:27.256261 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65037473-1c70-41de-973c-4ff4ea060ae4 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:27.263017 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:27.282203 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b50e5-71bb-454a-9931-2193f12a2a86 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:27.285483 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:27.320565 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b740a60-4a71-43ff-affd-1ad27a58897f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:27.321240 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b740a60-4a71-43ff-affd-1ad27a58897f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:27.321528 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b740a60-4a71-43ff-affd-1ad27a58897f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:27.322466 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b740a60-4a71-43ff-affd-1ad27a58897f None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:27.323607 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b740a60-4a71-43ff-affd-1ad27a58897f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:27.324428 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b740a60-4a71-43ff-affd-1ad27a58897f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:27.326133 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b740a60-4a71-43ff-affd-1ad27a58897f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:27.346399 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 323/651] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:53:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:27.347503 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b740a60-4a71-43ff-affd-1ad27a58897f None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:27.359708 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65037473-1c70-41de-973c-4ff4ea060ae4 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:27.396380 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46efba04-c384-4eb1-b224-211a0b68cfe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:27.397105 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46efba04-c384-4eb1-b224-211a0b68cfe6 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:27.397388 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46efba04-c384-4eb1-b224-211a0b68cfe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:27.397663 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46efba04-c384-4eb1-b224-211a0b68cfe6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:27.409167 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46efba04-c384-4eb1-b224-211a0b68cfe6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:27.410619 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46efba04-c384-4eb1-b224-211a0b68cfe6 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:27.427834 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-46efba04-c384-4eb1-b224-211a0b68cfe6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:27.427834 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:27.427834 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:27.427834 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:27.427834 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:27.427834 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:27.427834 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:27.427834 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:27.427834 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:27.427834 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:27.427834 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:27.427834 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:27.427834 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:53:27.427834 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:53:27.427834 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:53:27.428973 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:53:27.428973 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:27.428973 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:27.428973 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:27.428973 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:27.428973 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:27.428973 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:27.428973 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:27.428973 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:27.428973 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:27.428973 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:27.428973 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:27.428973 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:27.428973 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:27.428973 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:27.428973 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:27.428973 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:27.430020 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:53:27.430020 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:53:27.430020 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:27.430020 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:27.432445 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 329/652] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:53:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:27.433390 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46efba04-c384-4eb1-b224-211a0b68cfe6 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:27.459191 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b740a60-4a71-43ff-affd-1ad27a58897f None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:27.496267 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:27.497839 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b037bb47-f92f-40d9-960d-4bceec7dff0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:27.498648 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037bb47-f92f-40d9-960d-4bceec7dff0b None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:27.499021 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037bb47-f92f-40d9-960d-4bceec7dff0b None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:27.499337 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037bb47-f92f-40d9-960d-4bceec7dff0b None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:27.500034 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b037bb47-f92f-40d9-960d-4bceec7dff0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:27.500368 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b037bb47-f92f-40d9-960d-4bceec7dff0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:27.501808 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b037bb47-f92f-40d9-960d-4bceec7dff0b None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:27.519754 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 324/653] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:53:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:27.519754 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b037bb47-f92f-40d9-960d-4bceec7dff0b None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:27.543823 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46efba04-c384-4eb1-b224-211a0b68cfe6 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:27.546660 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:27.584546 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca40f52-f957-415b-9f60-2f05f158681f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:27.585837 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca40f52-f957-415b-9f60-2f05f158681f None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:27.586078 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca40f52-f957-415b-9f60-2f05f158681f None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:27.586417 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca40f52-f957-415b-9f60-2f05f158681f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:27.597538 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca40f52-f957-415b-9f60-2f05f158681f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:27.599331 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca40f52-f957-415b-9f60-2f05f158681f None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:27.614260 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-5ca40f52-f957-415b-9f60-2f05f158681f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:53:27.614260 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:27.614260 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:27.614260 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:27.614260 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:27.614260 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:27.614260 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:27.614260 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:27.614260 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:27.614260 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:27.614260 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:27.614260 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:27.614260 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 11:53:27.614260 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 11:53:27.614260 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 11:53:27.615163 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 11:53:27.615163 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:27.615163 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:27.615163 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:27.615163 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:27.615163 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:27.615163 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:27.615163 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:27.615163 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:27.615163 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:27.615163 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:27.615163 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:27.615163 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:27.615163 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:27.615163 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:27.615163 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:27.615163 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:27.616046 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 11:53:27.616046 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 11:53:27.616046 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 11:53:27.616046 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 11:53:27.616046 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 11:53:27.616046 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 11:53:27.616046 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:53:27.616046 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:27.616046 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 330/654] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Jun 8 11:53:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:27.616946 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca40f52-f957-415b-9f60-2f05f158681f None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:27.636443 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b037bb47-f92f-40d9-960d-4bceec7dff0b None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:27.678743 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e565c-df5a-46a3-9072-44876102b7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:27.679593 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e565c-df5a-46a3-9072-44876102b7c8 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:27.679886 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e565c-df5a-46a3-9072-44876102b7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:27.680200 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e565c-df5a-46a3-9072-44876102b7c8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:27.689153 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845e565c-df5a-46a3-9072-44876102b7c8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:27.690600 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845e565c-df5a-46a3-9072-44876102b7c8 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:27.708850 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-845e565c-df5a-46a3-9072-44876102b7c8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 08 11:53:27.708850 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:27.708850 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:27.708850 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:27.708850 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:27.708850 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:27.708850 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:27.708850 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:27.708850 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:27.708850 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:27.708850 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:27.708850 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:27.708850 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 11:53:27.708850 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 11:53:27.708850 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 11:53:27.708850 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 11:53:27.709826 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:27.709826 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:27.709826 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 11:53:27.709826 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:53:27.709826 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 11:53:27.709826 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:53:27.709826 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:27.709826 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:27.709826 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:27.709826 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:27.709826 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:27.709826 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:27.709826 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:27.709826 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:27.709826 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:27.709826 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:27.709826 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:27.709826 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:27.710785 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:27.710785 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:27.710785 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 11:53:27.710785 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 11:53:27.710785 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 11:53:27.710785 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 11:53:27.710785 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 11:53:27.710785 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 11:53:27.710785 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 08 11:53:27.710785 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:27.710785 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 325/655] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Jun 8 11:53:27 2022] GET /identity/v3/users/neutron => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:27.711810 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e565c-df5a-46a3-9072-44876102b7c8 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:27.729973 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca40f52-f957-415b-9f60-2f05f158681f None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:27.748694 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:27.767877 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16320d-3963-4335-a307-2ca6e4203125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:27.768572 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16320d-3963-4335-a307-2ca6e4203125 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:27.768866 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16320d-3963-4335-a307-2ca6e4203125 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:27.769143 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16320d-3963-4335-a307-2ca6e4203125 None admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:27.769872 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d16320d-3963-4335-a307-2ca6e4203125 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:27.770181 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d16320d-3963-4335-a307-2ca6e4203125 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:27.771564 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d16320d-3963-4335-a307-2ca6e4203125 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:27.784096 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 331/656] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:53:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:27.789063 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16320d-3963-4335-a307-2ca6e4203125 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:27.805370 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:27.823100 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e565c-df5a-46a3-9072-44876102b7c8 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:27.858311 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2590e53-6d50-4171-929b-e1d50e0169eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:27.859111 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2590e53-6d50-4171-929b-e1d50e0169eb None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:27.859398 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2590e53-6d50-4171-929b-e1d50e0169eb None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:27.859678 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2590e53-6d50-4171-929b-e1d50e0169eb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:27.867060 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2590e53-6d50-4171-929b-e1d50e0169eb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:27.868626 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2590e53-6d50-4171-929b-e1d50e0169eb None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:27.882864 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-f2590e53-6d50-4171-929b-e1d50e0169eb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 08 11:53:27.882864 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:27.882864 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:27.882864 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:27.882864 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:27.882864 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:27.882864 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:27.882864 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:27.882864 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:27.882864 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:27.882864 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:27.882864 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:27.882864 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 11:53:27.882864 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 11:53:27.882864 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 11:53:27.882864 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 11:53:27.883953 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:27.883953 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:27.883953 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 11:53:27.883953 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:53:27.883953 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 11:53:27.883953 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:53:27.883953 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:27.883953 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:27.883953 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:27.883953 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:27.883953 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:27.883953 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:27.883953 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:27.883953 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:27.883953 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:27.883953 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:27.883953 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:27.883953 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:27.889828 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:27.889828 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:27.889828 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 11:53:27.889828 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 11:53:27.889828 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 11:53:27.889828 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 11:53:27.889828 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 11:53:27.889828 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 11:53:27.889828 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 08 11:53:27.889828 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:27.889828 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 326/657] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:53:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:27.889828 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2590e53-6d50-4171-929b-e1d50e0169eb None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:27.892792 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16320d-3963-4335-a307-2ca6e4203125 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:27.926129 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da401a2-71b3-43ff-90de-6baa8bedbb4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:27.926792 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da401a2-71b3-43ff-90de-6baa8bedbb4c None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:27.927077 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da401a2-71b3-43ff-90de-6baa8bedbb4c None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:27.927352 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da401a2-71b3-43ff-90de-6baa8bedbb4c None admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:27.928133 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da401a2-71b3-43ff-90de-6baa8bedbb4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:27.928469 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da401a2-71b3-43ff-90de-6baa8bedbb4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:27.929955 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da401a2-71b3-43ff-90de-6baa8bedbb4c None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:27.942476 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 332/658] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Jun 8 11:53:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:27.943282 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da401a2-71b3-43ff-90de-6baa8bedbb4c None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:27.984799 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2590e53-6d50-4171-929b-e1d50e0169eb None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:27.985833 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:28.018283 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d85c8-d2b8-4a3b-9278-d02b1cbd5500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:28.018952 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d85c8-d2b8-4a3b-9278-d02b1cbd5500 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:28.019234 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d85c8-d2b8-4a3b-9278-d02b1cbd5500 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:28.019507 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d85c8-d2b8-4a3b-9278-d02b1cbd5500 None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:28.020372 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006d85c8-d2b8-4a3b-9278-d02b1cbd5500 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:28.020685 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006d85c8-d2b8-4a3b-9278-d02b1cbd5500 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:28.022110 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006d85c8-d2b8-4a3b-9278-d02b1cbd5500 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:28.039233 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 327/659] 10.222.0.39 () {56 vars in 1139 bytes} [Wed Jun 8 11:53:27 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:28.040552 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d4da6-7ec3-4019-a230-b94500319fde None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:28.041317 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d4da6-7ec3-4019-a230-b94500319fde None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:28.041600 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d4da6-7ec3-4019-a230-b94500319fde None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:28.044342 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 328/660] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:53:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:53:28.044342 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d4da6-7ec3-4019-a230-b94500319fde None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:28.046138 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:28.048828 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da401a2-71b3-43ff-90de-6baa8bedbb4c None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:28.082989 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70051c09-a140-424f-bff8-ecb7eaec8fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:28.083773 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70051c09-a140-424f-bff8-ecb7eaec8fbb None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:28.084051 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70051c09-a140-424f-bff8-ecb7eaec8fbb None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:28.084353 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70051c09-a140-424f-bff8-ecb7eaec8fbb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:28.091798 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70051c09-a140-424f-bff8-ecb7eaec8fbb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:28.093316 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70051c09-a140-424f-bff8-ecb7eaec8fbb None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:28.107982 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-70051c09-a140-424f-bff8-ecb7eaec8fbb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:53:28.107982 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:28.107982 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:28.107982 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:28.107982 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:28.107982 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:28.107982 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:28.107982 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:28.107982 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:28.107982 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:28.107982 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:28.107982 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:28.107982 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 11:53:28.107982 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 11:53:28.107982 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 11:53:28.108945 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 11:53:28.108945 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:28.108945 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:28.108945 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:28.108945 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:28.108945 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:28.108945 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:28.108945 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:28.108945 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:28.108945 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:28.108945 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:28.108945 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:28.108945 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:28.108945 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:28.108945 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:28.108945 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:28.108945 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:28.109851 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 11:53:28.109851 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 11:53:28.109851 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 11:53:28.109851 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 11:53:28.109851 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 11:53:28.109851 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 11:53:28.109851 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:53:28.109851 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:28.109851 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 333/661] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Jun 8 11:53:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:28.110338 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70051c09-a140-424f-bff8-ecb7eaec8fbb None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:28.152409 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d4da6-7ec3-4019-a230-b94500319fde None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:28.185448 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ca901-5b13-42a0-9925-b9bde0a72684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:28.186049 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ca901-5b13-42a0-9925-b9bde0a72684 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:28.186330 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ca901-5b13-42a0-9925-b9bde0a72684 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:28.186602 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ca901-5b13-42a0-9925-b9bde0a72684 None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:28.187432 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90ca901-5b13-42a0-9925-b9bde0a72684 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:28.187737 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90ca901-5b13-42a0-9925-b9bde0a72684 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:28.189226 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90ca901-5b13-42a0-9925-b9bde0a72684 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:28.206438 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:28.206580 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 329/662] 10.222.0.39 () {56 vars in 1137 bytes} [Wed Jun 8 11:53:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:28.207275 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ca901-5b13-42a0-9925-b9bde0a72684 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:28.214640 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70051c09-a140-424f-bff8-ecb7eaec8fbb None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:28.248779 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c4beb9-aa2b-447e-acba-404f5895c547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:28.249437 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4beb9-aa2b-447e-acba-404f5895c547 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:28.249724 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4beb9-aa2b-447e-acba-404f5895c547 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:28.250002 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4beb9-aa2b-447e-acba-404f5895c547 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:28.250829 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c4beb9-aa2b-447e-acba-404f5895c547 None admin] RBAC: Adding query filter params (role.id=125b7374688b4b009d443f1b34947c49, scope.project.id=6a7fee684e8b43e199c95aeeb92640d4, user.id=7ef7edb5e9ce49e6b098f48bf060b228) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:28.251149 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c4beb9-aa2b-447e-acba-404f5895c547 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:28.252610 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c4beb9-aa2b-447e-acba-404f5895c547 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:28.258315 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 334/663] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Jun 8 11:53:28 2022] GET /identity/v3/role_assignments?user.id=7ef7edb5e9ce49e6b098f48bf060b228&scope.project.id=6a7fee684e8b43e199c95aeeb92640d4&role.id=125b7374688b4b009d443f1b34947c49 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:28.259603 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39455bf-b23f-4a8e-a3e6-9c9db3b3e9d0 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:28.260061 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39455bf-b23f-4a8e-a3e6-9c9db3b3e9d0 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:28.260446 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39455bf-b23f-4a8e-a3e6-9c9db3b3e9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:28.276704 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:28.279739 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-e39455bf-b23f-4a8e-a3e6-9c9db3b3e9d0 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:53:28.281712 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-e39455bf-b23f-4a8e-a3e6-9c9db3b3e9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:53:28.324357 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ca901-5b13-42a0-9925-b9bde0a72684 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:28.363906 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f791dd8-b508-4b54-8e0d-116649197ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:28.364662 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f791dd8-b508-4b54-8e0d-116649197ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:28.364945 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f791dd8-b508-4b54-8e0d-116649197ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:28.365221 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f791dd8-b508-4b54-8e0d-116649197ea7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:28.376525 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 335/664] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:53:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:53:28.377441 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39455bf-b23f-4a8e-a3e6-9c9db3b3e9d0 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:28.452781 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f791dd8-b508-4b54-8e0d-116649197ea7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:28.454540 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f791dd8-b508-4b54-8e0d-116649197ea7 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:28.498089 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:28.507402 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39455bf-b23f-4a8e-a3e6-9c9db3b3e9d0 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:28.553226 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:28.557225 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da4a7e-d21c-4748-9174-45ee5af236b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:28.557999 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da4a7e-d21c-4748-9174-45ee5af236b5 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:28.558381 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da4a7e-d21c-4748-9174-45ee5af236b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:28.558695 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da4a7e-d21c-4748-9174-45ee5af236b5 None admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:28.559559 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3da4a7e-d21c-4748-9174-45ee5af236b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:28.559938 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3da4a7e-d21c-4748-9174-45ee5af236b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:28.561471 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3da4a7e-d21c-4748-9174-45ee5af236b5 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:28.576555 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 336/665] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Jun 8 11:53:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:28.576555 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da4a7e-d21c-4748-9174-45ee5af236b5 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:28.604150 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 330/666] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:53:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 11:53:28.605279 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f791dd8-b508-4b54-8e0d-116649197ea7 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:28.698338 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da4a7e-d21c-4748-9174-45ee5af236b5 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:28.710312 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f791dd8-b508-4b54-8e0d-116649197ea7 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:28.735319 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8700d0d-873b-4a50-8972-50002650e174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:28.735979 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8700d0d-873b-4a50-8972-50002650e174 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:28.736406 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8700d0d-873b-4a50-8972-50002650e174 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:28.736673 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8700d0d-873b-4a50-8972-50002650e174 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:28.746159 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f27c6-e6f2-45f7-940a-b57c727d0934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:28.747383 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f27c6-e6f2-45f7-940a-b57c727d0934 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:28.747667 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f27c6-e6f2-45f7-940a-b57c727d0934 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:28.747940 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f27c6-e6f2-45f7-940a-b57c727d0934 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:28.758850 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f27c6-e6f2-45f7-940a-b57c727d0934 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:53:28.760968 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:28.767436 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-175f27c6-e6f2-45f7-940a-b57c727d0934 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 11:53:28.767436 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:28.767436 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:28.767436 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:28.767436 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:28.767436 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:28.767436 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:28.767436 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:28.767436 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:28.767436 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:28.767436 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:28.767436 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:28.767436 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:53:28.767436 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:53:28.767436 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:53:28.767436 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:53:28.768448 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:53:28.768448 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:53:28.768448 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:53:28.768448 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:53:28.768448 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:28.768448 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:28.768448 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:28.768448 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:28.768448 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:28.768448 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:28.768448 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:28.768448 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:28.768448 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:28.768448 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:28.768448 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:28.768448 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:28.769300 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:28.769300 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:28.769300 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:28.769300 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:28.769300 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:53:28.769300 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:53:28.769300 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:53:28.769300 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:53:28.769300 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:53:28.769300 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:53:28.769300 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 11:53:28.769300 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:28.769300 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 331/667] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Jun 8 11:53:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:28.770002 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f27c6-e6f2-45f7-940a-b57c727d0934 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:28.792981 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:28.818434 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8700d0d-873b-4a50-8972-50002650e174 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:28.819886 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8700d0d-873b-4a50-8972-50002650e174 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:28.879960 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f27c6-e6f2-45f7-940a-b57c727d0934 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:28.917006 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb22dcbc-5c36-431b-943b-892795a97e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:28.917663 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22dcbc-5c36-431b-943b-892795a97e6c None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:28.917949 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22dcbc-5c36-431b-943b-892795a97e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:28.918230 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22dcbc-5c36-431b-943b-892795a97e6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:28.919066 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb22dcbc-5c36-431b-943b-892795a97e6c None admin] RBAC: Adding query filter params (role.id=125b7374688b4b009d443f1b34947c49, scope.project.id=6a7fee684e8b43e199c95aeeb92640d4, user.id=2e2f8b5040a048c5bf4eef36f2ecd678) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:28.919379 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb22dcbc-5c36-431b-943b-892795a97e6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:28.920850 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb22dcbc-5c36-431b-943b-892795a97e6c None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:28.936207 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 332/668] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Jun 8 11:53:28 2022] GET /identity/v3/role_assignments?user.id=2e2f8b5040a048c5bf4eef36f2ecd678&scope.project.id=6a7fee684e8b43e199c95aeeb92640d4&role.id=125b7374688b4b009d443f1b34947c49 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:28.936207 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb22dcbc-5c36-431b-943b-892795a97e6c None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:28.936509 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 337/669] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:53:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 11:53:28.936509 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8700d0d-873b-4a50-8972-50002650e174 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:28.998039 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:29.052427 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8700d0d-873b-4a50-8972-50002650e174 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:29.053592 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:29.080959 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb22dcbc-5c36-431b-943b-892795a97e6c None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:29.093880 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f3e28-1b1e-497d-bc5e-850b1cd366e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:29.094672 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f3e28-1b1e-497d-bc5e-850b1cd366e3 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:29.095030 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f3e28-1b1e-497d-bc5e-850b1cd366e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:29.095377 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f3e28-1b1e-497d-bc5e-850b1cd366e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:29.096250 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852f3e28-1b1e-497d-bc5e-850b1cd366e3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:29.096640 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852f3e28-1b1e-497d-bc5e-850b1cd366e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:29.098356 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852f3e28-1b1e-497d-bc5e-850b1cd366e3 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:29.113095 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 338/670] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Jun 8 11:53:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:29.114241 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f3e28-1b1e-497d-bc5e-850b1cd366e3 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:29.127557 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7717fc5-cf89-4724-a143-d59f1cbceb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:29.128971 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7717fc5-cf89-4724-a143-d59f1cbceb56 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:29.129326 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7717fc5-cf89-4724-a143-d59f1cbceb56 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:29.129899 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7717fc5-cf89-4724-a143-d59f1cbceb56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:29.148579 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7717fc5-cf89-4724-a143-d59f1cbceb56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:29.151527 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7717fc5-cf89-4724-a143-d59f1cbceb56 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:29.177808 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-a7717fc5-cf89-4724-a143-d59f1cbceb56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:29.177808 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:29.177808 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:29.177808 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:29.177808 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:29.177808 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:29.177808 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:29.177808 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:29.177808 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:29.177808 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:29.177808 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:29.177808 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:29.177808 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:53:29.177808 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:53:29.177808 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:53:29.178783 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:53:29.178783 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:29.178783 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:29.178783 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:29.178783 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:29.178783 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:29.178783 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:29.178783 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:29.178783 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:29.178783 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:29.178783 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:29.178783 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:29.178783 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:29.178783 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:29.178783 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:29.178783 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:29.178783 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:29.179692 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:53:29.179692 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:53:29.179692 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:29.179692 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:29.179692 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 333/671] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:53:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:29.180690 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7717fc5-cf89-4724-a143-d59f1cbceb56 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:29.253908 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f3e28-1b1e-497d-bc5e-850b1cd366e3 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:29.270978 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:29.298923 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e5454a-cd72-454d-8348-c48545685e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:29.300123 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5454a-cd72-454d-8348-c48545685e3a None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:29.300756 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5454a-cd72-454d-8348-c48545685e3a None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:29.301256 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5454a-cd72-454d-8348-c48545685e3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:29.310778 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7717fc5-cf89-4724-a143-d59f1cbceb56 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:29.313703 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e5454a-cd72-454d-8348-c48545685e3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:29.315265 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e5454a-cd72-454d-8348-c48545685e3a None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:29.334355 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-76e5454a-cd72-454d-8348-c48545685e3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:29.334355 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:29.334355 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:29.334355 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:29.334355 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:29.334355 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:29.334355 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:29.334355 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:29.334355 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:29.334355 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:29.334355 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:29.334355 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:29.334355 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:53:29.334355 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:53:29.334355 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:53:29.335576 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:53:29.335576 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:29.335576 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:29.335576 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:29.335576 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:29.335576 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:29.335576 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:29.335576 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:29.335576 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:29.335576 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:29.335576 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:29.335576 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:29.335576 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:29.335576 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:29.335576 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:29.335576 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:29.335576 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:29.336782 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:53:29.336782 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:53:29.336782 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:29.336782 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:29.338299 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 339/672] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:53:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:29.339323 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e5454a-cd72-454d-8348-c48545685e3a None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:29.355335 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00292507-0c2d-4385-a30a-0712ce8ff593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:29.356493 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00292507-0c2d-4385-a30a-0712ce8ff593 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:29.356933 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00292507-0c2d-4385-a30a-0712ce8ff593 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:29.357352 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00292507-0c2d-4385-a30a-0712ce8ff593 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:29.360506 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:29.370993 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00292507-0c2d-4385-a30a-0712ce8ff593 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:29.372795 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00292507-0c2d-4385-a30a-0712ce8ff593 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:29.391792 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-00292507-0c2d-4385-a30a-0712ce8ff593 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:29.391792 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:29.391792 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:29.391792 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:29.391792 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:29.391792 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:29.391792 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:29.391792 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:29.391792 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:29.391792 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:29.391792 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:29.391792 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:29.391792 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:53:29.391792 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:53:29.391792 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:53:29.392928 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:53:29.392928 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:29.392928 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:29.392928 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:29.392928 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:29.392928 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:29.392928 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:29.392928 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:29.392928 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:29.392928 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:29.392928 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:29.392928 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:29.392928 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:29.392928 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:29.392928 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:29.392928 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:29.392928 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:29.394069 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:53:29.394069 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:53:29.394069 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:29.394069 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:29.396021 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 334/673] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:53:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:29.399738 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00292507-0c2d-4385-a30a-0712ce8ff593 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:29.492632 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e5454a-cd72-454d-8348-c48545685e3a None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:29.544907 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21223ec3-4b17-468c-a71d-e2c2bf65e491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:29.545644 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21223ec3-4b17-468c-a71d-e2c2bf65e491 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:29.546033 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21223ec3-4b17-468c-a71d-e2c2bf65e491 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:29.546411 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21223ec3-4b17-468c-a71d-e2c2bf65e491 None admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:29.547233 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21223ec3-4b17-468c-a71d-e2c2bf65e491 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:29.547646 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21223ec3-4b17-468c-a71d-e2c2bf65e491 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:29.549164 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21223ec3-4b17-468c-a71d-e2c2bf65e491 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:29.556076 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00292507-0c2d-4385-a30a-0712ce8ff593 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:29.564716 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 340/674] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:53:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:29.566536 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21223ec3-4b17-468c-a71d-e2c2bf65e491 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:29.598840 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d8aa3-26ce-4b80-886d-84e8695ccb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:29.599884 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d8aa3-26ce-4b80-886d-84e8695ccb33 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:29.600394 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d8aa3-26ce-4b80-886d-84e8695ccb33 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:29.600896 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d8aa3-26ce-4b80-886d-84e8695ccb33 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:29.602594 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d8aa3-26ce-4b80-886d-84e8695ccb33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:29.603917 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d8aa3-26ce-4b80-886d-84e8695ccb33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:29.605879 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d8aa3-26ce-4b80-886d-84e8695ccb33 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:29.606770 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:29.629532 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 335/675] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:53:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:29.630763 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d8aa3-26ce-4b80-886d-84e8695ccb33 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:29.690432 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:29.743280 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d8aa3-26ce-4b80-886d-84e8695ccb33 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:29.766007 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21223ec3-4b17-468c-a71d-e2c2bf65e491 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:29.791490 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8632427d-ff9c-45e4-8d6e-a328be7befd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:29.793969 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8632427d-ff9c-45e4-8d6e-a328be7befd2 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:29.794721 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8632427d-ff9c-45e4-8d6e-a328be7befd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:29.795647 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8632427d-ff9c-45e4-8d6e-a328be7befd2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:29.804266 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8632427d-ff9c-45e4-8d6e-a328be7befd2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:29.806477 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8632427d-ff9c-45e4-8d6e-a328be7befd2 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:29.823972 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-8632427d-ff9c-45e4-8d6e-a328be7befd2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:53:29.823972 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:29.823972 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:29.823972 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:29.823972 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:29.823972 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:29.823972 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:29.823972 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:29.823972 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:29.823972 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:29.823972 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:29.823972 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:29.823972 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 11:53:29.823972 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 11:53:29.823972 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 11:53:29.824913 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 11:53:29.824913 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:29.824913 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:29.824913 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:29.824913 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:29.824913 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:29.824913 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:29.824913 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:29.824913 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:29.824913 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:29.824913 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:29.824913 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:29.824913 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:29.824913 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:29.824913 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:29.824913 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:29.824913 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:29.825788 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 11:53:29.825788 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 11:53:29.825788 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 11:53:29.825788 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 11:53:29.825788 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 11:53:29.825788 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 11:53:29.825788 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:53:29.825788 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:29.828244 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 336/676] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Jun 8 11:53:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:29.829279 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8632427d-ff9c-45e4-8d6e-a328be7befd2 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:29.862874 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c4e1d-8ef6-4bfc-b373-39b599d55db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:29.863579 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c4e1d-8ef6-4bfc-b373-39b599d55db6 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:29.863837 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c4e1d-8ef6-4bfc-b373-39b599d55db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:29.864135 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c4e1d-8ef6-4bfc-b373-39b599d55db6 None admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:29.864878 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c4e1d-8ef6-4bfc-b373-39b599d55db6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:29.865185 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c4e1d-8ef6-4bfc-b373-39b599d55db6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:29.872390 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c4e1d-8ef6-4bfc-b373-39b599d55db6 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:29.903973 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 341/677] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:53:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:29.904904 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c4e1d-8ef6-4bfc-b373-39b599d55db6 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:29.949211 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8632427d-ff9c-45e4-8d6e-a328be7befd2 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:29.959803 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:29.991624 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e477a-802f-4f73-8573-cc4f97a068b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:29.992854 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e477a-802f-4f73-8573-cc4f97a068b8 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:29.993373 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e477a-802f-4f73-8573-cc4f97a068b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:29.994667 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e477a-802f-4f73-8573-cc4f97a068b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:30.002335 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8e477a-802f-4f73-8573-cc4f97a068b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:30.004153 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8e477a-802f-4f73-8573-cc4f97a068b8 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:30.020915 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-0a8e477a-802f-4f73-8573-cc4f97a068b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:53:30.020915 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:30.020915 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:30.020915 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:30.020915 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:30.020915 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:30.020915 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:30.020915 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:30.020915 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:30.020915 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:30.020915 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:30.020915 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:30.020915 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 11:53:30.020915 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 11:53:30.020915 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 11:53:30.021827 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 11:53:30.021827 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:30.021827 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:30.021827 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:30.021827 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:30.021827 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:30.021827 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:30.021827 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:30.021827 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:30.021827 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:30.021827 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:30.021827 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:30.021827 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:30.021827 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:30.021827 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:30.021827 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:30.021827 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:30.022700 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 11:53:30.022700 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 11:53:30.022700 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 11:53:30.022700 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 11:53:30.022700 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 11:53:30.022700 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 11:53:30.022700 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:53:30.022700 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:30.030442 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 337/678] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Jun 8 11:53:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:30.031636 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e477a-802f-4f73-8573-cc4f97a068b8 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:30.121321 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:30.139714 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c4e1d-8ef6-4bfc-b373-39b599d55db6 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:30.176654 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704acffe-f118-4146-89d6-d49328dd06bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:30.177692 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704acffe-f118-4146-89d6-d49328dd06bb None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:30.178187 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704acffe-f118-4146-89d6-d49328dd06bb None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:30.178672 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704acffe-f118-4146-89d6-d49328dd06bb None admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:30.179695 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704acffe-f118-4146-89d6-d49328dd06bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:30.180234 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704acffe-f118-4146-89d6-d49328dd06bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:30.182636 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704acffe-f118-4146-89d6-d49328dd06bb None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:30.182977 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e477a-802f-4f73-8573-cc4f97a068b8 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:30.197709 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 342/679] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Jun 8 11:53:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:30.198901 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704acffe-f118-4146-89d6-d49328dd06bb None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:30.219402 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a0d66b-9043-4394-8cad-0d572e7684d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:30.220227 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0d66b-9043-4394-8cad-0d572e7684d9 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:30.220522 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0d66b-9043-4394-8cad-0d572e7684d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:30.220797 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0d66b-9043-4394-8cad-0d572e7684d9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:30.228942 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a0d66b-9043-4394-8cad-0d572e7684d9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:30.230417 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a0d66b-9043-4394-8cad-0d572e7684d9 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:30.245880 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-62a0d66b-9043-4394-8cad-0d572e7684d9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 08 11:53:30.245880 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:30.245880 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:30.245880 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:30.245880 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:30.245880 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:30.245880 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:30.245880 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:30.245880 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:30.245880 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:30.245880 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:30.245880 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:30.245880 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 11:53:30.245880 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 11:53:30.245880 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 11:53:30.245880 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 11:53:30.246874 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:30.246874 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:30.246874 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 11:53:30.246874 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:53:30.246874 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 11:53:30.246874 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:53:30.246874 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:30.246874 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:30.246874 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:30.246874 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:30.246874 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:30.246874 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:30.246874 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:30.246874 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:30.246874 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:30.246874 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:30.246874 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:30.246874 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:30.247823 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:30.247823 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:30.247823 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 11:53:30.247823 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 11:53:30.247823 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 11:53:30.247823 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 11:53:30.247823 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 11:53:30.247823 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 11:53:30.247823 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 08 11:53:30.247823 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:30.247823 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 338/680] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Jun 8 11:53:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:30.248581 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a0d66b-9043-4394-8cad-0d572e7684d9 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:30.279104 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:30.318957 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704acffe-f118-4146-89d6-d49328dd06bb None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:30.362905 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a0d66b-9043-4394-8cad-0d572e7684d9 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:30.363351 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee106b-e2b1-4356-9c8a-92c2b9df594f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:30.364342 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee106b-e2b1-4356-9c8a-92c2b9df594f None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:30.364906 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee106b-e2b1-4356-9c8a-92c2b9df594f None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:30.365387 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee106b-e2b1-4356-9c8a-92c2b9df594f None admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:30.366378 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee106b-e2b1-4356-9c8a-92c2b9df594f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:30.366892 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee106b-e2b1-4356-9c8a-92c2b9df594f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:30.369128 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee106b-e2b1-4356-9c8a-92c2b9df594f None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:30.388006 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 343/681] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Jun 8 11:53:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:30.389248 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee106b-e2b1-4356-9c8a-92c2b9df594f None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:30.399045 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:30.401166 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ba3892-6599-4d1a-9dde-2852c7f48fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:30.401947 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba3892-6599-4d1a-9dde-2852c7f48fe4 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:30.402249 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba3892-6599-4d1a-9dde-2852c7f48fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:30.402503 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba3892-6599-4d1a-9dde-2852c7f48fe4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:30.403348 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ba3892-6599-4d1a-9dde-2852c7f48fe4 None admin] RBAC: Adding query filter params (role.id=125b7374688b4b009d443f1b34947c49, scope.project.id=6a7fee684e8b43e199c95aeeb92640d4, user.id=2fef074aa2ea4570928109f62ea1aa96) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:30.403661 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ba3892-6599-4d1a-9dde-2852c7f48fe4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:30.405324 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ba3892-6599-4d1a-9dde-2852c7f48fe4 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:30.413041 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 339/682] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Jun 8 11:53:30 2022] GET /identity/v3/role_assignments?user.id=2fef074aa2ea4570928109f62ea1aa96&scope.project.id=6a7fee684e8b43e199c95aeeb92640d4&role.id=125b7374688b4b009d443f1b34947c49 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:30.413923 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ba3892-6599-4d1a-9dde-2852c7f48fe4 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:30.512322 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee106b-e2b1-4356-9c8a-92c2b9df594f None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:30.516620 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:30.525581 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ba3892-6599-4d1a-9dde-2852c7f48fe4 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:30.553052 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d117bc-306e-4b80-afca-186c0ef0a31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:30.554136 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d117bc-306e-4b80-afca-186c0ef0a31f None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:30.554649 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d117bc-306e-4b80-afca-186c0ef0a31f None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:30.555159 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d117bc-306e-4b80-afca-186c0ef0a31f None admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:30.556855 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d117bc-306e-4b80-afca-186c0ef0a31f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:30.557429 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d117bc-306e-4b80-afca-186c0ef0a31f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:30.559262 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d117bc-306e-4b80-afca-186c0ef0a31f None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:30.566626 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc63129-b516-4070-9693-090a89e6ae67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:30.567304 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc63129-b516-4070-9693-090a89e6ae67 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:30.567589 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc63129-b516-4070-9693-090a89e6ae67 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:30.567868 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc63129-b516-4070-9693-090a89e6ae67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:30.568747 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc63129-b516-4070-9693-090a89e6ae67 None admin] RBAC: Adding query filter params (role.id=125b7374688b4b009d443f1b34947c49, scope.project.id=6a7fee684e8b43e199c95aeeb92640d4, user.id=a2d235956e984676be738414b948bde3) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:30.569099 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc63129-b516-4070-9693-090a89e6ae67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:30.570504 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc63129-b516-4070-9693-090a89e6ae67 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:30.578296 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 340/683] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Jun 8 11:53:30 2022] GET /identity/v3/role_assignments?user.id=a2d235956e984676be738414b948bde3&scope.project.id=6a7fee684e8b43e199c95aeeb92640d4&role.id=125b7374688b4b009d443f1b34947c49 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:30.585008 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 344/684] 10.222.0.39 () {56 vars in 1135 bytes} [Wed Jun 8 11:53:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:30.593389 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc63129-b516-4070-9693-090a89e6ae67 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:30.674899 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270f394-4ccf-4cf6-8cc7-417a3be1c8d8 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:30.675085 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270f394-4ccf-4cf6-8cc7-417a3be1c8d8 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:30.675371 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270f394-4ccf-4cf6-8cc7-417a3be1c8d8 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:30.678344 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 345/685] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:53:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:53:30.683426 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d00da-8211-4a38-88a4-8ed4586f0467 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:30.683751 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d00da-8211-4a38-88a4-8ed4586f0467 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:30.683987 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d00da-8211-4a38-88a4-8ed4586f0467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:30.714963 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-a97d00da-8211-4a38-88a4-8ed4586f0467 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:53:30.716195 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-a97d00da-8211-4a38-88a4-8ed4586f0467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:53:30.764988 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc63129-b516-4070-9693-090a89e6ae67 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:30.792469 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:30.803990 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 346/686] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:53:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 11:53:30.816892 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b3cd2-a2da-4572-bfb2-243c904e229c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:30.818298 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b3cd2-a2da-4572-bfb2-243c904e229c None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:30.818806 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b3cd2-a2da-4572-bfb2-243c904e229c None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:30.819294 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b3cd2-a2da-4572-bfb2-243c904e229c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:30.830742 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d00da-8211-4a38-88a4-8ed4586f0467 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:30.870797 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:30.937039 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b3cd2-a2da-4572-bfb2-243c904e229c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:30.938834 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b3cd2-a2da-4572-bfb2-243c904e229c None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:30.970554 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d00da-8211-4a38-88a4-8ed4586f0467 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:31.011444 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59476ae2-89a9-4602-bb3a-dfba19d27a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:31.012303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59476ae2-89a9-4602-bb3a-dfba19d27a65 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:31.012633 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59476ae2-89a9-4602-bb3a-dfba19d27a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:31.012919 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59476ae2-89a9-4602-bb3a-dfba19d27a65 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:31.023913 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59476ae2-89a9-4602-bb3a-dfba19d27a65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:53:31.032854 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-59476ae2-89a9-4602-bb3a-dfba19d27a65 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:53:31.032854 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:31.032854 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:31.032854 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:31.032854 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:31.032854 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:31.032854 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:31.032854 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:31.032854 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:31.032854 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:31.032854 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:31.032854 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:31.032854 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:53:31.032854 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:53:31.032854 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:53:31.032854 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:53:31.034011 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:53:31.034011 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:53:31.034011 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:53:31.034011 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:53:31.034011 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:31.034011 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:31.034011 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:31.034011 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:31.034011 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:31.034011 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:31.034011 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:31.034011 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:31.034011 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:31.034011 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:31.034011 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:31.034011 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:31.035108 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:31.035108 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:31.035108 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:31.035108 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:31.035108 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:53:31.035108 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:53:31.035108 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:53:31.035108 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:53:31.035108 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:53:31.035108 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:53:31.035108 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:53:31.035108 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:31.035108 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 347/687] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Jun 8 11:53:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:31.040091 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59476ae2-89a9-4602-bb3a-dfba19d27a65 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:31.079138 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 341/688] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:53:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 11:53:31.086692 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b3cd2-a2da-4572-bfb2-243c904e229c None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:31.126960 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:31.155644 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:31.231214 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59476ae2-89a9-4602-bb3a-dfba19d27a65 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:31.254382 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b3cd2-a2da-4572-bfb2-243c904e229c None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:31.277914 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6fba1-a431-41d4-95d9-19838a13bc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:31.278619 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6fba1-a431-41d4-95d9-19838a13bc90 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:31.278904 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6fba1-a431-41d4-95d9-19838a13bc90 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:31.279183 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6fba1-a431-41d4-95d9-19838a13bc90 None admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:31.279956 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f6fba1-a431-41d4-95d9-19838a13bc90 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:31.280295 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f6fba1-a431-41d4-95d9-19838a13bc90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:31.281733 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f6fba1-a431-41d4-95d9-19838a13bc90 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:31.310606 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 348/689] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:53:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:31.311667 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6fba1-a431-41d4-95d9-19838a13bc90 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:31.334157 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acbf64c-4c96-4595-880b-507d6b8f4b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:31.334989 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acbf64c-4c96-4595-880b-507d6b8f4b41 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:31.335273 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acbf64c-4c96-4595-880b-507d6b8f4b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:31.335576 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acbf64c-4c96-4595-880b-507d6b8f4b41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:31.347818 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acbf64c-4c96-4595-880b-507d6b8f4b41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:31.356363 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acbf64c-4c96-4595-880b-507d6b8f4b41 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:31.392607 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-3acbf64c-4c96-4595-880b-507d6b8f4b41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:31.392607 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:31.392607 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:31.392607 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:31.392607 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:31.392607 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:31.392607 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:31.392607 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:31.392607 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:31.392607 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:31.392607 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:31.392607 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:31.392607 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:53:31.392607 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:53:31.392607 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:53:31.393575 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:53:31.393575 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:31.393575 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:31.393575 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:31.393575 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:31.393575 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:31.393575 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:31.393575 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:31.393575 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:31.393575 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:31.393575 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:31.393575 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:31.393575 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:31.393575 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:31.393575 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:31.393575 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:31.393575 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:31.394455 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:53:31.394455 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:53:31.394455 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:31.394455 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:31.400521 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 342/690] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:53:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:31.414041 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acbf64c-4c96-4595-880b-507d6b8f4b41 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:31.542888 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6fba1-a431-41d4-95d9-19838a13bc90 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:31.546568 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acbf64c-4c96-4595-880b-507d6b8f4b41 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:31.582678 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:31.593994 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:31.603526 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5e582-290b-41e6-a265-1aa644306e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:31.604502 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5e582-290b-41e6-a265-1aa644306e88 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:31.605840 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5e582-290b-41e6-a265-1aa644306e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:31.607260 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5e582-290b-41e6-a265-1aa644306e88 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:31.608206 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de5e582-290b-41e6-a265-1aa644306e88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:31.609664 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de5e582-290b-41e6-a265-1aa644306e88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:31.611814 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de5e582-290b-41e6-a265-1aa644306e88 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:31.627847 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a7f87-398e-453a-bc1c-8bd02dec3362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:31.629002 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a7f87-398e-453a-bc1c-8bd02dec3362 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:31.629461 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a7f87-398e-453a-bc1c-8bd02dec3362 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:31.629886 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a7f87-398e-453a-bc1c-8bd02dec3362 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:31.635957 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 343/691] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:53:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:31.641450 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702deac-b4f8-4351-acb6-5f1692a17dbf None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:31.641751 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702deac-b4f8-4351-acb6-5f1692a17dbf None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:31.642155 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702deac-b4f8-4351-acb6-5f1692a17dbf None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:31.643765 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 344/692] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:53:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:53:31.644642 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c702deac-b4f8-4351-acb6-5f1692a17dbf None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:31.646769 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747a7f87-398e-453a-bc1c-8bd02dec3362 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:31.648480 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747a7f87-398e-453a-bc1c-8bd02dec3362 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:31.671573 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-747a7f87-398e-453a-bc1c-8bd02dec3362 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:31.671573 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:31.671573 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:31.671573 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:31.671573 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:31.671573 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:31.671573 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:31.671573 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:31.671573 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:31.671573 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:31.671573 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:31.671573 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:31.671573 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:53:31.671573 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:53:31.671573 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:53:31.672640 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:53:31.672640 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:31.672640 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:31.672640 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:31.672640 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:31.672640 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:31.672640 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:31.672640 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:31.672640 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:31.672640 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:31.672640 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:31.672640 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:31.672640 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:31.672640 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:31.672640 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:31.672640 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:31.672640 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:31.673603 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:53:31.673603 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:53:31.673603 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:31.673603 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:31.676322 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 349/693] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:53:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:31.678253 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0770da9-fff0-4b55-b6b1-75032dc08eff None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:31.678988 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0770da9-fff0-4b55-b6b1-75032dc08eff None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:31.679437 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0770da9-fff0-4b55-b6b1-75032dc08eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:31.701942 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-f0770da9-fff0-4b55-b6b1-75032dc08eff None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:53:31.703678 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-f0770da9-fff0-4b55-b6b1-75032dc08eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:53:31.764942 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c702deac-b4f8-4351-acb6-5f1692a17dbf None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:31.794057 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 350/694] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:53:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:53:31.795112 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0770da9-fff0-4b55-b6b1-75032dc08eff None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:31.809734 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3ba15-3bcd-48d6-8e74-c1ac7ee4b2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:31.810597 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3ba15-3bcd-48d6-8e74-c1ac7ee4b2ef None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:31.810884 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3ba15-3bcd-48d6-8e74-c1ac7ee4b2ef None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:31.811255 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3ba15-3bcd-48d6-8e74-c1ac7ee4b2ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:31.825380 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3ba15-3bcd-48d6-8e74-c1ac7ee4b2ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:31.826830 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3ba15-3bcd-48d6-8e74-c1ac7ee4b2ef None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:31.848922 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-2fa3ba15-3bcd-48d6-8e74-c1ac7ee4b2ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:53:31.848922 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:31.848922 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:31.848922 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:31.848922 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:31.848922 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:31.848922 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:31.848922 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:31.848922 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:31.848922 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:31.848922 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:31.848922 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:31.848922 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 11:53:31.848922 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 11:53:31.848922 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 11:53:31.850034 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 11:53:31.850034 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:31.850034 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:31.850034 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:31.850034 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:31.850034 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:31.850034 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:31.850034 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:31.850034 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:31.850034 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:31.850034 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:31.850034 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:31.850034 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:31.850034 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:31.850034 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:31.850034 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:31.850034 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:31.850998 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 11:53:31.850998 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 11:53:31.850998 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 11:53:31.850998 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 11:53:31.850998 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 11:53:31.850998 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 11:53:31.850998 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:53:31.850998 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:31.851644 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 345/695] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Jun 8 11:53:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:31.852471 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3ba15-3bcd-48d6-8e74-c1ac7ee4b2ef None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:31.891714 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:31.913354 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:31.919116 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0770da9-fff0-4b55-b6b1-75032dc08eff None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:31.956789 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1837ca9f-48b2-4e1f-b47a-f42dc84e575f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:31.957733 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837ca9f-48b2-4e1f-b47a-f42dc84e575f None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:31.958164 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837ca9f-48b2-4e1f-b47a-f42dc84e575f None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:31.958696 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837ca9f-48b2-4e1f-b47a-f42dc84e575f None admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:31.959666 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1837ca9f-48b2-4e1f-b47a-f42dc84e575f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:31.960119 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1837ca9f-48b2-4e1f-b47a-f42dc84e575f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:31.961670 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1837ca9f-48b2-4e1f-b47a-f42dc84e575f None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:31.975499 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 351/696] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:53:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:31.976730 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1837ca9f-48b2-4e1f-b47a-f42dc84e575f None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:31.980994 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3ba15-3bcd-48d6-8e74-c1ac7ee4b2ef None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:32.028699 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12449cf-17ee-4c08-a96a-91c55a780bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:32.030038 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12449cf-17ee-4c08-a96a-91c55a780bdb None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:32.030532 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12449cf-17ee-4c08-a96a-91c55a780bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:32.031051 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12449cf-17ee-4c08-a96a-91c55a780bdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:32.043539 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12449cf-17ee-4c08-a96a-91c55a780bdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:32.045609 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12449cf-17ee-4c08-a96a-91c55a780bdb None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:32.065345 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-e12449cf-17ee-4c08-a96a-91c55a780bdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:32.065345 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:32.065345 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:32.065345 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:32.065345 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:32.065345 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:32.065345 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:32.065345 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:32.065345 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:32.065345 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:32.065345 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:32.065345 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:32.065345 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:53:32.065345 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:53:32.065345 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:53:32.066282 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:53:32.066282 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:32.066282 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:32.066282 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:32.066282 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:32.066282 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:32.066282 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:32.066282 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:32.066282 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:32.066282 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:32.066282 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:32.066282 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:32.066282 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:32.066282 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:32.066282 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:32.066282 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:32.066282 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:32.067156 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:53:32.067156 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:53:32.067156 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:32.067156 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:32.074045 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 346/697] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:53:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:32.075188 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12449cf-17ee-4c08-a96a-91c55a780bdb None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:32.100380 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1837ca9f-48b2-4e1f-b47a-f42dc84e575f None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:32.143233 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d65d09-e803-40fb-99c3-f1806d9b93ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:32.144697 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d65d09-e803-40fb-99c3-f1806d9b93ec None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:32.145166 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d65d09-e803-40fb-99c3-f1806d9b93ec None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:32.145627 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d65d09-e803-40fb-99c3-f1806d9b93ec None admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:32.146599 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d65d09-e803-40fb-99c3-f1806d9b93ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:32.147090 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d65d09-e803-40fb-99c3-f1806d9b93ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:32.148771 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d65d09-e803-40fb-99c3-f1806d9b93ec None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:32.161992 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 352/698] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Jun 8 11:53:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:32.163125 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d65d09-e803-40fb-99c3-f1806d9b93ec None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:32.167539 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:32.191022 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12449cf-17ee-4c08-a96a-91c55a780bdb None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:32.192870 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:32.236939 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29a7b1-7049-4860-8a2a-3c5a1c990fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:32.237961 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29a7b1-7049-4860-8a2a-3c5a1c990fbf None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:32.238246 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29a7b1-7049-4860-8a2a-3c5a1c990fbf None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:32.238522 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29a7b1-7049-4860-8a2a-3c5a1c990fbf None admin] PATH_INFO: `/v3/users/nova` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:32.249889 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a29a7b1-7049-4860-8a2a-3c5a1c990fbf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:32.252291 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a29a7b1-7049-4860-8a2a-3c5a1c990fbf None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:32.270566 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-3a29a7b1-7049-4860-8a2a-3c5a1c990fbf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 08 11:53:32.270566 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:32.270566 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:32.270566 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:32.270566 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:32.270566 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:32.270566 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:32.270566 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:32.270566 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:32.270566 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:32.270566 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:32.270566 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:32.270566 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 11:53:32.270566 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 11:53:32.270566 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 11:53:32.270566 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 11:53:32.271513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:32.271513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:32.271513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 11:53:32.271513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:53:32.271513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 11:53:32.271513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:53:32.271513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:32.271513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:32.271513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:32.271513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:32.271513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:32.271513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:32.271513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:32.271513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:32.271513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:32.271513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:32.271513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:32.271513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:32.272485 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:32.272485 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:32.272485 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 11:53:32.272485 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 11:53:32.272485 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 11:53:32.272485 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 11:53:32.272485 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 11:53:32.272485 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 11:53:32.272485 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 08 11:53:32.272485 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:32.280161 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 347/699] 10.222.0.39 () {56 vars in 1093 bytes} [Wed Jun 8 11:53:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:32.280161 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29a7b1-7049-4860-8a2a-3c5a1c990fbf None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:32.311546 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d65d09-e803-40fb-99c3-f1806d9b93ec None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:32.360885 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff8c98a-7041-46ff-8a7e-f962b3695a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:32.361657 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8c98a-7041-46ff-8a7e-f962b3695a28 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:32.362017 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8c98a-7041-46ff-8a7e-f962b3695a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:32.362369 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8c98a-7041-46ff-8a7e-f962b3695a28 None admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:32.363466 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff8c98a-7041-46ff-8a7e-f962b3695a28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:32.363840 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff8c98a-7041-46ff-8a7e-f962b3695a28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:32.365602 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff8c98a-7041-46ff-8a7e-f962b3695a28 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:32.386447 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 353/700] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:53:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:32.386447 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff8c98a-7041-46ff-8a7e-f962b3695a28 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:32.404197 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29a7b1-7049-4860-8a2a-3c5a1c990fbf None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:32.448049 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe6322a-21f9-44e6-a4b5-f1fb309bcd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:32.449084 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6322a-21f9-44e6-a4b5-f1fb309bcd0a None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:32.449596 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6322a-21f9-44e6-a4b5-f1fb309bcd0a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:32.450075 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6322a-21f9-44e6-a4b5-f1fb309bcd0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:32.451272 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe6322a-21f9-44e6-a4b5-f1fb309bcd0a None admin] RBAC: Adding query filter params (role.id=125b7374688b4b009d443f1b34947c49, scope.project.id=6a7fee684e8b43e199c95aeeb92640d4, user.id=753bde6a72d64045abd3ad44b9b0de04) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:32.451789 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe6322a-21f9-44e6-a4b5-f1fb309bcd0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:32.453524 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe6322a-21f9-44e6-a4b5-f1fb309bcd0a None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:32.460781 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 348/701] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Jun 8 11:53:32 2022] GET /identity/v3/role_assignments?user.id=753bde6a72d64045abd3ad44b9b0de04&scope.project.id=6a7fee684e8b43e199c95aeeb92640d4&role.id=125b7374688b4b009d443f1b34947c49 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:32.461892 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe6322a-21f9-44e6-a4b5-f1fb309bcd0a None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:32.491210 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:32.520385 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:32.581633 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff8c98a-7041-46ff-8a7e-f962b3695a28 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:32.635491 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff592d-b9f0-4bb3-9705-f690e004e1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:32.636277 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff592d-b9f0-4bb3-9705-f690e004e1ab None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:32.636716 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff592d-b9f0-4bb3-9705-f690e004e1ab None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:32.637003 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff592d-b9f0-4bb3-9705-f690e004e1ab None admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:32.637871 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff592d-b9f0-4bb3-9705-f690e004e1ab None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:32.638183 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff592d-b9f0-4bb3-9705-f690e004e1ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:32.639662 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff592d-b9f0-4bb3-9705-f690e004e1ab None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:32.660874 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 354/702] 10.222.0.39 () {56 vars in 1133 bytes} [Wed Jun 8 11:53:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:32.666520 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff592d-b9f0-4bb3-9705-f690e004e1ab None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:32.697645 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe6322a-21f9-44e6-a4b5-f1fb309bcd0a None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:32.735899 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec3762-2e99-4970-aa72-b28764cbd0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:32.736619 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec3762-2e99-4970-aa72-b28764cbd0be None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:32.736905 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec3762-2e99-4970-aa72-b28764cbd0be None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:32.737178 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec3762-2e99-4970-aa72-b28764cbd0be None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:32.737914 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec3762-2e99-4970-aa72-b28764cbd0be None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:32.739358 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec3762-2e99-4970-aa72-b28764cbd0be None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:32.763912 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 349/703] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Jun 8 11:53:32 2022] POST /identity/v3/users => generated 254 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 11:53:32.810176 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff592d-b9f0-4bb3-9705-f690e004e1ab None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:32.853702 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a6fea3-21a8-4692-bda1-ea03a3133cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:32.854295 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6fea3-21a8-4692-bda1-ea03a3133cbd None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:32.854746 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6fea3-21a8-4692-bda1-ea03a3133cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:32.855029 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6fea3-21a8-4692-bda1-ea03a3133cbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:32.859207 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:32.943639 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a6fea3-21a8-4692-bda1-ea03a3133cbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:32.945241 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a6fea3-21a8-4692-bda1-ea03a3133cbd None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:33.059367 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 355/704] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:53:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 11:53:33.064948 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec3762-2e99-4970-aa72-b28764cbd0be None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:33.128020 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:33.171999 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec3762-2e99-4970-aa72-b28764cbd0be None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:33.207488 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0636410f-e915-4559-882d-5637f175b896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:33.208323 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636410f-e915-4559-882d-5637f175b896 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:33.208609 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636410f-e915-4559-882d-5637f175b896 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:33.208879 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636410f-e915-4559-882d-5637f175b896 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:33.220927 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0636410f-e915-4559-882d-5637f175b896 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:33.222398 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0636410f-e915-4559-882d-5637f175b896 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:33.240616 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-0636410f-e915-4559-882d-5637f175b896 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:33.240616 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:33.240616 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:33.240616 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:33.240616 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:33.240616 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:33.240616 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:33.240616 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:33.240616 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:33.240616 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:33.240616 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:33.240616 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:33.240616 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:53:33.240616 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:53:33.240616 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:53:33.241568 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:53:33.241568 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:33.241568 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:33.241568 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:33.241568 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:33.241568 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:33.241568 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:33.241568 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:33.241568 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:33.241568 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:33.241568 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:33.241568 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:33.241568 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:33.241568 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:33.241568 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:33.241568 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:33.241568 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:33.242457 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:53:33.242457 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:53:33.242457 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:33.242457 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:33.242457 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 350/705] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:53:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 11:53:33.249299 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a6fea3-21a8-4692-bda1-ea03a3133cbd None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:33.285809 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:33.302656 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e10282-14f3-4292-b298-2963a5905e40 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:33.303106 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e10282-14f3-4292-b298-2963a5905e40 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:33.303510 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e10282-14f3-4292-b298-2963a5905e40 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:33.305238 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 351/706] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:53:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:53:33.311691 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a38e9-cef6-4ce9-9bad-d77fd35624f2 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:33.311986 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a38e9-cef6-4ce9-9bad-d77fd35624f2 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:33.312341 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a38e9-cef6-4ce9-9bad-d77fd35624f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:33.330135 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-cd7a38e9-cef6-4ce9-9bad-d77fd35624f2 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:53:33.330710 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-cd7a38e9-cef6-4ce9-9bad-d77fd35624f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:53:33.376559 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a6fea3-21a8-4692-bda1-ea03a3133cbd None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:33.416438 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c9496-b228-401a-ab1c-7e2a50de6ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:33.417027 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c9496-b228-401a-ab1c-7e2a50de6ef2 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:33.417311 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c9496-b228-401a-ab1c-7e2a50de6ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:33.417587 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c9496-b228-401a-ab1c-7e2a50de6ef2 None admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:33.418435 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2c9496-b228-401a-ab1c-7e2a50de6ef2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:33.418741 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2c9496-b228-401a-ab1c-7e2a50de6ef2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:33.420245 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2c9496-b228-401a-ab1c-7e2a50de6ef2 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:33.434399 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 352/707] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:53:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 08 11:53:33.435884 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7f443-4e44-4e08-831b-6028473a6936 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:33.436112 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 356/708] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:53:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:53:33.436236 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7f443-4e44-4e08-831b-6028473a6936 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:33.436476 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7f443-4e44-4e08-831b-6028473a6936 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:33.438038 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 353/709] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:53:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:53:33.442469 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c9496-b228-401a-ab1c-7e2a50de6ef2 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:33.442886 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e426a9-2fa8-4ef9-9153-70f8f3244c02 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:33.443157 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e426a9-2fa8-4ef9-9153-70f8f3244c02 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:33.443439 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e426a9-2fa8-4ef9-9153-70f8f3244c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:33.474939 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-36e426a9-2fa8-4ef9-9153-70f8f3244c02 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:53:33.476142 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-36e426a9-2fa8-4ef9-9153-70f8f3244c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:53:33.531820 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:33.560081 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:33.567217 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c9496-b228-401a-ab1c-7e2a50de6ef2 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:33.588546 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 354/710] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:53:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:53:33.589737 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e426a9-2fa8-4ef9-9153-70f8f3244c02 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:33.635730 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae4d4de-1362-4767-a6a7-cfce16888096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:33.636910 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4d4de-1362-4767-a6a7-cfce16888096 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:33.637391 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4d4de-1362-4767-a6a7-cfce16888096 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:33.637884 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4d4de-1362-4767-a6a7-cfce16888096 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:33.645761 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae4d4de-1362-4767-a6a7-cfce16888096 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:33.647592 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae4d4de-1362-4767-a6a7-cfce16888096 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:33.664597 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-5ae4d4de-1362-4767-a6a7-cfce16888096 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:53:33.664597 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:33.664597 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:33.664597 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:33.664597 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:33.664597 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:33.664597 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:33.664597 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:33.664597 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:33.664597 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:33.664597 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:33.664597 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:33.664597 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 11:53:33.664597 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 11:53:33.664597 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 11:53:33.666251 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 11:53:33.666251 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:33.666251 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:33.666251 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:33.666251 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:33.666251 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:33.666251 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:33.666251 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:33.666251 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:33.666251 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:33.666251 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:33.666251 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:33.666251 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:33.666251 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:33.666251 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:33.666251 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:33.666251 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:33.667207 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 11:53:33.667207 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 11:53:33.667207 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 11:53:33.667207 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 11:53:33.667207 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 11:53:33.667207 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 11:53:33.667207 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:53:33.667207 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:33.667207 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 357/711] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Jun 8 11:53:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:33.667743 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae4d4de-1362-4767-a6a7-cfce16888096 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:33.707913 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e426a9-2fa8-4ef9-9153-70f8f3244c02 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:33.753070 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b9036-9b0c-4f68-a114-44f3e0c49c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:33.754719 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b9036-9b0c-4f68-a114-44f3e0c49c1b None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:33.755006 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b9036-9b0c-4f68-a114-44f3e0c49c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:33.755281 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b9036-9b0c-4f68-a114-44f3e0c49c1b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:33.756001 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355b9036-9b0c-4f68-a114-44f3e0c49c1b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:33.757420 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355b9036-9b0c-4f68-a114-44f3e0c49c1b None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:33.776299 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-355b9036-9b0c-4f68-a114-44f3e0c49c1b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 08 11:53:33.776299 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:33.776299 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 11:53:33.776299 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 11:53:33.776299 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 11:53:33.776299 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 11:53:33.776299 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 11:53:33.776299 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 11:53:33.776299 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 08 11:53:33.776299 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:33.776299 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 11:53:33.776299 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:33.776299 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:33.776299 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:33.776299 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:33.776299 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:33.777324 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:33.777324 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:33.777324 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:33.777324 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:33.777324 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:33.777324 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:33.777324 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:33.777324 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 11:53:33.777324 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 11:53:33.777324 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 11:53:33.777324 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 11:53:33.777324 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:33.777324 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:33.777324 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:33.777324 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:33.777324 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:33.778216 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:33.778216 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:33.778216 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:33.778216 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:33.778216 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:33.778216 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:33.778216 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:33.778216 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:33.778216 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:33.778216 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:33.778216 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:33.778216 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 11:53:33.778216 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 11:53:33.778216 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 08 11:53:33.778216 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:33.778216 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 355/712] 10.222.0.39 () {56 vars in 1129 bytes} [Wed Jun 8 11:53:33 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:33.779080 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b9036-9b0c-4f68-a114-44f3e0c49c1b None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:33.788420 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae4d4de-1362-4767-a6a7-cfce16888096 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:33.820707 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:33.832600 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8ec3e-52cf-4c1a-bf9f-dc988a0694fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:33.834270 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8ec3e-52cf-4c1a-bf9f-dc988a0694fe None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:33.834882 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8ec3e-52cf-4c1a-bf9f-dc988a0694fe None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:33.836693 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8ec3e-52cf-4c1a-bf9f-dc988a0694fe None admin] PATH_INFO: `/v3/services/network` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:33.837649 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab8ec3e-52cf-4c1a-bf9f-dc988a0694fe None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:33.839817 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab8ec3e-52cf-4c1a-bf9f-dc988a0694fe None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:33.858303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-8ab8ec3e-52cf-4c1a-bf9f-dc988a0694fe None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 08 11:53:33.858303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:33.858303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 11:53:33.858303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 11:53:33.858303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 11:53:33.858303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 11:53:33.858303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 11:53:33.858303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 11:53:33.858303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 08 11:53:33.858303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:33.858303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 11:53:33.858303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:33.858303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:33.858303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:33.858303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:33.858303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:33.858303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:33.859355 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:33.859355 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:33.859355 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:33.859355 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:33.859355 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:33.859355 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:33.859355 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 11:53:33.859355 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 11:53:33.859355 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 11:53:33.859355 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 11:53:33.859355 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:33.859355 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:33.859355 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:33.859355 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:33.859355 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:33.859355 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:33.860514 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:33.860514 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:33.860514 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:33.860514 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:33.860514 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:33.860514 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:33.860514 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:33.860514 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:33.860514 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:33.860514 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:33.860514 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 11:53:33.860514 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 11:53:33.860514 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 08 11:53:33.860514 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:33.864245 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 358/713] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Jun 8 11:53:33 2022] GET /identity/v3/services/network => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:33.866266 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8ec3e-52cf-4c1a-bf9f-dc988a0694fe None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:33.896499 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:33.906176 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b9036-9b0c-4f68-a114-44f3e0c49c1b None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:33.944233 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94391c5-10de-41c3-97f3-1fbe2dcc6ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:33.945293 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94391c5-10de-41c3-97f3-1fbe2dcc6ffd None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:33.945791 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94391c5-10de-41c3-97f3-1fbe2dcc6ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:33.946273 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94391c5-10de-41c3-97f3-1fbe2dcc6ffd None admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:33.947618 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94391c5-10de-41c3-97f3-1fbe2dcc6ffd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:33.948159 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94391c5-10de-41c3-97f3-1fbe2dcc6ffd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:33.949841 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94391c5-10de-41c3-97f3-1fbe2dcc6ffd None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:33.965703 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 356/714] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Jun 8 11:53:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:33.967348 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94391c5-10de-41c3-97f3-1fbe2dcc6ffd None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:34.000338 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8ec3e-52cf-4c1a-bf9f-dc988a0694fe None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:34.039541 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d3ce5-11ae-4c49-9eb4-0c21464a6617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:34.040673 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d3ce5-11ae-4c49-9eb4-0c21464a6617 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:34.040964 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d3ce5-11ae-4c49-9eb4-0c21464a6617 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:34.041243 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d3ce5-11ae-4c49-9eb4-0c21464a6617 None admin] PATH_INFO: `/v3/services` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:34.041981 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0d3ce5-11ae-4c49-9eb4-0c21464a6617 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:34.042301 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0d3ce5-11ae-4c49-9eb4-0c21464a6617 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:34.043895 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0d3ce5-11ae-4c49-9eb4-0c21464a6617 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:34.054367 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 359/715] 10.222.0.39 () {56 vars in 1124 bytes} [Wed Jun 8 11:53:33 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:34.055366 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d3ce5-11ae-4c49-9eb4-0c21464a6617 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:34.076876 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:34.083770 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94391c5-10de-41c3-97f3-1fbe2dcc6ffd None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:34.123299 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef672e-9c20-4791-b4fa-2af5b17650a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:34.124136 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef672e-9c20-4791-b4fa-2af5b17650a2 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:34.124554 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef672e-9c20-4791-b4fa-2af5b17650a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:34.125031 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef672e-9c20-4791-b4fa-2af5b17650a2 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:34.126068 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ef672e-9c20-4791-b4fa-2af5b17650a2 None admin] RBAC: Adding query filter params (name=network) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:34.126362 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ef672e-9c20-4791-b4fa-2af5b17650a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:34.127862 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ef672e-9c20-4791-b4fa-2af5b17650a2 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:34.137881 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 357/716] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Jun 8 11:53:33 2022] GET /identity/v3/services?name=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:34.137881 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef672e-9c20-4791-b4fa-2af5b17650a2 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:34.156283 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:34.173706 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d3ce5-11ae-4c49-9eb4-0c21464a6617 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:34.210762 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756f9354-615d-4903-b566-57a8ba143949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:34.211768 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f9354-615d-4903-b566-57a8ba143949 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:34.212829 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f9354-615d-4903-b566-57a8ba143949 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:34.213434 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f9354-615d-4903-b566-57a8ba143949 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:34.214717 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756f9354-615d-4903-b566-57a8ba143949 None admin] RBAC: Adding query filter params (role.id=028d4429a4554bbb88b3aec9f6a9d937, scope.project.id=6a7fee684e8b43e199c95aeeb92640d4, user.id=7ef7edb5e9ce49e6b098f48bf060b228) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:34.215231 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756f9354-615d-4903-b566-57a8ba143949 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:34.216886 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756f9354-615d-4903-b566-57a8ba143949 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:34.223805 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 360/717] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Jun 8 11:53:34 2022] GET /identity/v3/role_assignments?user.id=7ef7edb5e9ce49e6b098f48bf060b228&scope.project.id=6a7fee684e8b43e199c95aeeb92640d4&role.id=028d4429a4554bbb88b3aec9f6a9d937 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:34.224993 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756f9354-615d-4903-b566-57a8ba143949 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:34.248728 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef672e-9c20-4791-b4fa-2af5b17650a2 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:34.291468 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2a3b9-29a1-49a0-9045-e0a294ce945c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:34.291973 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2a3b9-29a1-49a0-9045-e0a294ce945c None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:34.292299 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2a3b9-29a1-49a0-9045-e0a294ce945c None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:34.292581 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2a3b9-29a1-49a0-9045-e0a294ce945c None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:34.293325 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b2a3b9-29a1-49a0-9045-e0a294ce945c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:34.293627 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b2a3b9-29a1-49a0-9045-e0a294ce945c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:34.295322 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b2a3b9-29a1-49a0-9045-e0a294ce945c None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:34.308197 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 358/718] 10.222.0.39 () {56 vars in 1124 bytes} [Wed Jun 8 11:53:34 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:34.388040 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756f9354-615d-4903-b566-57a8ba143949 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:34.450638 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cedc1af-38e9-4238-a651-1fb0cd22d19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:34.451352 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cedc1af-38e9-4238-a651-1fb0cd22d19f None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:34.451701 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cedc1af-38e9-4238-a651-1fb0cd22d19f None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:34.451899 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cedc1af-38e9-4238-a651-1fb0cd22d19f None admin] PATH_INFO: `/v3/services` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:34.452665 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cedc1af-38e9-4238-a651-1fb0cd22d19f None admin] RBAC: Adding query filter params (type=network) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:34.452965 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cedc1af-38e9-4238-a651-1fb0cd22d19f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:34.454376 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cedc1af-38e9-4238-a651-1fb0cd22d19f None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:34.466707 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 361/719] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Jun 8 11:53:34 2022] GET /identity/v3/services?type=network => generated 124 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:35.427402 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761fcb58-f163-4944-84e8-dbfb41960270 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:35.428497 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761fcb58-f163-4944-84e8-dbfb41960270 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:35.429040 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761fcb58-f163-4944-84e8-dbfb41960270 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:35.431001 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 359/720] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:53:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:53:35.436147 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908beb0-8397-4b79-9c84-b4a09b7cf25b None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:35.436975 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908beb0-8397-4b79-9c84-b4a09b7cf25b None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:35.437450 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908beb0-8397-4b79-9c84-b4a09b7cf25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:35.460014 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-4908beb0-8397-4b79-9c84-b4a09b7cf25b None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:53:35.461515 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-4908beb0-8397-4b79-9c84-b4a09b7cf25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:53:35.470136 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:35.558093 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 362/721] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:53:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:53:35.603846 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761fcb58-f163-4944-84e8-dbfb41960270 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:35.640670 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:35.744815 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761fcb58-f163-4944-84e8-dbfb41960270 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:35.794273 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7cfb42-4a81-44c6-bb46-418786e54f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:35.795081 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7cfb42-4a81-44c6-bb46-418786e54f36 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:35.795367 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7cfb42-4a81-44c6-bb46-418786e54f36 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:35.795643 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7cfb42-4a81-44c6-bb46-418786e54f36 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:35.810635 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7cfb42-4a81-44c6-bb46-418786e54f36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:53:35.810817 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9cf40-8a39-4936-8ec0-5b3cdc38efe2 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:35.811050 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9cf40-8a39-4936-8ec0-5b3cdc38efe2 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:35.811300 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9cf40-8a39-4936-8ec0-5b3cdc38efe2 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:35.812920 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 363/722] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:53:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:53:35.817960 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a878b90-04af-4d8e-bc48-4795ca4d4efb None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:35.818258 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a878b90-04af-4d8e-bc48-4795ca4d4efb None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:35.818378 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-8a7cfb42-4a81-44c6-bb46-418786e54f36 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:53:35.818378 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:35.818378 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:35.818378 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:35.818378 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:35.818378 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:35.818378 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:35.818378 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:35.818378 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:35.818378 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:35.818378 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:35.818378 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:35.818378 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:53:35.818378 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:53:35.818378 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:53:35.818378 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:53:35.819268 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:53:35.819268 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:53:35.819268 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:53:35.819268 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:53:35.819268 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:35.819268 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:35.819268 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:35.819268 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:35.819268 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:35.819268 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:35.819268 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:35.819268 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:35.819268 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:35.819268 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:35.819268 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:35.819268 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:35.820799 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:35.820799 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:35.820799 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:35.820799 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:35.820799 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:53:35.820799 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:53:35.820799 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:53:35.820799 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:53:35.820799 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:53:35.820799 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:53:35.820799 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:53:35.820799 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:35.822076 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a878b90-04af-4d8e-bc48-4795ca4d4efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:35.822149 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 360/723] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Jun 8 11:53:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:35.825676 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7cfb42-4a81-44c6-bb46-418786e54f36 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:35.849170 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-1a878b90-04af-4d8e-bc48-4795ca4d4efb None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:53:35.850378 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-1a878b90-04af-4d8e-bc48-4795ca4d4efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:53:35.973316 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 364/724] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:53:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:53:35.980518 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:35.994302 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7cfb42-4a81-44c6-bb46-418786e54f36 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:36.000737 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a878b90-04af-4d8e-bc48-4795ca4d4efb None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:36.032552 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd9718-833e-4b71-b9b3-4ff4890c38c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:36.033242 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd9718-833e-4b71-b9b3-4ff4890c38c8 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:36.033528 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd9718-833e-4b71-b9b3-4ff4890c38c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:36.033807 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd9718-833e-4b71-b9b3-4ff4890c38c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:36.034561 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd9718-833e-4b71-b9b3-4ff4890c38c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:36.034868 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd9718-833e-4b71-b9b3-4ff4890c38c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:36.036291 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd9718-833e-4b71-b9b3-4ff4890c38c8 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:36.054770 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 361/725] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:53:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:53:36.061251 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd9718-833e-4b71-b9b3-4ff4890c38c8 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:36.135404 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:36.192470 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a878b90-04af-4d8e-bc48-4795ca4d4efb None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:36.245568 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd9718-833e-4b71-b9b3-4ff4890c38c8 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:36.259918 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d6460-9dfc-46f8-b6f4-948c6d11fbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:36.260676 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d6460-9dfc-46f8-b6f4-948c6d11fbb0 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:36.260959 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d6460-9dfc-46f8-b6f4-948c6d11fbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:36.261238 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d6460-9dfc-46f8-b6f4-948c6d11fbb0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:36.281287 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87d6460-9dfc-46f8-b6f4-948c6d11fbb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:53:36.289076 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-f87d6460-9dfc-46f8-b6f4-948c6d11fbb0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 11:53:36.289076 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:36.289076 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:36.289076 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:36.289076 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:36.289076 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:36.289076 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:36.289076 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:36.289076 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:36.289076 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:36.289076 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:36.289076 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:36.289076 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:53:36.289076 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:53:36.289076 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:53:36.289076 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:53:36.290328 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:53:36.290328 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:53:36.290328 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:53:36.290328 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:53:36.290328 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:36.290328 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:36.290328 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:36.290328 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:36.290328 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:36.290328 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:36.290328 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:36.290328 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:36.290328 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:36.290328 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:36.290328 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:36.290328 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:36.291522 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:36.291522 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:36.291522 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:36.291522 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:36.291522 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:53:36.291522 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:53:36.291522 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:53:36.291522 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:53:36.291522 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:53:36.291522 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:53:36.291522 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 11:53:36.291522 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:36.296991 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 365/726] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Jun 8 11:53:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 11:53:36.301770 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d6460-9dfc-46f8-b6f4-948c6d11fbb0 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:36.316953 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c936e87-0fab-4839-b919-227b47e53c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:36.317771 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c936e87-0fab-4839-b919-227b47e53c29 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:36.318053 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c936e87-0fab-4839-b919-227b47e53c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:36.318327 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c936e87-0fab-4839-b919-227b47e53c29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:36.333925 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c936e87-0fab-4839-b919-227b47e53c29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:36.335395 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c936e87-0fab-4839-b919-227b47e53c29 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:36.346166 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:36.360731 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-5c936e87-0fab-4839-b919-227b47e53c29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:36.360731 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:36.360731 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:36.360731 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:36.360731 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:36.360731 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:36.360731 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:36.360731 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:36.360731 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:36.360731 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:36.360731 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:36.360731 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:36.360731 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:53:36.360731 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:53:36.360731 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:53:36.361669 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:53:36.361669 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:36.361669 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:36.361669 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:36.361669 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:36.361669 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:36.361669 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:36.361669 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:36.361669 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:36.361669 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:36.361669 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:36.361669 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:36.361669 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:36.361669 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:36.361669 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:36.361669 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:36.361669 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:36.362547 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:53:36.362547 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:53:36.362547 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:36.362547 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:36.362547 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 362/727] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:53:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:36.369802 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c936e87-0fab-4839-b919-227b47e53c29 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:36.491138 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d6460-9dfc-46f8-b6f4-948c6d11fbb0 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:36.536487 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:36.544151 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7837c652-cc15-4114-9ca3-e7ac291a4fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:36.544971 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837c652-cc15-4114-9ca3-e7ac291a4fb6 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:36.545269 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837c652-cc15-4114-9ca3-e7ac291a4fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:36.545554 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837c652-cc15-4114-9ca3-e7ac291a4fb6 None admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:36.546322 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7837c652-cc15-4114-9ca3-e7ac291a4fb6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:36.546638 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7837c652-cc15-4114-9ca3-e7ac291a4fb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:36.548183 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7837c652-cc15-4114-9ca3-e7ac291a4fb6 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:36.557242 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c936e87-0fab-4839-b919-227b47e53c29 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:36.571752 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 366/728] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Jun 8 11:53:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:53:36.577595 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7837c652-cc15-4114-9ca3-e7ac291a4fb6 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:36.604462 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c3950-558a-4e74-a2bf-f76f3813b576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:36.605145 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c3950-558a-4e74-a2bf-f76f3813b576 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:36.605430 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c3950-558a-4e74-a2bf-f76f3813b576 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:36.605705 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c3950-558a-4e74-a2bf-f76f3813b576 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:36.606437 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8c3950-558a-4e74-a2bf-f76f3813b576 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:36.606744 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8c3950-558a-4e74-a2bf-f76f3813b576 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:36.608136 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8c3950-558a-4e74-a2bf-f76f3813b576 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:36.620925 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 363/729] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:53:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:36.627034 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c3950-558a-4e74-a2bf-f76f3813b576 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:36.744590 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:36.790997 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c3950-558a-4e74-a2bf-f76f3813b576 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:36.817145 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7837c652-cc15-4114-9ca3-e7ac291a4fb6 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:36.837724 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e919a21-34cb-4e1d-bda8-b34547abfabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:36.838720 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e919a21-34cb-4e1d-bda8-b34547abfabd None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:36.839009 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e919a21-34cb-4e1d-bda8-b34547abfabd None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:36.839285 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e919a21-34cb-4e1d-bda8-b34547abfabd None admin] PATH_INFO: `/v3/users/swift` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:36.849877 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e919a21-34cb-4e1d-bda8-b34547abfabd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:36.851093 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e919a21-34cb-4e1d-bda8-b34547abfabd None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:36.865993 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-7e919a21-34cb-4e1d-bda8-b34547abfabd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 08 11:53:36.865993 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:36.865993 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:36.865993 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:36.865993 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:36.865993 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:36.865993 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:36.865993 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:36.865993 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:36.865993 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:36.865993 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:36.865993 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:36.865993 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 11:53:36.865993 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 11:53:36.865993 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 11:53:36.865993 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 11:53:36.866980 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:36.866980 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:36.866980 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 11:53:36.866980 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:53:36.866980 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 11:53:36.866980 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:53:36.866980 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:36.866980 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:36.866980 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:36.866980 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:36.866980 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:36.866980 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:36.866980 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:36.866980 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:36.866980 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:36.866980 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:36.866980 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:36.866980 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:36.867906 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:36.867906 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:36.867906 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 11:53:36.867906 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 11:53:36.867906 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 11:53:36.867906 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 11:53:36.867906 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 11:53:36.867906 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 11:53:36.867906 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 08 11:53:36.867906 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:36.867906 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 364/730] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Jun 8 11:53:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:36.873575 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa25d58-db48-4a26-aee5-0e67318bdf99 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:36.873920 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa25d58-db48-4a26-aee5-0e67318bdf99 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:36.874212 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa25d58-db48-4a26-aee5-0e67318bdf99 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:36.879740 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 365/731] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:53:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:53:36.879740 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa25d58-db48-4a26-aee5-0e67318bdf99 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:36.880964 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c470a3a8-61c3-4615-871d-ed8d7881ed94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:36.882020 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470a3a8-61c3-4615-871d-ed8d7881ed94 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:36.882506 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470a3a8-61c3-4615-871d-ed8d7881ed94 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:36.882991 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470a3a8-61c3-4615-871d-ed8d7881ed94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:36.895458 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c470a3a8-61c3-4615-871d-ed8d7881ed94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:36.897486 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c470a3a8-61c3-4615-871d-ed8d7881ed94 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:36.918394 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-c470a3a8-61c3-4615-871d-ed8d7881ed94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:36.918394 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:36.918394 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:36.918394 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:36.918394 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:36.918394 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:36.918394 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:36.918394 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:36.918394 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:36.918394 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:36.918394 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:36.918394 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:36.918394 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:53:36.918394 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:53:36.918394 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:53:36.919335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:53:36.919335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:36.919335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:36.919335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:36.919335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:36.919335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:36.919335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:36.919335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:36.919335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:36.919335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:36.919335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:36.919335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:36.919335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:36.919335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:36.919335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:36.919335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:36.919335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:36.920667 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:53:36.920667 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:53:36.920667 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:36.920667 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:36.922720 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 367/732] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:53:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:36.924405 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238ea03-477f-4b7c-a237-7ef0ebc1354b None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:36.924916 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238ea03-477f-4b7c-a237-7ef0ebc1354b None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:36.925444 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238ea03-477f-4b7c-a237-7ef0ebc1354b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:36.943613 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-6238ea03-477f-4b7c-a237-7ef0ebc1354b None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:53:36.945439 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-6238ea03-477f-4b7c-a237-7ef0ebc1354b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:53:36.986420 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa25d58-db48-4a26-aee5-0e67318bdf99 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:36.993678 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:37.006717 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:37.025924 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c2e9e-5dbd-499b-9b25-0ab9db3ccc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:37.026638 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c2e9e-5dbd-499b-9b25-0ab9db3ccc67 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:37.026933 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c2e9e-5dbd-499b-9b25-0ab9db3ccc67 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:37.031783 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c2e9e-5dbd-499b-9b25-0ab9db3ccc67 None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:37.031783 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c2e9e-5dbd-499b-9b25-0ab9db3ccc67 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:37.031783 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c2e9e-5dbd-499b-9b25-0ab9db3ccc67 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:37.031783 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c2e9e-5dbd-499b-9b25-0ab9db3ccc67 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:37.032505 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 368/733] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:53:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:53:37.033280 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238ea03-477f-4b7c-a237-7ef0ebc1354b None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:37.049942 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 366/734] 10.222.0.39 () {56 vars in 1135 bytes} [Wed Jun 8 11:53:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:37.055278 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c2e9e-5dbd-499b-9b25-0ab9db3ccc67 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:37.164354 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c2e9e-5dbd-499b-9b25-0ab9db3ccc67 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:37.165570 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238ea03-477f-4b7c-a237-7ef0ebc1354b None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:37.202499 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532347f1-ee82-4961-87ab-50004ee837b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:37.203094 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25b77e-4e0d-40db-a9f3-90212921ba8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:37.203330 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532347f1-ee82-4961-87ab-50004ee837b3 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:37.203612 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532347f1-ee82-4961-87ab-50004ee837b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:37.203808 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25b77e-4e0d-40db-a9f3-90212921ba8e None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:37.203895 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532347f1-ee82-4961-87ab-50004ee837b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:37.204090 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25b77e-4e0d-40db-a9f3-90212921ba8e None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:37.204391 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25b77e-4e0d-40db-a9f3-90212921ba8e None admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:37.205059 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f25b77e-4e0d-40db-a9f3-90212921ba8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:37.205367 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f25b77e-4e0d-40db-a9f3-90212921ba8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:37.207005 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f25b77e-4e0d-40db-a9f3-90212921ba8e None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:37.214957 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532347f1-ee82-4961-87ab-50004ee837b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:53:37.220083 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 369/735] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:53:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:37.221112 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25b77e-4e0d-40db-a9f3-90212921ba8e None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:37.222750 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-532347f1-ee82-4961-87ab-50004ee837b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:53:37.222750 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:37.222750 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:37.222750 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:37.222750 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:37.222750 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:37.222750 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:37.222750 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:37.222750 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:37.222750 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:37.222750 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:37.222750 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:37.222750 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:53:37.222750 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:53:37.222750 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:53:37.222750 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:53:37.223969 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:53:37.223969 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:53:37.223969 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:53:37.223969 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:53:37.223969 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:37.223969 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:37.223969 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:37.223969 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:37.223969 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:37.223969 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:37.223969 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:37.223969 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:37.223969 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:37.223969 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:37.223969 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:37.223969 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:37.225132 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:37.225132 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:37.225132 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:37.225132 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:37.225132 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:53:37.225132 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:53:37.225132 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:53:37.225132 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:53:37.225132 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:53:37.225132 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:53:37.225132 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:53:37.225132 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:37.229480 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 367/736] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Jun 8 11:53:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:37.231903 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb696a-f90b-4062-b375-c17c128acd56 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:37.232210 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb696a-f90b-4062-b375-c17c128acd56 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:37.232494 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb696a-f90b-4062-b375-c17c128acd56 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:37.237970 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 368/737] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:53:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:53:37.237970 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb696a-f90b-4062-b375-c17c128acd56 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:37.266599 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:37.272582 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:37.339003 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25b77e-4e0d-40db-a9f3-90212921ba8e None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:37.342140 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb696a-f90b-4062-b375-c17c128acd56 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:37.378141 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc610617-1d87-45f7-b432-63ff509868de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:37.378922 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc610617-1d87-45f7-b432-63ff509868de None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:37.379209 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc610617-1d87-45f7-b432-63ff509868de None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:37.379484 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc610617-1d87-45f7-b432-63ff509868de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:37.380367 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd84612c-1b82-44d8-9bec-d90e729e17fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:37.381189 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84612c-1b82-44d8-9bec-d90e729e17fe None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:37.381528 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84612c-1b82-44d8-9bec-d90e729e17fe None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:37.381813 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84612c-1b82-44d8-9bec-d90e729e17fe None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:37.390557 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd84612c-1b82-44d8-9bec-d90e729e17fe None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:37.392040 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd84612c-1b82-44d8-9bec-d90e729e17fe None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:37.407132 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-dd84612c-1b82-44d8-9bec-d90e729e17fe None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 08 11:53:37.407132 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:37.407132 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:37.407132 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:37.407132 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:37.407132 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:37.407132 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:37.407132 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:37.407132 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:37.407132 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:37.407132 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:37.407132 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:37.407132 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 11:53:37.407132 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 11:53:37.407132 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 11:53:37.407132 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 11:53:37.408105 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:37.408105 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:37.408105 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 11:53:37.408105 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:53:37.408105 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 11:53:37.408105 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:53:37.408105 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:37.408105 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:37.408105 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:37.408105 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:37.408105 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:37.408105 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:37.408105 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:37.408105 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:37.408105 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:37.408105 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:37.408105 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:37.408105 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:37.409082 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:37.409082 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:37.409082 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 11:53:37.409082 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 11:53:37.409082 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 11:53:37.409082 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 11:53:37.409082 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 11:53:37.409082 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 11:53:37.409082 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 08 11:53:37.409082 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:37.409082 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 369/738] 10.222.0.39 () {56 vars in 1117 bytes} [Wed Jun 8 11:53:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:37.409082 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd84612c-1b82-44d8-9bec-d90e729e17fe None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:37.449212 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc610617-1d87-45f7-b432-63ff509868de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:37.450672 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc610617-1d87-45f7-b432-63ff509868de None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:37.484395 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:37.504812 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:37.511134 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd84612c-1b82-44d8-9bec-d90e729e17fe None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:37.544063 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d0bde-12f4-48c0-8eb8-14107d4eb5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:37.544761 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d0bde-12f4-48c0-8eb8-14107d4eb5d9 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:37.545034 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d0bde-12f4-48c0-8eb8-14107d4eb5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:37.545312 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d0bde-12f4-48c0-8eb8-14107d4eb5d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:37.546052 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3d0bde-12f4-48c0-8eb8-14107d4eb5d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:37.546355 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3d0bde-12f4-48c0-8eb8-14107d4eb5d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:37.547704 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3d0bde-12f4-48c0-8eb8-14107d4eb5d9 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:37.548982 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 370/739] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:53:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 11:53:37.550267 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff54f1-54ef-49e1-9dbb-63089080112b None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:37.550560 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff54f1-54ef-49e1-9dbb-63089080112b None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:37.550841 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff54f1-54ef-49e1-9dbb-63089080112b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:37.556364 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 370/740] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:53:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:37.557674 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ebba1-67c8-4d04-85ad-9e2b02c9be06 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:37.558202 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ebba1-67c8-4d04-85ad-9e2b02c9be06 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:37.558202 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ebba1-67c8-4d04-85ad-9e2b02c9be06 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:37.563684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 371/741] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:53:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:53:37.564412 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ebba1-67c8-4d04-85ad-9e2b02c9be06 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:37.566939 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-43ff54f1-54ef-49e1-9dbb-63089080112b None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:53:37.568131 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-43ff54f1-54ef-49e1-9dbb-63089080112b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:53:37.636599 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 371/742] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:53:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:53:37.637280 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff54f1-54ef-49e1-9dbb-63089080112b None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:37.670300 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ebba1-67c8-4d04-85ad-9e2b02c9be06 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:37.701865 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:37.703449 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea18d35-2774-48b7-a9bc-ab0bd1a87296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:37.704117 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea18d35-2774-48b7-a9bc-ab0bd1a87296 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:37.704453 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea18d35-2774-48b7-a9bc-ab0bd1a87296 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:37.704776 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea18d35-2774-48b7-a9bc-ab0bd1a87296 None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:37.705605 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea18d35-2774-48b7-a9bc-ab0bd1a87296 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:37.705911 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea18d35-2774-48b7-a9bc-ab0bd1a87296 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:37.707333 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea18d35-2774-48b7-a9bc-ab0bd1a87296 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:37.724691 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 372/743] 10.222.0.39 () {56 vars in 1149 bytes} [Wed Jun 8 11:53:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:37.725478 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea18d35-2774-48b7-a9bc-ab0bd1a87296 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:37.736545 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff54f1-54ef-49e1-9dbb-63089080112b None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:37.746429 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:37.770234 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978df2fe-cf95-4389-ab6d-b07d9e8d005b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:37.771059 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978df2fe-cf95-4389-ab6d-b07d9e8d005b None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:37.771344 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978df2fe-cf95-4389-ab6d-b07d9e8d005b None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:37.771625 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978df2fe-cf95-4389-ab6d-b07d9e8d005b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:37.782390 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978df2fe-cf95-4389-ab6d-b07d9e8d005b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:37.783848 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978df2fe-cf95-4389-ab6d-b07d9e8d005b None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:37.801478 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-978df2fe-cf95-4389-ab6d-b07d9e8d005b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:37.801478 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:37.801478 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:37.801478 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:37.801478 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:37.801478 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:37.801478 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:37.801478 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:37.801478 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:37.801478 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:37.801478 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:37.801478 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:37.801478 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:53:37.801478 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:53:37.801478 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:53:37.802569 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:53:37.802569 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:37.802569 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:37.802569 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:37.802569 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:37.802569 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:37.802569 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:37.802569 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:37.802569 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:37.802569 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:37.802569 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:37.802569 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:37.802569 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:37.802569 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:37.802569 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:37.802569 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:37.802569 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:37.803482 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:53:37.803482 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:53:37.803482 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:37.803482 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:37.803482 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 372/744] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:53:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:37.804275 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43b72a-8232-4dba-a807-8e723380a580 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:37.804560 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43b72a-8232-4dba-a807-8e723380a580 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:37.805176 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43b72a-8232-4dba-a807-8e723380a580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:37.822166 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-0d43b72a-8232-4dba-a807-8e723380a580 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:53:37.823337 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-0d43b72a-8232-4dba-a807-8e723380a580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:53:37.829256 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea18d35-2774-48b7-a9bc-ab0bd1a87296 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:37.863372 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e1bbd-6e78-4b1f-a016-53892f8a40c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:37.864103 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e1bbd-6e78-4b1f-a016-53892f8a40c6 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:37.864417 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e1bbd-6e78-4b1f-a016-53892f8a40c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:37.864692 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e1bbd-6e78-4b1f-a016-53892f8a40c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:37.875287 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e1bbd-6e78-4b1f-a016-53892f8a40c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:37.876771 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e1bbd-6e78-4b1f-a016-53892f8a40c6 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:37.890227 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 373/745] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:53:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 08 11:53:37.891038 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d43b72a-8232-4dba-a807-8e723380a580 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:37.893862 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-be6e1bbd-6e78-4b1f-a016-53892f8a40c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:37.893862 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:37.893862 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:37.893862 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:37.893862 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:37.893862 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:37.893862 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:37.893862 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:37.893862 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:37.893862 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:37.893862 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:37.893862 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:37.893862 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:53:37.893862 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:53:37.893862 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:53:37.894752 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:53:37.894752 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:37.894752 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:37.894752 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:37.894752 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:37.894752 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:37.894752 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:37.894752 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:37.894752 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:37.894752 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:37.894752 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:37.894752 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:37.894752 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:37.894752 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:37.894752 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:37.894752 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:37.894752 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:37.895743 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:53:37.895743 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:53:37.895743 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:37.895743 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:37.895743 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 373/746] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:53:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:37.896406 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e1bbd-6e78-4b1f-a016-53892f8a40c6 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:37.943334 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:37.968071 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:37.993976 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d43b72a-8232-4dba-a807-8e723380a580 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:38.001685 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e1bbd-6e78-4b1f-a016-53892f8a40c6 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:38.027300 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780e98f-294b-4b3c-97d0-2fa82ec60146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:38.027968 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780e98f-294b-4b3c-97d0-2fa82ec60146 None admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:38.028280 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780e98f-294b-4b3c-97d0-2fa82ec60146 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:38.028557 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780e98f-294b-4b3c-97d0-2fa82ec60146 None admin] PATH_INFO: `/v3/services` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:38.029273 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9780e98f-294b-4b3c-97d0-2fa82ec60146 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:38.030646 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9780e98f-294b-4b3c-97d0-2fa82ec60146 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:38.035097 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd0086-fce8-4f72-9235-6782a9405a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:38.035799 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd0086-fce8-4f72-9235-6782a9405a5d None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:38.036114 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd0086-fce8-4f72-9235-6782a9405a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:38.036465 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd0086-fce8-4f72-9235-6782a9405a5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:38.058564 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 374/747] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Jun 8 11:53:37 2022] POST /identity/v3/services => generated 251 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 11:53:38.058564 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780e98f-294b-4b3c-97d0-2fa82ec60146 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:38.114655 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd0086-fce8-4f72-9235-6782a9405a5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:38.116557 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd0086-fce8-4f72-9235-6782a9405a5d None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:38.188873 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780e98f-294b-4b3c-97d0-2fa82ec60146 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:38.191878 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:38.195829 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:38.232037 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b65ff-e505-4554-9440-8535a6917d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:38.232755 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b65ff-e505-4554-9440-8535a6917d0b None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:38.233045 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b65ff-e505-4554-9440-8535a6917d0b None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:38.233328 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b65ff-e505-4554-9440-8535a6917d0b None admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:38.234212 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3b65ff-e505-4554-9440-8535a6917d0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:38.234610 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3b65ff-e505-4554-9440-8535a6917d0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:38.236022 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3b65ff-e505-4554-9440-8535a6917d0b None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:38.242531 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 374/748] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:53:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 08 11:53:38.242531 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd0086-fce8-4f72-9235-6782a9405a5d None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:38.254920 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 375/749] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:38.255871 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b65ff-e505-4554-9440-8535a6917d0b None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:38.356685 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd0086-fce8-4f72-9235-6782a9405a5d None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:38.360773 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b65ff-e505-4554-9440-8535a6917d0b None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:38.392051 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829853f-9912-4b82-aa8a-4d5b316ac24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:38.392707 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829853f-9912-4b82-aa8a-4d5b316ac24a None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:38.392993 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829853f-9912-4b82-aa8a-4d5b316ac24a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:38.393269 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829853f-9912-4b82-aa8a-4d5b316ac24a None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:38.393986 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829853f-9912-4b82-aa8a-4d5b316ac24a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:38.394292 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829853f-9912-4b82-aa8a-4d5b316ac24a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:38.395347 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742549a-92f1-4a48-b3f8-43241a6c6fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:38.395783 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829853f-9912-4b82-aa8a-4d5b316ac24a None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:38.396062 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742549a-92f1-4a48-b3f8-43241a6c6fd2 None admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:38.396377 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742549a-92f1-4a48-b3f8-43241a6c6fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:38.396654 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742549a-92f1-4a48-b3f8-43241a6c6fd2 None admin] PATH_INFO: `/v3/services` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:38.397375 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4742549a-92f1-4a48-b3f8-43241a6c6fd2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:38.398729 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4742549a-92f1-4a48-b3f8-43241a6c6fd2 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:38.409067 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 375/750] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:38.410075 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829853f-9912-4b82-aa8a-4d5b316ac24a None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:38.428200 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 376/751] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Jun 8 11:53:38 2022] POST /identity/v3/services => generated 240 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 11:53:38.428200 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742549a-92f1-4a48-b3f8-43241a6c6fd2 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:38.453661 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:38.457716 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:38.541392 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829853f-9912-4b82-aa8a-4d5b316ac24a None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:38.558292 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742549a-92f1-4a48-b3f8-43241a6c6fd2 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:38.587953 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ccc26-2025-452b-8181-5b9606f69344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:38.588810 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ccc26-2025-452b-8181-5b9606f69344 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:38.589275 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ccc26-2025-452b-8181-5b9606f69344 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:38.589559 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ccc26-2025-452b-8181-5b9606f69344 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:38.607770 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089ccc26-2025-452b-8181-5b9606f69344 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:38.609552 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089ccc26-2025-452b-8181-5b9606f69344 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:38.610032 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d134cc1-9ade-4eea-9921-0ac36f15b80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:38.611110 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d134cc1-9ade-4eea-9921-0ac36f15b80a None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:38.611852 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d134cc1-9ade-4eea-9921-0ac36f15b80a None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:38.612366 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d134cc1-9ade-4eea-9921-0ac36f15b80a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:38.622945 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d134cc1-9ade-4eea-9921-0ac36f15b80a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:38.624834 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d134cc1-9ade-4eea-9921-0ac36f15b80a None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:38.631281 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-089ccc26-2025-452b-8181-5b9606f69344 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:38.631281 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:38.631281 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:38.631281 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:38.631281 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:38.631281 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:38.631281 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:38.631281 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:38.631281 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:38.631281 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:38.631281 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:38.631281 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:38.631281 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:53:38.631281 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:53:38.631281 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:53:38.632266 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:53:38.632266 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:38.632266 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:38.632266 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:38.632266 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:38.632266 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:38.632266 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:38.632266 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:38.632266 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:38.632266 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:38.632266 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:38.632266 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:38.632266 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:38.632266 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:38.632266 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:38.632266 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:38.632266 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:38.633203 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:53:38.633203 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:53:38.633203 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:38.633203 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:38.636440 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 376/752] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:53:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:38.638033 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ccc26-2025-452b-8181-5b9606f69344 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:38.647542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-1d134cc1-9ade-4eea-9921-0ac36f15b80a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:53:38.647542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:38.647542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:38.647542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:38.647542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:38.647542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:38.647542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:38.647542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:38.647542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:38.647542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:38.647542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:38.647542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:38.647542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 11:53:38.647542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 11:53:38.647542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 11:53:38.648518 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 11:53:38.648518 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:38.648518 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:38.648518 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:38.648518 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:38.648518 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:38.648518 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:38.648518 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:38.648518 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:38.648518 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:38.648518 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:38.648518 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:38.648518 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:38.648518 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:38.648518 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:38.648518 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:38.648518 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:38.650027 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 11:53:38.650027 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 11:53:38.650027 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 11:53:38.650027 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 11:53:38.650027 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 11:53:38.650027 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 11:53:38.650027 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:53:38.650027 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:38.655304 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 377/753] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Jun 8 11:53:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:38.656371 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d134cc1-9ade-4eea-9921-0ac36f15b80a None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:38.749854 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:38.757995 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:38.773075 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ccc26-2025-452b-8181-5b9606f69344 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:38.779958 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d134cc1-9ade-4eea-9921-0ac36f15b80a None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:38.811991 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d16521d-1606-4c87-a60f-b3a76bef3893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:38.813215 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16521d-1606-4c87-a60f-b3a76bef3893 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:38.813697 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16521d-1606-4c87-a60f-b3a76bef3893 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:38.814166 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16521d-1606-4c87-a60f-b3a76bef3893 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:38.817484 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239e8ef-4a39-496f-a000-277a68540eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:38.818161 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239e8ef-4a39-496f-a000-277a68540eeb None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:38.818445 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239e8ef-4a39-496f-a000-277a68540eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:38.818723 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239e8ef-4a39-496f-a000-277a68540eeb None admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:38.819450 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3239e8ef-4a39-496f-a000-277a68540eeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:38.819755 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3239e8ef-4a39-496f-a000-277a68540eeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:38.821716 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3239e8ef-4a39-496f-a000-277a68540eeb None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:38.824725 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d16521d-1606-4c87-a60f-b3a76bef3893 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:38.826414 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d16521d-1606-4c87-a60f-b3a76bef3893 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:38.835019 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 378/754] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:38.835875 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239e8ef-4a39-496f-a000-277a68540eeb None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:38.843200 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-2d16521d-1606-4c87-a60f-b3a76bef3893 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 08 11:53:38.843200 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:38.843200 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:38.843200 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:38.843200 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:38.843200 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:38.843200 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:38.843200 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:38.843200 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:38.843200 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:38.843200 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:38.843200 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:38.843200 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 11:53:38.843200 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 11:53:38.843200 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 11:53:38.843200 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 11:53:38.844146 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:38.844146 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:38.844146 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 11:53:38.844146 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:53:38.844146 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 11:53:38.844146 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:53:38.844146 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:38.844146 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:38.844146 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:38.844146 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:38.844146 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:38.844146 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:38.844146 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:38.844146 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:38.844146 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:38.844146 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:38.844146 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:38.844146 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:38.845101 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:38.845101 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:38.845101 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 11:53:38.845101 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 11:53:38.845101 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 11:53:38.845101 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 11:53:38.845101 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 11:53:38.845101 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 11:53:38.845101 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 08 11:53:38.845101 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:38.852502 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 377/755] 10.222.0.39 () {56 vars in 1093 bytes} [Wed Jun 8 11:53:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:38.853947 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d16521d-1606-4c87-a60f-b3a76bef3893 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:38.950081 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239e8ef-4a39-496f-a000-277a68540eeb None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:38.962718 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d16521d-1606-4c87-a60f-b3a76bef3893 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:38.987539 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e94741b-bf9e-4351-b1d0-045405d99b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:38.988203 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e94741b-bf9e-4351-b1d0-045405d99b1c None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:38.988512 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e94741b-bf9e-4351-b1d0-045405d99b1c None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:38.988790 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e94741b-bf9e-4351-b1d0-045405d99b1c None admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:38.989687 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e94741b-bf9e-4351-b1d0-045405d99b1c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:38.990008 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e94741b-bf9e-4351-b1d0-045405d99b1c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:38.991431 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e94741b-bf9e-4351-b1d0-045405d99b1c None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:39.001083 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:39.002068 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa676274-e56a-4567-bdee-0a49e1d2e4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:39.003083 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa676274-e56a-4567-bdee-0a49e1d2e4a1 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:39.003575 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa676274-e56a-4567-bdee-0a49e1d2e4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:39.004046 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa676274-e56a-4567-bdee-0a49e1d2e4a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:39.004579 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 379/756] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Jun 8 11:53:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:39.005375 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e94741b-bf9e-4351-b1d0-045405d99b1c None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:39.013289 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa676274-e56a-4567-bdee-0a49e1d2e4a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:39.015020 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa676274-e56a-4567-bdee-0a49e1d2e4a1 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:39.018003 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:39.030756 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-aa676274-e56a-4567-bdee-0a49e1d2e4a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:53:39.030756 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:39.030756 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:39.030756 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:39.030756 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:39.030756 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:39.030756 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:39.030756 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:39.030756 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:39.030756 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:39.030756 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:39.030756 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:39.030756 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 11:53:39.030756 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 11:53:39.030756 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 11:53:39.031845 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 11:53:39.031845 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:39.031845 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:39.031845 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:39.031845 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:39.031845 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:39.031845 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:39.031845 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:39.031845 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:39.031845 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:39.031845 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:39.031845 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:39.031845 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:39.031845 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:39.031845 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:39.031845 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:39.031845 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:39.032964 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 11:53:39.032964 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 11:53:39.032964 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 11:53:39.032964 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 11:53:39.032964 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 11:53:39.032964 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 11:53:39.032964 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:53:39.032964 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:39.040648 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 378/757] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Jun 8 11:53:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:39.041478 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa676274-e56a-4567-bdee-0a49e1d2e4a1 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:39.126147 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e94741b-bf9e-4351-b1d0-045405d99b1c None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:39.148749 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa676274-e56a-4567-bdee-0a49e1d2e4a1 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:39.163054 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950cf78d-29a4-4c5a-9cb3-b1f9a88edac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:39.164043 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950cf78d-29a4-4c5a-9cb3-b1f9a88edac8 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:39.164524 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950cf78d-29a4-4c5a-9cb3-b1f9a88edac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:39.165541 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950cf78d-29a4-4c5a-9cb3-b1f9a88edac8 None admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:39.166669 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950cf78d-29a4-4c5a-9cb3-b1f9a88edac8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:39.167178 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950cf78d-29a4-4c5a-9cb3-b1f9a88edac8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:39.168959 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950cf78d-29a4-4c5a-9cb3-b1f9a88edac8 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:39.186712 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3020410a-986a-4971-a22c-098fb71053f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:39.187471 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3020410a-986a-4971-a22c-098fb71053f0 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:39.187824 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3020410a-986a-4971-a22c-098fb71053f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:39.188189 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3020410a-986a-4971-a22c-098fb71053f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:39.189093 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3020410a-986a-4971-a22c-098fb71053f0 None admin] RBAC: Adding query filter params (role.id=028d4429a4554bbb88b3aec9f6a9d937, scope.project.id=6a7fee684e8b43e199c95aeeb92640d4, user.id=753bde6a72d64045abd3ad44b9b0de04) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:39.189474 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3020410a-986a-4971-a22c-098fb71053f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:39.191859 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3020410a-986a-4971-a22c-098fb71053f0 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:39.193733 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 380/758] 10.222.0.39 () {56 vars in 1133 bytes} [Wed Jun 8 11:53:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:39.194756 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950cf78d-29a4-4c5a-9cb3-b1f9a88edac8 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:39.202119 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 379/759] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Jun 8 11:53:39 2022] GET /identity/v3/role_assignments?user.id=753bde6a72d64045abd3ad44b9b0de04&scope.project.id=6a7fee684e8b43e199c95aeeb92640d4&role.id=028d4429a4554bbb88b3aec9f6a9d937 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:39.203098 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3020410a-986a-4971-a22c-098fb71053f0 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:39.264620 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:39.277009 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:39.321257 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950cf78d-29a4-4c5a-9cb3-b1f9a88edac8 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:39.322251 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3020410a-986a-4971-a22c-098fb71053f0 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:39.366079 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf177dd-d8bc-4814-a6be-d0f8843668ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:39.367175 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf177dd-d8bc-4814-a6be-d0f8843668ac None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:39.367627 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf177dd-d8bc-4814-a6be-d0f8843668ac None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:39.368118 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf177dd-d8bc-4814-a6be-d0f8843668ac None admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:39.369144 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf177dd-d8bc-4814-a6be-d0f8843668ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:39.369654 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf177dd-d8bc-4814-a6be-d0f8843668ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:39.371340 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf177dd-d8bc-4814-a6be-d0f8843668ac None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:39.386050 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 381/760] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Jun 8 11:53:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:39.392584 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf177dd-d8bc-4814-a6be-d0f8843668ac None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:39.401938 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272721c-79f4-470d-8c71-32c5d52c9561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:39.402885 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272721c-79f4-470d-8c71-32c5d52c9561 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:39.403221 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272721c-79f4-470d-8c71-32c5d52c9561 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:39.403567 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272721c-79f4-470d-8c71-32c5d52c9561 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:39.420953 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1272721c-79f4-470d-8c71-32c5d52c9561 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:39.422536 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1272721c-79f4-470d-8c71-32c5d52c9561 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:39.442575 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-1272721c-79f4-470d-8c71-32c5d52c9561 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:39.442575 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:39.442575 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:39.442575 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:39.442575 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:39.442575 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:39.442575 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:39.442575 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:39.442575 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:39.442575 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:39.442575 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:39.442575 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:39.442575 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:53:39.442575 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:53:39.442575 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:53:39.443573 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:53:39.443573 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:39.443573 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:39.443573 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:39.443573 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:39.443573 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:39.443573 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:39.443573 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:39.443573 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:39.443573 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:39.443573 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:39.443573 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:39.443573 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:39.443573 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:39.443573 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:39.443573 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:39.443573 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:39.444525 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:53:39.444525 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:53:39.444525 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:39.444525 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:39.448513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 380/761] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:53:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:39.450356 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272721c-79f4-470d-8c71-32c5d52c9561 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:39.511944 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf177dd-d8bc-4814-a6be-d0f8843668ac None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:39.548103 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20292de-7614-4aad-ad35-c86d6f65c99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:39.549144 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20292de-7614-4aad-ad35-c86d6f65c99e None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:39.552352 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:39.552896 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20292de-7614-4aad-ad35-c86d6f65c99e None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:39.553614 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20292de-7614-4aad-ad35-c86d6f65c99e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:39.554649 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20292de-7614-4aad-ad35-c86d6f65c99e None admin] RBAC: Adding query filter params (role.id=125b7374688b4b009d443f1b34947c49, scope.project.id=6a7fee684e8b43e199c95aeeb92640d4, user.id=d52efc21c66d4300a8a979d92dbfeb47) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:39.555144 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20292de-7614-4aad-ad35-c86d6f65c99e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:39.557060 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20292de-7614-4aad-ad35-c86d6f65c99e None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:39.563665 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 382/762] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Jun 8 11:53:39 2022] GET /identity/v3/role_assignments?user.id=d52efc21c66d4300a8a979d92dbfeb47&scope.project.id=6a7fee684e8b43e199c95aeeb92640d4&role.id=125b7374688b4b009d443f1b34947c49 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:39.654542 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272721c-79f4-470d-8c71-32c5d52c9561 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:39.683606 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:39.703841 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb0f67-7bc3-488b-a034-942953c27b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:39.704567 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb0f67-7bc3-488b-a034-942953c27b8c None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:39.704848 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb0f67-7bc3-488b-a034-942953c27b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:39.705122 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb0f67-7bc3-488b-a034-942953c27b8c None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:39.705853 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeb0f67-7bc3-488b-a034-942953c27b8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:39.706157 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeb0f67-7bc3-488b-a034-942953c27b8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:39.707583 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeb0f67-7bc3-488b-a034-942953c27b8c None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:39.724285 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 381/763] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:53:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:39.726617 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20292de-7614-4aad-ad35-c86d6f65c99e None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:39.866130 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20292de-7614-4aad-ad35-c86d6f65c99e None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:39.900791 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b98208-e781-4477-92d3-c94eaca4edf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:39.901607 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b98208-e781-4477-92d3-c94eaca4edf4 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:39.901892 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b98208-e781-4477-92d3-c94eaca4edf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:39.902167 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b98208-e781-4477-92d3-c94eaca4edf4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:39.909354 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b98208-e781-4477-92d3-c94eaca4edf4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:39.910819 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b98208-e781-4477-92d3-c94eaca4edf4 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:39.926436 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-44b98208-e781-4477-92d3-c94eaca4edf4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:53:39.926436 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:39.926436 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:39.926436 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:39.926436 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:39.926436 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:39.926436 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:39.926436 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:39.926436 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:39.926436 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:39.926436 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:39.926436 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:39.926436 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 11:53:39.926436 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 11:53:39.926436 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 11:53:39.927381 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 11:53:39.927381 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:39.927381 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:39.927381 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:39.927381 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:39.927381 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:39.927381 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:39.927381 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:39.927381 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:39.927381 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:39.927381 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:39.927381 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:39.927381 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:39.927381 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:39.927381 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:39.927381 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:39.927381 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:39.928318 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 11:53:39.928318 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 11:53:39.928318 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 11:53:39.928318 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 11:53:39.928318 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 11:53:39.928318 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 11:53:39.928318 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:53:39.928318 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:39.932292 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 383/764] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Jun 8 11:53:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:39.933995 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb0f67-7bc3-488b-a034-942953c27b8c None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:40.071150 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb0f67-7bc3-488b-a034-942953c27b8c None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:40.112773 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32fc1af-a2dc-445b-8926-b23061424db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:40.113443 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32fc1af-a2dc-445b-8926-b23061424db7 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:40.113732 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32fc1af-a2dc-445b-8926-b23061424db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:40.114039 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32fc1af-a2dc-445b-8926-b23061424db7 None admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:40.114829 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32fc1af-a2dc-445b-8926-b23061424db7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:40.115137 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32fc1af-a2dc-445b-8926-b23061424db7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:40.120794 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32fc1af-a2dc-445b-8926-b23061424db7 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:40.139365 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 382/765] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Jun 8 11:53:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:40.144995 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b98208-e781-4477-92d3-c94eaca4edf4 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:40.199155 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:40.280110 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b98208-e781-4477-92d3-c94eaca4edf4 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:40.326293 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8277d3-e38f-4f1f-8da7-20b238bc023f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:40.327552 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8277d3-e38f-4f1f-8da7-20b238bc023f None admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:40.328048 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8277d3-e38f-4f1f-8da7-20b238bc023f None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:40.328558 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8277d3-e38f-4f1f-8da7-20b238bc023f None admin] PATH_INFO: `/v3/projects/6a7fee684e8b43e199c95aeeb92640d4/users/7ef7edb5e9ce49e6b098f48bf060b228/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:40.333038 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8277d3-e38f-4f1f-8da7-20b238bc023f None admin] RBAC: Authorizing `identity:create_grant(project_id=6a7fee684e8b43e199c95aeeb92640d4, user_id=7ef7edb5e9ce49e6b098f48bf060b228, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:40.334508 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8277d3-e38f-4f1f-8da7-20b238bc023f None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:40.372906 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 384/766] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Jun 8 11:53:40 2022] PUT /identity/v3/projects/6a7fee684e8b43e199c95aeeb92640d4/users/7ef7edb5e9ce49e6b098f48bf060b228/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 11:53:40.737611 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc4aa8-694d-4309-9baa-f7ae935464d8 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:40.738161 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc4aa8-694d-4309-9baa-f7ae935464d8 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:40.738161 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc4aa8-694d-4309-9baa-f7ae935464d8 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:40.739706 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 383/767] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:53:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:53:40.745641 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b21856-266f-42f8-bbe7-5a9ffc8e497b None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:40.746087 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b21856-266f-42f8-bbe7-5a9ffc8e497b None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:40.746185 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b21856-266f-42f8-bbe7-5a9ffc8e497b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:40.766545 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-20b21856-266f-42f8-bbe7-5a9ffc8e497b None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:53:40.767756 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-20b21856-266f-42f8-bbe7-5a9ffc8e497b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:53:40.845275 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 385/768] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:53:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 11:53:40.876123 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc4aa8-694d-4309-9baa-f7ae935464d8 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:40.937650 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:41.036418 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc4aa8-694d-4309-9baa-f7ae935464d8 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:41.080914 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec34f1-8487-4b61-bb90-1011dabb35ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:41.081728 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec34f1-8487-4b61-bb90-1011dabb35ca None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:41.082008 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec34f1-8487-4b61-bb90-1011dabb35ca None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:41.082277 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec34f1-8487-4b61-bb90-1011dabb35ca None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:41.082985 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ec34f1-8487-4b61-bb90-1011dabb35ca None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:41.084378 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ec34f1-8487-4b61-bb90-1011dabb35ca None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:41.100337 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-98ec34f1-8487-4b61-bb90-1011dabb35ca None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 08 11:53:41.100337 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:41.100337 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 11:53:41.100337 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 11:53:41.100337 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 11:53:41.100337 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 11:53:41.100337 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 11:53:41.100337 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 11:53:41.100337 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 08 11:53:41.100337 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:41.100337 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 11:53:41.100337 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:41.100337 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:41.100337 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:41.100337 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:41.100337 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:41.101308 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:41.101308 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:41.101308 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:41.101308 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:41.101308 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:41.101308 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:41.101308 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:41.101308 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 11:53:41.101308 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 11:53:41.101308 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 11:53:41.101308 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 11:53:41.101308 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:41.101308 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:41.101308 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:41.101308 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:41.101308 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:41.102684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:41.102684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:41.102684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:41.102684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:41.102684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:41.102684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:41.102684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:41.102684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:41.102684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:41.102684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:41.102684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:41.102684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 11:53:41.102684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 11:53:41.102684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 08 11:53:41.102684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:41.106594 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 384/769] 10.222.0.39 () {56 vars in 1129 bytes} [Wed Jun 8 11:53:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:41.107933 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b21856-266f-42f8-bbe7-5a9ffc8e497b None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:41.187761 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:41.295274 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b21856-266f-42f8-bbe7-5a9ffc8e497b None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:41.341905 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20de122-8826-40fb-b1cf-1e58b9197b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:41.342748 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20de122-8826-40fb-b1cf-1e58b9197b53 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:41.343043 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20de122-8826-40fb-b1cf-1e58b9197b53 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:41.343358 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20de122-8826-40fb-b1cf-1e58b9197b53 None admin] PATH_INFO: `/v3/services` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:41.344076 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20de122-8826-40fb-b1cf-1e58b9197b53 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:41.344630 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20de122-8826-40fb-b1cf-1e58b9197b53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:41.345969 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20de122-8826-40fb-b1cf-1e58b9197b53 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:41.351369 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 386/770] 10.222.0.39 () {56 vars in 1124 bytes} [Wed Jun 8 11:53:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:41.357796 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec34f1-8487-4b61-bb90-1011dabb35ca None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:41.422335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa12de8-cc4a-4190-bec4-a917fe3db951 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:41.422651 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa12de8-cc4a-4190-bec4-a917fe3db951 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:41.422904 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa12de8-cc4a-4190-bec4-a917fe3db951 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:41.424796 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 387/771] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:53:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 11:53:41.431582 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ebe7ab-6cf0-4e02-9c62-2b07b6eb7bb5 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:41.431882 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ebe7ab-6cf0-4e02-9c62-2b07b6eb7bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:41.432140 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ebe7ab-6cf0-4e02-9c62-2b07b6eb7bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:41.451275 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-78ebe7ab-6cf0-4e02-9c62-2b07b6eb7bb5 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:53:41.452663 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-78ebe7ab-6cf0-4e02-9c62-2b07b6eb7bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:53:41.534740 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 388/772] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:53:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 11:53:41.561056 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ebe7ab-6cf0-4e02-9c62-2b07b6eb7bb5 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:41.562261 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:41.571725 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec34f1-8487-4b61-bb90-1011dabb35ca None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:41.594588 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:41.641703 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe92b7e-1d3e-4a34-bb78-b10d695c5212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:41.644086 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe92b7e-1d3e-4a34-bb78-b10d695c5212 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:41.645908 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe92b7e-1d3e-4a34-bb78-b10d695c5212 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:41.646428 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe92b7e-1d3e-4a34-bb78-b10d695c5212 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:41.647528 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe92b7e-1d3e-4a34-bb78-b10d695c5212 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:41.648951 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe92b7e-1d3e-4a34-bb78-b10d695c5212 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:41.653926 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe92b7e-1d3e-4a34-bb78-b10d695c5212 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:41.662618 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 385/773] 10.222.0.39 () {56 vars in 1124 bytes} [Wed Jun 8 11:53:41 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:41.668265 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe92b7e-1d3e-4a34-bb78-b10d695c5212 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:41.719491 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ebe7ab-6cf0-4e02-9c62-2b07b6eb7bb5 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:41.767491 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1415743-ed80-49e7-9669-e0da9bb55898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:41.768145 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1415743-ed80-49e7-9669-e0da9bb55898 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:41.768417 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1415743-ed80-49e7-9669-e0da9bb55898 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:41.768692 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1415743-ed80-49e7-9669-e0da9bb55898 None admin] PATH_INFO: `/v3/services/network` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:41.769358 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1415743-ed80-49e7-9669-e0da9bb55898 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:41.770755 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1415743-ed80-49e7-9669-e0da9bb55898 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:41.794278 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-a1415743-ed80-49e7-9669-e0da9bb55898 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 08 11:53:41.794278 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:41.794278 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 11:53:41.794278 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 11:53:41.794278 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 11:53:41.794278 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 11:53:41.794278 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 11:53:41.794278 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 11:53:41.794278 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 08 11:53:41.794278 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:41.794278 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 11:53:41.794278 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:41.794278 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:41.794278 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:41.794278 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:41.794278 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:41.794278 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:41.795326 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:41.795326 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:41.795326 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:41.795326 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:41.795326 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:41.795326 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:41.795326 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 11:53:41.795326 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 11:53:41.795326 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 11:53:41.795326 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 11:53:41.795326 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:41.795326 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:41.795326 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:41.795326 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:41.795326 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:41.795326 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:41.796160 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:41.796160 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:41.796160 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:41.796160 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:41.796160 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:41.796160 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:41.796160 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:41.796160 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:41.796160 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:41.796160 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:41.796160 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 11:53:41.796160 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 11:53:41.796160 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 08 11:53:41.796160 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:41.802395 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 389/774] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Jun 8 11:53:41 2022] GET /identity/v3/services/network => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:41.803279 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1415743-ed80-49e7-9669-e0da9bb55898 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:41.931352 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:41.943346 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1415743-ed80-49e7-9669-e0da9bb55898 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:41.967222 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe92b7e-1d3e-4a34-bb78-b10d695c5212 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:41.989154 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c29bd6b-0a67-4d0d-af00-965da341812e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:41.990222 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29bd6b-0a67-4d0d-af00-965da341812e None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:41.990893 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29bd6b-0a67-4d0d-af00-965da341812e None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:41.992302 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29bd6b-0a67-4d0d-af00-965da341812e None admin] PATH_INFO: `/v3/services` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:41.993589 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c29bd6b-0a67-4d0d-af00-965da341812e None admin] RBAC: Adding query filter params (name=network) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:41.995677 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c29bd6b-0a67-4d0d-af00-965da341812e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:41.997439 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c29bd6b-0a67-4d0d-af00-965da341812e None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:42.009061 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 390/775] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Jun 8 11:53:41 2022] GET /identity/v3/services?name=network => generated 124 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:42.018111 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c29bd6b-0a67-4d0d-af00-965da341812e None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:42.051516 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5cf097-d22f-46b0-803b-77bd7bf2ab91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:42.053006 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5cf097-d22f-46b0-803b-77bd7bf2ab91 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:42.053360 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5cf097-d22f-46b0-803b-77bd7bf2ab91 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:42.053636 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5cf097-d22f-46b0-803b-77bd7bf2ab91 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:42.054437 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5cf097-d22f-46b0-803b-77bd7bf2ab91 None admin] RBAC: Adding query filter params (interface=public, service_id=c0931de987df490fb7066c097b3c14e3, region_id=RegionOne) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:42.054750 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5cf097-d22f-46b0-803b-77bd7bf2ab91 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:42.060384 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5cf097-d22f-46b0-803b-77bd7bf2ab91 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:42.069260 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 386/776] 10.222.0.39 () {56 vars in 1251 bytes} [Wed Jun 8 11:53:41 2022] GET /identity/v3/endpoints?service_id=c0931de987df490fb7066c097b3c14e3&interface=public®ion_id=RegionOne => generated 194 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:42.075901 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5cf097-d22f-46b0-803b-77bd7bf2ab91 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:42.112983 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:42.153609 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c29bd6b-0a67-4d0d-af00-965da341812e None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:42.191121 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e83d4-8e16-4adf-a5eb-38182cbd65a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:42.192026 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e83d4-8e16-4adf-a5eb-38182cbd65a1 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:42.192489 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e83d4-8e16-4adf-a5eb-38182cbd65a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:42.192926 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e83d4-8e16-4adf-a5eb-38182cbd65a1 None admin] PATH_INFO: `/v3/services` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:42.193909 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e83d4-8e16-4adf-a5eb-38182cbd65a1 None admin] RBAC: Adding query filter params (type=network) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:42.194368 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e83d4-8e16-4adf-a5eb-38182cbd65a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:42.196054 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e83d4-8e16-4adf-a5eb-38182cbd65a1 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:42.201887 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 391/777] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Jun 8 11:53:42 2022] GET /identity/v3/services?type=network => generated 350 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:42.203498 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d89a5-7745-428c-b534-8a5f1138f689 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:42.203965 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d89a5-7745-428c-b534-8a5f1138f689 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:42.204418 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d89a5-7745-428c-b534-8a5f1138f689 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:42.209957 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 392/778] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:53:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:53:42.210901 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d89a5-7745-428c-b534-8a5f1138f689 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:42.211141 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5cf097-d22f-46b0-803b-77bd7bf2ab91 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:42.240613 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:42.251861 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7627f93-0efd-43a6-9815-186653ccce7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:42.252901 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7627f93-0efd-43a6-9815-186653ccce7c None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:42.253438 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7627f93-0efd-43a6-9815-186653ccce7c None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:42.253903 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7627f93-0efd-43a6-9815-186653ccce7c None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:42.254763 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7627f93-0efd-43a6-9815-186653ccce7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:42.256694 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7627f93-0efd-43a6-9815-186653ccce7c None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:42.268503 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 387/779] 10.222.0.39 () {56 vars in 1087 bytes} [Wed Jun 8 11:53:42 2022] GET /identity/v3/services => generated 772 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:53:42.270371 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26d9df-9cd8-4d77-9a90-4ae2e56c74dc None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:42.270941 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26d9df-9cd8-4d77-9a90-4ae2e56c74dc None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:42.271407 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26d9df-9cd8-4d77-9a90-4ae2e56c74dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:42.301795 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-4a26d9df-9cd8-4d77-9a90-4ae2e56c74dc None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:53:42.303322 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-4a26d9df-9cd8-4d77-9a90-4ae2e56c74dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:53:42.344187 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d89a5-7745-428c-b534-8a5f1138f689 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:42.392326 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793725d-9040-499a-823c-6b2223c22ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:42.393029 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793725d-9040-499a-823c-6b2223c22ba3 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:42.393593 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793725d-9040-499a-823c-6b2223c22ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:42.393887 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793725d-9040-499a-823c-6b2223c22ba3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:42.395198 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0793725d-9040-499a-823c-6b2223c22ba3 None admin] RBAC: Adding query filter params (interface=public, service_id=0ab26390e4524a438539f1d47d6770c9, region_id=RegionOne) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:42.395798 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0793725d-9040-499a-823c-6b2223c22ba3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:42.397665 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0793725d-9040-499a-823c-6b2223c22ba3 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:42.407848 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 388/780] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:53:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 11:53:42.409158 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 393/781] 10.222.0.39 () {56 vars in 1251 bytes} [Wed Jun 8 11:53:42 2022] GET /identity/v3/endpoints?service_id=0ab26390e4524a438539f1d47d6770c9&interface=public®ion_id=RegionOne => generated 194 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:42.409466 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a0045-c17f-45e5-8a8c-db8840d1b4cc None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:42.409804 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a0045-c17f-45e5-8a8c-db8840d1b4cc None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:42.410205 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a0045-c17f-45e5-8a8c-db8840d1b4cc None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:42.415170 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793725d-9040-499a-823c-6b2223c22ba3 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:42.415897 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 389/782] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:53:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:53:42.417611 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85730eaa-c0ea-428d-92e9-a4894d018391 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:42.417948 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85730eaa-c0ea-428d-92e9-a4894d018391 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:42.418452 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85730eaa-c0ea-428d-92e9-a4894d018391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:42.440992 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-85730eaa-c0ea-428d-92e9-a4894d018391 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:53:42.442842 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-85730eaa-c0ea-428d-92e9-a4894d018391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:53:42.470072 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:42.530234 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:42.537563 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 390/783] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:53:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 11:53:42.538629 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85730eaa-c0ea-428d-92e9-a4894d018391 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:42.557535 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793725d-9040-499a-823c-6b2223c22ba3 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:42.604296 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdad1c7-319c-4233-bee9-88fc65a48c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:42.604296 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdad1c7-319c-4233-bee9-88fc65a48c7e None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:42.604814 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdad1c7-319c-4233-bee9-88fc65a48c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:42.605094 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdad1c7-319c-4233-bee9-88fc65a48c7e None admin] PATH_INFO: `/v3/services` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:42.606973 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdad1c7-319c-4233-bee9-88fc65a48c7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:42.607912 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdad1c7-319c-4233-bee9-88fc65a48c7e None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:42.616152 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 394/784] 10.222.0.39 () {56 vars in 1087 bytes} [Wed Jun 8 11:53:42 2022] GET /identity/v3/services => generated 772 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:53:42.617006 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdad1c7-319c-4233-bee9-88fc65a48c7e None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:42.675691 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85730eaa-c0ea-428d-92e9-a4894d018391 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:42.729309 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad3721-aa5d-4e61-9c5e-d17936be2cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:42.730058 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad3721-aa5d-4e61-9c5e-d17936be2cc6 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:42.730343 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad3721-aa5d-4e61-9c5e-d17936be2cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:42.730620 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad3721-aa5d-4e61-9c5e-d17936be2cc6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:42.739220 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdad1c7-319c-4233-bee9-88fc65a48c7e None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:42.744125 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ad3721-aa5d-4e61-9c5e-d17936be2cc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:53:42.751074 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-c7ad3721-aa5d-4e61-9c5e-d17936be2cc6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:53:42.751074 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:42.751074 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:42.751074 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:42.751074 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:42.751074 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:42.751074 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:42.751074 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:42.751074 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:42.751074 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:42.751074 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:42.751074 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:42.751074 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:53:42.751074 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:53:42.751074 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:53:42.751074 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:53:42.752014 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:53:42.752014 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:53:42.752014 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:53:42.752014 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:53:42.752014 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:42.752014 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:42.752014 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:42.752014 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:42.752014 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:42.752014 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:42.752014 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:42.752014 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:42.752014 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:42.752014 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:42.752014 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:42.752014 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:42.752871 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:42.752871 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:42.752871 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:42.752871 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:42.752871 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:53:42.752871 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:53:42.752871 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:53:42.752871 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:53:42.752871 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:53:42.752871 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:53:42.752871 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:53:42.752871 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:42.752871 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 391/785] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Jun 8 11:53:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:42.761468 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad3721-aa5d-4e61-9c5e-d17936be2cc6 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:42.791244 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f1a61a-9934-4319-87c8-0c10f8092eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:42.792780 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1a61a-9934-4319-87c8-0c10f8092eb9 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:42.794828 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1a61a-9934-4319-87c8-0c10f8092eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:42.795320 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1a61a-9934-4319-87c8-0c10f8092eb9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:42.796702 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:42.823530 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f1a61a-9934-4319-87c8-0c10f8092eb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:53:42.832542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-53f1a61a-9934-4319-87c8-0c10f8092eb9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 11:53:42.832542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:42.832542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:42.832542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:42.832542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:42.832542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:42.832542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:42.832542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:42.832542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:42.832542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:42.832542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:42.832542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:42.832542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:53:42.832542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:53:42.832542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:53:42.832542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:53:42.833551 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:53:42.833551 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:53:42.833551 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:53:42.833551 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:53:42.833551 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:42.833551 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:42.833551 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:42.833551 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:42.833551 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:42.833551 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:42.833551 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:42.833551 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:42.833551 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:42.833551 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:42.833551 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:42.833551 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:42.834387 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:42.834387 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:42.834387 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:42.834387 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:42.834387 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:53:42.834387 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:53:42.834387 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:53:42.834387 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:53:42.834387 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:53:42.834387 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:53:42.834387 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 11:53:42.834387 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:42.847440 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 395/786] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Jun 8 11:53:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:42.855042 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f1a61a-9934-4319-87c8-0c10f8092eb9 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:42.866074 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:42.961338 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad3721-aa5d-4e61-9c5e-d17936be2cc6 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:43.002254 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4573949a-dcc7-4eb1-aada-cf18f7829f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:43.003006 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573949a-dcc7-4eb1-aada-cf18f7829f9d None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:43.003399 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573949a-dcc7-4eb1-aada-cf18f7829f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:43.003781 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573949a-dcc7-4eb1-aada-cf18f7829f9d None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:43.005374 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4573949a-dcc7-4eb1-aada-cf18f7829f9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:43.005696 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4573949a-dcc7-4eb1-aada-cf18f7829f9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:43.007173 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f1a61a-9934-4319-87c8-0c10f8092eb9 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:43.007289 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4573949a-dcc7-4eb1-aada-cf18f7829f9d None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:43.017463 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 392/787] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:53:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:43.026966 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4573949a-dcc7-4eb1-aada-cf18f7829f9d None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:43.052765 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ff656-0043-4056-bc02-c16875f57e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:43.053716 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ff656-0043-4056-bc02-c16875f57e24 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:43.054003 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ff656-0043-4056-bc02-c16875f57e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:43.054277 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ff656-0043-4056-bc02-c16875f57e24 None admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:43.055773 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ff656-0043-4056-bc02-c16875f57e24 None admin] RBAC: Adding query filter params (name=service) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:43.056430 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ff656-0043-4056-bc02-c16875f57e24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:43.058469 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ff656-0043-4056-bc02-c16875f57e24 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:43.072267 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 396/788] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Jun 8 11:53:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:53:43.076756 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ff656-0043-4056-bc02-c16875f57e24 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:43.112547 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:43.148045 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4573949a-dcc7-4eb1-aada-cf18f7829f9d None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:43.157262 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:43.203038 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8c692-6017-4b3d-bb30-38c6804e0691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:43.203855 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8c692-6017-4b3d-bb30-38c6804e0691 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:43.204141 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8c692-6017-4b3d-bb30-38c6804e0691 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:43.204441 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8c692-6017-4b3d-bb30-38c6804e0691 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:43.206643 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ff656-0043-4056-bc02-c16875f57e24 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:43.231715 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db8c692-6017-4b3d-bb30-38c6804e0691 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:43.234887 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db8c692-6017-4b3d-bb30-38c6804e0691 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:43.264287 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-5db8c692-6017-4b3d-bb30-38c6804e0691 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:43.264287 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:43.264287 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:43.264287 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:43.264287 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:43.264287 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:43.264287 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:43.264287 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:43.264287 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:43.264287 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:43.264287 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:43.264287 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:43.264287 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:53:43.264287 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:53:43.264287 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:53:43.265223 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:53:43.265223 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:43.265223 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:43.265223 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:43.265223 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:43.265223 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:43.265223 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:43.265223 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:43.265223 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:43.265223 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:43.265223 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:43.265223 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:43.265223 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:43.265223 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:43.265223 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:43.265223 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:43.265223 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:43.266118 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:53:43.266118 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:53:43.266118 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:43.266118 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:43.275003 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 393/789] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:53:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:43.281027 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8c692-6017-4b3d-bb30-38c6804e0691 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:43.283551 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f03a9-0853-4035-aeb3-3b9b1966d6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:43.284619 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f03a9-0853-4035-aeb3-3b9b1966d6bc None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:43.285106 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f03a9-0853-4035-aeb3-3b9b1966d6bc None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:43.285633 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f03a9-0853-4035-aeb3-3b9b1966d6bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:43.309047 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f03a9-0853-4035-aeb3-3b9b1966d6bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:43.310761 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f03a9-0853-4035-aeb3-3b9b1966d6bc None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:43.330206 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-895f03a9-0853-4035-aeb3-3b9b1966d6bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:43.330206 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:43.330206 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:43.330206 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:43.330206 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:43.330206 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:43.330206 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:43.330206 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:43.330206 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:43.330206 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:43.330206 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:43.330206 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:43.330206 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:53:43.330206 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:53:43.330206 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:53:43.331188 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:53:43.331188 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:43.331188 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:43.331188 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:43.331188 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:43.331188 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:43.331188 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:43.331188 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:43.331188 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:43.331188 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:43.331188 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:43.331188 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:43.331188 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:43.331188 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:43.331188 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:43.331188 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:43.331188 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:43.336994 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:53:43.336994 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:53:43.336994 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:43.336994 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:43.336994 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 397/790] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:53:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:43.336994 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2054b5-d143-4764-8983-f7a9d30d69fc None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:43.336994 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2054b5-d143-4764-8983-f7a9d30d69fc None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:43.336994 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2054b5-d143-4764-8983-f7a9d30d69fc None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:43.339135 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 398/791] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:53:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:53:43.340634 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb53b61-375b-4287-bfb2-f6fcb469f33b None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:43.341109 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb53b61-375b-4287-bfb2-f6fcb469f33b None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:43.341598 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb53b61-375b-4287-bfb2-f6fcb469f33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:43.362931 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-bdb53b61-375b-4287-bfb2-f6fcb469f33b None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:53:43.364292 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-bdb53b61-375b-4287-bfb2-f6fcb469f33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:53:43.411027 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8c692-6017-4b3d-bb30-38c6804e0691 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:43.438017 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:43.440201 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 399/792] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:53:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 11:53:43.441017 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb53b61-375b-4287-bfb2-f6fcb469f33b None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:43.449239 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac37a8d4-6ce2-41ea-a478-5de5071580a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:43.450219 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37a8d4-6ce2-41ea-a478-5de5071580a9 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:43.450714 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37a8d4-6ce2-41ea-a478-5de5071580a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:43.451187 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37a8d4-6ce2-41ea-a478-5de5071580a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:43.452101 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac37a8d4-6ce2-41ea-a478-5de5071580a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:43.452631 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac37a8d4-6ce2-41ea-a478-5de5071580a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:43.454207 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac37a8d4-6ce2-41ea-a478-5de5071580a9 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:43.466927 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 394/793] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:53:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:43.473662 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac37a8d4-6ce2-41ea-a478-5de5071580a9 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:43.494584 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:43.548863 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb53b61-375b-4287-bfb2-f6fcb469f33b None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:43.581453 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac37a8d4-6ce2-41ea-a478-5de5071580a9 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:43.586177 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc765f6-a8b0-43ee-a0de-ad49f602e533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:43.587189 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc765f6-a8b0-43ee-a0de-ad49f602e533 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:43.587490 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc765f6-a8b0-43ee-a0de-ad49f602e533 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:43.587833 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc765f6-a8b0-43ee-a0de-ad49f602e533 None admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:43.588627 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc765f6-a8b0-43ee-a0de-ad49f602e533 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:43.588999 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc765f6-a8b0-43ee-a0de-ad49f602e533 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:43.590466 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc765f6-a8b0-43ee-a0de-ad49f602e533 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:43.609239 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 400/794] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:53:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:43.609239 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc765f6-a8b0-43ee-a0de-ad49f602e533 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:43.627198 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ddde1-cffd-46ae-b151-bb78878c549e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:43.628418 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ddde1-cffd-46ae-b151-bb78878c549e None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:43.628923 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ddde1-cffd-46ae-b151-bb78878c549e None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:43.629399 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ddde1-cffd-46ae-b151-bb78878c549e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:43.637964 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968ddde1-cffd-46ae-b151-bb78878c549e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:43.639662 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968ddde1-cffd-46ae-b151-bb78878c549e None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:43.654684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-968ddde1-cffd-46ae-b151-bb78878c549e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 08 11:53:43.654684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:43.654684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:43.654684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:43.654684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:43.654684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:43.654684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:43.654684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:43.654684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:43.654684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:43.654684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:43.654684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:43.654684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 11:53:43.654684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 11:53:43.654684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 11:53:43.654684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 11:53:43.655642 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:43.655642 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:43.655642 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 11:53:43.655642 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:53:43.655642 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 11:53:43.655642 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:53:43.655642 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:43.655642 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:43.655642 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:43.655642 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:43.655642 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:43.655642 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:43.655642 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:43.655642 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:43.655642 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:43.655642 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:43.655642 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:43.655642 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:43.656628 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:43.656628 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:43.656628 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 11:53:43.656628 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 11:53:43.656628 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 11:53:43.656628 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 11:53:43.656628 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 11:53:43.656628 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 11:53:43.656628 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 08 11:53:43.656628 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:43.659251 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 395/795] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Jun 8 11:53:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:43.660327 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ddde1-cffd-46ae-b151-bb78878c549e None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:43.709861 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:43.717933 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc765f6-a8b0-43ee-a0de-ad49f602e533 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:43.736591 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:43.756919 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98cb44-192c-4d80-bd4e-97ded0072a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:43.757967 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98cb44-192c-4d80-bd4e-97ded0072a45 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:43.758535 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98cb44-192c-4d80-bd4e-97ded0072a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:43.758994 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98cb44-192c-4d80-bd4e-97ded0072a45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:43.768278 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ddde1-cffd-46ae-b151-bb78878c549e None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:43.771827 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f98cb44-192c-4d80-bd4e-97ded0072a45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:53:43.781059 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-0f98cb44-192c-4d80-bd4e-97ded0072a45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:53:43.781059 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:43.781059 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:43.781059 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:43.781059 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:43.781059 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:43.781059 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:43.781059 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:43.781059 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:43.781059 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:43.781059 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:43.781059 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:43.781059 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:53:43.781059 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:53:43.781059 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:53:43.781059 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:53:43.782225 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:53:43.782225 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:53:43.782225 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:53:43.782225 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:53:43.782225 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:43.782225 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:43.782225 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:43.782225 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:43.782225 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:43.782225 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:43.782225 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:43.782225 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:43.782225 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:43.782225 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:43.782225 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:43.782225 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:43.783055 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:43.783055 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:43.783055 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:43.783055 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:43.783055 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:53:43.783055 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:53:43.783055 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:53:43.783055 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:53:43.783055 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:53:43.783055 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:53:43.783055 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:53:43.783055 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:43.785800 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 401/796] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Jun 8 11:53:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:43.786798 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98cb44-192c-4d80-bd4e-97ded0072a45 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:43.811619 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d907d-b946-4ec7-bac7-50c3d9c91d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:43.812391 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d907d-b946-4ec7-bac7-50c3d9c91d12 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:43.812881 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d907d-b946-4ec7-bac7-50c3d9c91d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:43.813165 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d907d-b946-4ec7-bac7-50c3d9c91d12 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:43.820675 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196d907d-b946-4ec7-bac7-50c3d9c91d12 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:43.822243 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196d907d-b946-4ec7-bac7-50c3d9c91d12 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:43.837936 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-196d907d-b946-4ec7-bac7-50c3d9c91d12 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 08 11:53:43.837936 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:43.837936 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:43.837936 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:43.837936 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:43.837936 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:43.837936 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:43.837936 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:43.837936 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:43.837936 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:43.837936 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:43.837936 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:43.837936 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 11:53:43.837936 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 11:53:43.837936 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 11:53:43.837936 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 11:53:43.838890 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:43.838890 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:43.838890 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 11:53:43.838890 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:53:43.838890 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 11:53:43.838890 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:53:43.838890 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:43.838890 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:43.838890 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:43.838890 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:43.838890 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:43.838890 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:43.838890 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:43.838890 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:43.838890 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:43.838890 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:43.838890 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:43.838890 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:43.839831 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:43.839831 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:43.839831 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 11:53:43.839831 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 11:53:43.839831 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 11:53:43.839831 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 11:53:43.839831 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 11:53:43.839831 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 11:53:43.839831 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 08 11:53:43.839831 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:43.843761 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 396/797] 10.222.0.39 () {56 vars in 1117 bytes} [Wed Jun 8 11:53:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:43.844689 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d907d-b946-4ec7-bac7-50c3d9c91d12 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:43.902865 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98cb44-192c-4d80-bd4e-97ded0072a45 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:43.940263 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de7981-0c85-4ef0-a2b4-3ec06f576131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:43.941386 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de7981-0c85-4ef0-a2b4-3ec06f576131 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:43.941906 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de7981-0c85-4ef0-a2b4-3ec06f576131 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:43.942390 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de7981-0c85-4ef0-a2b4-3ec06f576131 None admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:43.943430 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26de7981-0c85-4ef0-a2b4-3ec06f576131 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:43.944090 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26de7981-0c85-4ef0-a2b4-3ec06f576131 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:43.946081 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26de7981-0c85-4ef0-a2b4-3ec06f576131 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:43.953581 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d907d-b946-4ec7-bac7-50c3d9c91d12 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:43.961179 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:43.967104 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 402/798] 10.222.0.39 () {56 vars in 1135 bytes} [Wed Jun 8 11:53:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:43.968204 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de7981-0c85-4ef0-a2b4-3ec06f576131 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:43.991457 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fdebe2-8e2e-4953-9304-27bd88b0268f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:43.992195 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fdebe2-8e2e-4953-9304-27bd88b0268f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:43.992495 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fdebe2-8e2e-4953-9304-27bd88b0268f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:43.993315 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fdebe2-8e2e-4953-9304-27bd88b0268f None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:43.994357 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fdebe2-8e2e-4953-9304-27bd88b0268f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:43.994707 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fdebe2-8e2e-4953-9304-27bd88b0268f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:43.996189 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fdebe2-8e2e-4953-9304-27bd88b0268f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:43.998955 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:44.011035 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 397/799] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:53:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:44.012502 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fdebe2-8e2e-4953-9304-27bd88b0268f None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:44.075585 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de7981-0c85-4ef0-a2b4-3ec06f576131 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:44.114185 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc10dad-fc16-43a1-9716-7ff3aa328357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:44.115113 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc10dad-fc16-43a1-9716-7ff3aa328357 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:44.115502 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc10dad-fc16-43a1-9716-7ff3aa328357 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:44.115888 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc10dad-fc16-43a1-9716-7ff3aa328357 None admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:44.116929 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc10dad-fc16-43a1-9716-7ff3aa328357 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:44.117280 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc10dad-fc16-43a1-9716-7ff3aa328357 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:44.118772 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc10dad-fc16-43a1-9716-7ff3aa328357 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:44.126126 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fdebe2-8e2e-4953-9304-27bd88b0268f None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:44.142451 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 403/800] 10.222.0.39 () {56 vars in 1149 bytes} [Wed Jun 8 11:53:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:44.142451 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc10dad-fc16-43a1-9716-7ff3aa328357 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:44.181257 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c793d-0b41-4867-a8b8-fadd43bed577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:44.182430 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c793d-0b41-4867-a8b8-fadd43bed577 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:44.182919 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c793d-0b41-4867-a8b8-fadd43bed577 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:44.184042 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c793d-0b41-4867-a8b8-fadd43bed577 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:44.200058 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42c793d-0b41-4867-a8b8-fadd43bed577 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:44.202522 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42c793d-0b41-4867-a8b8-fadd43bed577 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:44.226081 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-b42c793d-0b41-4867-a8b8-fadd43bed577 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:44.226081 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:44.226081 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:44.226081 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:44.226081 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:44.226081 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:44.226081 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:44.226081 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:44.226081 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:44.226081 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:44.226081 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:44.226081 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:44.226081 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:53:44.226081 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:53:44.226081 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:53:44.227541 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:53:44.227541 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:44.227541 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:44.227541 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:44.227541 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:44.227541 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:44.227541 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:44.227541 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:44.227541 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:44.227541 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:44.227541 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:44.227541 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:44.227541 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:44.227541 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:44.227541 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:44.227541 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:44.227541 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:44.228930 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:53:44.228930 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:53:44.228930 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:44.228930 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:44.228930 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 398/801] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:53:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:44.229202 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c793d-0b41-4867-a8b8-fadd43bed577 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:44.247566 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:44.253628 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:44.272061 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc10dad-fc16-43a1-9716-7ff3aa328357 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:44.319544 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a231baf-efab-460b-970e-a2e51269fd34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:44.321301 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a231baf-efab-460b-970e-a2e51269fd34 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:44.322278 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a231baf-efab-460b-970e-a2e51269fd34 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:44.322771 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a231baf-efab-460b-970e-a2e51269fd34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:44.337882 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a231baf-efab-460b-970e-a2e51269fd34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:44.340372 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a231baf-efab-460b-970e-a2e51269fd34 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:44.344227 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c793d-0b41-4867-a8b8-fadd43bed577 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:44.365126 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-0a231baf-efab-460b-970e-a2e51269fd34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:44.365126 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:44.365126 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:44.365126 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:44.365126 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:44.365126 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:44.365126 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:44.365126 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:44.365126 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:44.365126 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:44.365126 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:44.365126 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:44.365126 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:53:44.365126 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:53:44.365126 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:53:44.366057 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:53:44.366057 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:44.366057 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:44.366057 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:44.366057 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:44.366057 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:44.366057 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:44.366057 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:44.366057 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:44.366057 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:44.366057 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:44.366057 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:44.366057 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:44.366057 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:44.366057 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:44.366057 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:44.366057 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:44.366929 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:53:44.366929 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:53:44.366929 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:44.366929 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:44.370209 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 404/802] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:53:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:44.371600 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a231baf-efab-460b-970e-a2e51269fd34 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:44.392772 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b0e02-adff-44cb-a259-f84a9bc1ee43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:44.394096 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b0e02-adff-44cb-a259-f84a9bc1ee43 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:44.394531 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b0e02-adff-44cb-a259-f84a9bc1ee43 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:44.395411 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b0e02-adff-44cb-a259-f84a9bc1ee43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:44.411559 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b0e02-adff-44cb-a259-f84a9bc1ee43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:44.414131 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b0e02-adff-44cb-a259-f84a9bc1ee43 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:44.442797 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-c50b0e02-adff-44cb-a259-f84a9bc1ee43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:44.442797 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:44.442797 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:44.442797 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:44.442797 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:44.442797 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:44.442797 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:44.442797 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:44.442797 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:44.442797 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:44.442797 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:44.442797 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:44.442797 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:53:44.442797 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:53:44.442797 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:53:44.443937 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:53:44.443937 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:44.443937 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:44.443937 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:44.443937 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:44.443937 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:44.443937 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:44.443937 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:44.443937 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:44.443937 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:44.443937 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:44.443937 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:44.443937 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:44.443937 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:44.443937 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:44.443937 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:44.443937 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:44.445055 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:53:44.445055 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:53:44.445055 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:44.445055 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:44.451352 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 399/803] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:53:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:44.451352 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b0e02-adff-44cb-a259-f84a9bc1ee43 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:44.518544 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a231baf-efab-460b-970e-a2e51269fd34 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:44.523731 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:44.558186 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b0e02-adff-44cb-a259-f84a9bc1ee43 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:44.565035 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2eb774-a6f8-48f6-99e7-5953d5c456e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:44.566286 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2eb774-a6f8-48f6-99e7-5953d5c456e4 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:44.566744 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2eb774-a6f8-48f6-99e7-5953d5c456e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:44.567163 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2eb774-a6f8-48f6-99e7-5953d5c456e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:44.568026 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2eb774-a6f8-48f6-99e7-5953d5c456e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:44.568817 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2eb774-a6f8-48f6-99e7-5953d5c456e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:44.571133 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2eb774-a6f8-48f6-99e7-5953d5c456e4 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:44.587060 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:44.603304 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 405/804] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:53:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:44.603304 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2eb774-a6f8-48f6-99e7-5953d5c456e4 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:44.619925 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca3e91f-2ffd-4f84-92c0-05b203ef4da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:44.621476 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3e91f-2ffd-4f84-92c0-05b203ef4da7 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:44.622242 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3e91f-2ffd-4f84-92c0-05b203ef4da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:44.622718 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3e91f-2ffd-4f84-92c0-05b203ef4da7 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:44.623924 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca3e91f-2ffd-4f84-92c0-05b203ef4da7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:44.624770 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca3e91f-2ffd-4f84-92c0-05b203ef4da7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:44.626397 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca3e91f-2ffd-4f84-92c0-05b203ef4da7 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:44.645352 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 400/805] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:53:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:44.646555 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca3e91f-2ffd-4f84-92c0-05b203ef4da7 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:44.709882 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2eb774-a6f8-48f6-99e7-5953d5c456e4 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:44.746256 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed45b5-db6b-4fbc-b172-66542581ca48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:44.746779 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed45b5-db6b-4fbc-b172-66542581ca48 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:44.747137 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed45b5-db6b-4fbc-b172-66542581ca48 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:44.747489 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed45b5-db6b-4fbc-b172-66542581ca48 None admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:44.748340 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fed45b5-db6b-4fbc-b172-66542581ca48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:44.748723 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fed45b5-db6b-4fbc-b172-66542581ca48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:44.750193 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fed45b5-db6b-4fbc-b172-66542581ca48 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:44.767411 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 406/806] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:53:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:44.768813 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed45b5-db6b-4fbc-b172-66542581ca48 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:44.785347 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca3e91f-2ffd-4f84-92c0-05b203ef4da7 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:44.819586 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:44.826976 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bbc043-0b89-4bf6-a7f4-f8264266cee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:44.827787 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbc043-0b89-4bf6-a7f4-f8264266cee7 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:44.828275 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbc043-0b89-4bf6-a7f4-f8264266cee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:44.828383 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbc043-0b89-4bf6-a7f4-f8264266cee7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:44.830480 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:44.836147 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bbc043-0b89-4bf6-a7f4-f8264266cee7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:44.838472 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bbc043-0b89-4bf6-a7f4-f8264266cee7 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:44.852980 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-c5bbc043-0b89-4bf6-a7f4-f8264266cee7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:53:44.852980 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:44.852980 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:44.852980 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:44.852980 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:44.852980 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:44.852980 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:44.852980 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:44.852980 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:44.852980 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:44.852980 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:44.852980 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:44.852980 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 11:53:44.852980 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 11:53:44.852980 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 11:53:44.853933 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 11:53:44.853933 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:44.853933 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:44.853933 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:44.853933 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:44.853933 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:44.853933 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:44.853933 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:44.853933 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:44.853933 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:44.853933 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:44.853933 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:44.853933 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:44.853933 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:44.853933 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:44.853933 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:44.853933 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:44.854858 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 11:53:44.854858 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 11:53:44.854858 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 11:53:44.854858 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 11:53:44.854858 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 11:53:44.854858 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 11:53:44.854858 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:53:44.854858 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:44.858815 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 401/807] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Jun 8 11:53:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:44.859648 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bbc043-0b89-4bf6-a7f4-f8264266cee7 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:44.882136 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed45b5-db6b-4fbc-b172-66542581ca48 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:44.932925 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc39546-7cc2-43d6-be96-7924dddc9a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:44.933867 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc39546-7cc2-43d6-be96-7924dddc9a94 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:44.934086 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc39546-7cc2-43d6-be96-7924dddc9a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:44.934294 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc39546-7cc2-43d6-be96-7924dddc9a94 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:44.942851 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc39546-7cc2-43d6-be96-7924dddc9a94 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:44.944374 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc39546-7cc2-43d6-be96-7924dddc9a94 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:44.961970 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-abc39546-7cc2-43d6-be96-7924dddc9a94 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 08 11:53:44.961970 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:44.961970 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:44.961970 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:44.961970 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:44.961970 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:44.961970 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:44.961970 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:44.961970 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:44.961970 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:44.961970 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:44.961970 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:44.961970 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 11:53:44.961970 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 11:53:44.961970 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 11:53:44.961970 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 11:53:44.963016 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:44.963016 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:44.963016 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 11:53:44.963016 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:53:44.963016 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 11:53:44.963016 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:53:44.963016 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:44.963016 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:44.963016 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:44.963016 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:44.963016 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:44.963016 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:44.963016 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:44.963016 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:44.963016 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:44.963016 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:44.963016 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:44.963016 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:44.963992 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:44.963992 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:44.963992 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 11:53:44.963992 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 11:53:44.963992 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 11:53:44.963992 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 11:53:44.963992 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 11:53:44.963992 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 11:53:44.963992 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 08 11:53:44.963992 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:44.963992 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 407/808] 10.222.0.39 () {56 vars in 1093 bytes} [Wed Jun 8 11:53:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:44.965339 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aadbca8-3a34-45a0-9ad2-fbc6921a765a None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:44.965339 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aadbca8-3a34-45a0-9ad2-fbc6921a765a None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:44.965339 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aadbca8-3a34-45a0-9ad2-fbc6921a765a None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:44.968360 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 408/809] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:53:44.968360 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aadbca8-3a34-45a0-9ad2-fbc6921a765a None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:44.982578 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bbc043-0b89-4bf6-a7f4-f8264266cee7 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:45.022705 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b7663f-74a1-4656-9311-7bd5e21a03a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:45.024921 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7663f-74a1-4656-9311-7bd5e21a03a2 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:45.026126 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7663f-74a1-4656-9311-7bd5e21a03a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:45.026590 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7663f-74a1-4656-9311-7bd5e21a03a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:45.036794 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b7663f-74a1-4656-9311-7bd5e21a03a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:45.038714 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b7663f-74a1-4656-9311-7bd5e21a03a2 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:45.059617 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-29b7663f-74a1-4656-9311-7bd5e21a03a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:53:45.059617 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:45.059617 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:45.059617 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:45.059617 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:45.059617 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:45.059617 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:45.059617 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:45.059617 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:45.059617 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:45.059617 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:45.059617 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:45.059617 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 11:53:45.059617 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 11:53:45.059617 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 11:53:45.060607 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 11:53:45.060607 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:45.060607 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:45.060607 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:45.060607 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:45.060607 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:45.060607 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:45.060607 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:45.060607 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:45.060607 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:45.060607 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:45.060607 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:45.060607 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:45.060607 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:45.060607 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:45.060607 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:45.060607 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:45.061513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 11:53:45.061513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 11:53:45.061513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 11:53:45.061513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 11:53:45.061513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 11:53:45.061513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 11:53:45.061513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:53:45.061513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:45.061513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 402/810] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Jun 8 11:53:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:45.062851 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b7663f-74a1-4656-9311-7bd5e21a03a2 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:45.079980 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aadbca8-3a34-45a0-9ad2-fbc6921a765a None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:45.099182 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:45.117072 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ff976-04d8-4f40-b82b-f47f52479c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:45.117678 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ff976-04d8-4f40-b82b-f47f52479c3b None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:45.117968 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ff976-04d8-4f40-b82b-f47f52479c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:45.118241 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ff976-04d8-4f40-b82b-f47f52479c3b None admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:45.119034 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ff976-04d8-4f40-b82b-f47f52479c3b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:45.119345 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ff976-04d8-4f40-b82b-f47f52479c3b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:45.120753 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:45.120866 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ff976-04d8-4f40-b82b-f47f52479c3b None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:45.138236 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 409/811] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Jun 8 11:53:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:45.138236 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8c380-02ce-4792-8e11-f169fb3fbcbb None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:45.138236 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8c380-02ce-4792-8e11-f169fb3fbcbb None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:45.138236 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8c380-02ce-4792-8e11-f169fb3fbcbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:45.154607 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-12d8c380-02ce-4792-8e11-f169fb3fbcbb None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:53:45.155769 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-12d8c380-02ce-4792-8e11-f169fb3fbcbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:53:45.176257 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b7663f-74a1-4656-9311-7bd5e21a03a2 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:45.213866 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d463c8ba-85dd-4efe-b8b4-b90027887362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:45.214552 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463c8ba-85dd-4efe-b8b4-b90027887362 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:45.214837 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463c8ba-85dd-4efe-b8b4-b90027887362 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:45.215111 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463c8ba-85dd-4efe-b8b4-b90027887362 None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:45.215982 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d463c8ba-85dd-4efe-b8b4-b90027887362 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:45.216322 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d463c8ba-85dd-4efe-b8b4-b90027887362 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:45.217770 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d463c8ba-85dd-4efe-b8b4-b90027887362 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:45.230402 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 410/812] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:53:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 11:53:45.231638 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d8c380-02ce-4792-8e11-f169fb3fbcbb None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:45.244901 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 403/813] 10.222.0.39 () {56 vars in 1133 bytes} [Wed Jun 8 11:53:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:45.245747 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d463c8ba-85dd-4efe-b8b4-b90027887362 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:45.337616 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d8c380-02ce-4792-8e11-f169fb3fbcbb None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:45.347284 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:45.354987 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d463c8ba-85dd-4efe-b8b4-b90027887362 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:45.365624 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:45.373348 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659fa60-802e-4336-befe-576057dbad59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:45.373962 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659fa60-802e-4336-befe-576057dbad59 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:45.374252 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659fa60-802e-4336-befe-576057dbad59 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:45.374531 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659fa60-802e-4336-befe-576057dbad59 None admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:45.375322 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2659fa60-802e-4336-befe-576057dbad59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:45.375638 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2659fa60-802e-4336-befe-576057dbad59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:45.377105 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2659fa60-802e-4336-befe-576057dbad59 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:45.388744 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 411/814] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Jun 8 11:53:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:45.389534 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659fa60-802e-4336-befe-576057dbad59 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:45.390222 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ef6b9-f1c0-4e12-a14f-66aa1b599660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:45.391281 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ef6b9-f1c0-4e12-a14f-66aa1b599660 None admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:45.391712 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ef6b9-f1c0-4e12-a14f-66aa1b599660 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:45.392138 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ef6b9-f1c0-4e12-a14f-66aa1b599660 None admin] PATH_INFO: `/v3/projects/6a7fee684e8b43e199c95aeeb92640d4/users/753bde6a72d64045abd3ad44b9b0de04/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:45.394340 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911ef6b9-f1c0-4e12-a14f-66aa1b599660 None admin] RBAC: Authorizing `identity:create_grant(project_id=6a7fee684e8b43e199c95aeeb92640d4, user_id=753bde6a72d64045abd3ad44b9b0de04, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:45.395770 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911ef6b9-f1c0-4e12-a14f-66aa1b599660 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:45.408714 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 404/815] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Jun 8 11:53:45 2022] PUT /identity/v3/projects/6a7fee684e8b43e199c95aeeb92640d4/users/753bde6a72d64045abd3ad44b9b0de04/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 11:53:45.409514 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ef6b9-f1c0-4e12-a14f-66aa1b599660 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:45.504414 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659fa60-802e-4336-befe-576057dbad59 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:45.528638 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ef6b9-f1c0-4e12-a14f-66aa1b599660 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:45.542376 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adfa046-bc79-4920-b693-cba9afc98162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:45.543052 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfa046-bc79-4920-b693-cba9afc98162 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:45.543346 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfa046-bc79-4920-b693-cba9afc98162 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:45.543623 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfa046-bc79-4920-b693-cba9afc98162 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:45.566011 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d1538d-a412-4d04-9b48-ea3d55763cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:45.566837 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d1538d-a412-4d04-9b48-ea3d55763cad None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:45.567121 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d1538d-a412-4d04-9b48-ea3d55763cad None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:45.567398 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d1538d-a412-4d04-9b48-ea3d55763cad None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:45.568048 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d1538d-a412-4d04-9b48-ea3d55763cad None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:45.569484 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d1538d-a412-4d04-9b48-ea3d55763cad None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:45.584539 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:45.587395 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-e5d1538d-a412-4d04-9b48-ea3d55763cad None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 08 11:53:45.587395 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:45.587395 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 11:53:45.587395 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 11:53:45.587395 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 11:53:45.587395 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 11:53:45.587395 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 11:53:45.587395 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 11:53:45.587395 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 08 11:53:45.587395 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:45.587395 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 11:53:45.587395 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:45.587395 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:45.587395 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:45.587395 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:45.587395 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:45.588709 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:45.588709 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:45.588709 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:45.588709 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:45.588709 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:45.588709 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:45.588709 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:45.588709 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 11:53:45.588709 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 11:53:45.588709 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 11:53:45.588709 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 11:53:45.588709 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:45.588709 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:45.588709 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:45.588709 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:45.588709 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:45.589546 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:45.589546 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:45.589546 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:45.589546 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:45.589546 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:45.589546 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:45.589546 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:45.589546 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:45.589546 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:45.589546 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:45.589546 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:45.589546 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 11:53:45.589546 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 11:53:45.589546 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 08 11:53:45.589546 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:45.592222 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 405/816] 10.222.0.39 () {56 vars in 1129 bytes} [Wed Jun 8 11:53:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:45.593668 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c89315-aae9-4925-82a6-3ca62ce09f77 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:45.593909 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c89315-aae9-4925-82a6-3ca62ce09f77 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:45.594186 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c89315-aae9-4925-82a6-3ca62ce09f77 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:45.595815 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 406/817] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:53:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:53:45.600288 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c89315-aae9-4925-82a6-3ca62ce09f77 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:45.631952 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adfa046-bc79-4920-b693-cba9afc98162 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:45.633994 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adfa046-bc79-4920-b693-cba9afc98162 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:45.645148 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:45.717423 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c89315-aae9-4925-82a6-3ca62ce09f77 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:45.739236 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 412/818] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:53:45 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 11:53:45.740074 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adfa046-bc79-4920-b693-cba9afc98162 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:45.757473 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13afcba9-450a-450b-b8bd-f21a247f433a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:45.758903 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13afcba9-450a-450b-b8bd-f21a247f433a None admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:45.759220 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13afcba9-450a-450b-b8bd-f21a247f433a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:45.759452 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13afcba9-450a-450b-b8bd-f21a247f433a None admin] PATH_INFO: `/v3/projects/6a7fee684e8b43e199c95aeeb92640d4/users/d52efc21c66d4300a8a979d92dbfeb47/roles/125b7374688b4b009d443f1b34947c49` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:45.774790 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13afcba9-450a-450b-b8bd-f21a247f433a None admin] RBAC: Authorizing `identity:create_grant(project_id=6a7fee684e8b43e199c95aeeb92640d4, user_id=d52efc21c66d4300a8a979d92dbfeb47, role_id=125b7374688b4b009d443f1b34947c49)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:45.776310 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13afcba9-450a-450b-b8bd-f21a247f433a None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:45.800283 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 407/819] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Jun 8 11:53:45 2022] PUT /identity/v3/projects/6a7fee684e8b43e199c95aeeb92640d4/users/d52efc21c66d4300a8a979d92dbfeb47/roles/125b7374688b4b009d443f1b34947c49 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 11:53:45.802188 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a2355-e403-47a6-9050-a683d4ccecc8 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:45.802485 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a2355-e403-47a6-9050-a683d4ccecc8 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:45.802775 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a2355-e403-47a6-9050-a683d4ccecc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:45.815118 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:45.829338 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-583a2355-e403-47a6-9050-a683d4ccecc8 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:53:45.830592 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-583a2355-e403-47a6-9050-a683d4ccecc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:53:45.860749 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adfa046-bc79-4920-b693-cba9afc98162 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:45.903828 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c45192-3745-4fa7-88b7-66e8da4ad0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:45.904906 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c45192-3745-4fa7-88b7-66e8da4ad0b9 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:45.905436 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c45192-3745-4fa7-88b7-66e8da4ad0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:45.906013 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c45192-3745-4fa7-88b7-66e8da4ad0b9 None admin] PATH_INFO: `/v3/services` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:45.906978 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c45192-3745-4fa7-88b7-66e8da4ad0b9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:45.907482 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c45192-3745-4fa7-88b7-66e8da4ad0b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:45.909205 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c45192-3745-4fa7-88b7-66e8da4ad0b9 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:45.915793 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 413/820] 10.222.0.39 () {56 vars in 1124 bytes} [Wed Jun 8 11:53:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:45.917087 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c45192-3745-4fa7-88b7-66e8da4ad0b9 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:45.926888 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 408/821] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:53:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 11:53:45.928115 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a2355-e403-47a6-9050-a683d4ccecc8 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:45.956245 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:46.040799 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c45192-3745-4fa7-88b7-66e8da4ad0b9 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:46.065636 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a2355-e403-47a6-9050-a683d4ccecc8 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:46.091753 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d460d3eb-f10f-41c6-9fad-0bb9b945beae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:46.093165 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460d3eb-f10f-41c6-9fad-0bb9b945beae None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:46.093760 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460d3eb-f10f-41c6-9fad-0bb9b945beae None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:46.094105 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460d3eb-f10f-41c6-9fad-0bb9b945beae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:46.104350 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e0024e-d4bd-4315-a916-f8499c947004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:46.105309 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0024e-d4bd-4315-a916-f8499c947004 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:46.105780 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0024e-d4bd-4315-a916-f8499c947004 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:46.106273 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0024e-d4bd-4315-a916-f8499c947004 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:46.107192 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e0024e-d4bd-4315-a916-f8499c947004 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:46.107724 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e0024e-d4bd-4315-a916-f8499c947004 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:46.107853 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d460d3eb-f10f-41c6-9fad-0bb9b945beae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:46.109369 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d460d3eb-f10f-41c6-9fad-0bb9b945beae None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:46.109691 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e0024e-d4bd-4315-a916-f8499c947004 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:46.115613 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 409/822] 10.222.0.39 () {56 vars in 1124 bytes} [Wed Jun 8 11:53:45 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:46.116806 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e0024e-d4bd-4315-a916-f8499c947004 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:46.132409 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-d460d3eb-f10f-41c6-9fad-0bb9b945beae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:46.132409 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:46.132409 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:46.132409 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:46.132409 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:46.132409 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:46.132409 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:46.132409 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:46.132409 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:46.132409 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:46.132409 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:46.132409 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:46.132409 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:53:46.132409 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:53:46.132409 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:53:46.133763 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:53:46.133763 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:46.133763 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:46.133763 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:46.133763 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:46.133763 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:46.133763 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:46.133763 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:46.133763 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:46.133763 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:46.133763 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:46.133763 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:46.133763 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:46.133763 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:46.133763 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:46.133763 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:46.133763 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:46.134855 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:53:46.134855 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:53:46.134855 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:46.134855 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:46.134855 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 414/823] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:53:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:46.134855 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:46.140281 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d460d3eb-f10f-41c6-9fad-0bb9b945beae None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:46.210458 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:46.241161 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e0024e-d4bd-4315-a916-f8499c947004 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:46.262233 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d460d3eb-f10f-41c6-9fad-0bb9b945beae None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:46.285760 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54600f92-b52a-4c1a-ba4f-158d98d6f69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:46.286566 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54600f92-b52a-4c1a-ba4f-158d98d6f69a None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:46.286863 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54600f92-b52a-4c1a-ba4f-158d98d6f69a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:46.287121 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54600f92-b52a-4c1a-ba4f-158d98d6f69a None admin] PATH_INFO: `/v3/services/network` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:46.287961 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54600f92-b52a-4c1a-ba4f-158d98d6f69a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:46.290251 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54600f92-b52a-4c1a-ba4f-158d98d6f69a None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:46.304296 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdfbe82-dfcd-4454-b338-d955e5d44e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:46.305336 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdfbe82-dfcd-4454-b338-d955e5d44e8e None admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:46.305837 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdfbe82-dfcd-4454-b338-d955e5d44e8e None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:46.306319 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-54600f92-b52a-4c1a-ba4f-158d98d6f69a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 08 11:53:46.306319 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:46.306319 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 11:53:46.306319 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 11:53:46.306319 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 11:53:46.306319 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 11:53:46.306319 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 11:53:46.306319 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 11:53:46.306319 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 08 11:53:46.306319 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:46.306319 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 11:53:46.306319 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:46.306319 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:46.306319 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:46.306319 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:46.306319 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:46.306319 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:46.307274 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:46.307274 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:46.307274 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:46.307274 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:46.307274 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:46.307274 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:46.307274 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 11:53:46.307274 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 11:53:46.307274 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 11:53:46.307274 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 11:53:46.307274 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:46.307274 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:46.307274 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:46.307274 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:46.307274 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:46.307274 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:46.308126 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:46.308126 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:46.308126 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:46.308126 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:46.308126 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:46.308126 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:46.308126 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:46.308126 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:46.308126 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:46.308126 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:46.308126 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 11:53:46.308126 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 11:53:46.308126 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 08 11:53:46.308126 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:46.309160 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdfbe82-dfcd-4454-b338-d955e5d44e8e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:46.310107 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdfbe82-dfcd-4454-b338-d955e5d44e8e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:46.311678 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdfbe82-dfcd-4454-b338-d955e5d44e8e None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:46.312521 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 410/824] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Jun 8 11:53:46 2022] GET /identity/v3/services/network => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:46.313367 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54600f92-b52a-4c1a-ba4f-158d98d6f69a None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:46.338329 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 415/825] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Jun 8 11:53:46 2022] POST /identity/v3/endpoints => generated 346 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 11:53:46.339888 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdfbe82-dfcd-4454-b338-d955e5d44e8e None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:46.394690 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:46.462422 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54600f92-b52a-4c1a-ba4f-158d98d6f69a None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:46.485752 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdfbe82-dfcd-4454-b338-d955e5d44e8e None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:46.550340 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1422d13-d3dc-4726-9af2-2fe3e50bfcf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:46.552758 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1422d13-d3dc-4726-9af2-2fe3e50bfcf6 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:46.553317 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1422d13-d3dc-4726-9af2-2fe3e50bfcf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:46.554715 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1422d13-d3dc-4726-9af2-2fe3e50bfcf6 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:46.557405 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1422d13-d3dc-4726-9af2-2fe3e50bfcf6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:46.557990 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1422d13-d3dc-4726-9af2-2fe3e50bfcf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:46.560267 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1422d13-d3dc-4726-9af2-2fe3e50bfcf6 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:46.577256 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a411db74-8878-401b-b0d6-5d953228be2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:46.578342 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411db74-8878-401b-b0d6-5d953228be2f None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:46.578802 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411db74-8878-401b-b0d6-5d953228be2f None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:46.579250 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411db74-8878-401b-b0d6-5d953228be2f None admin] PATH_INFO: `/v3/services` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:46.580155 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a411db74-8878-401b-b0d6-5d953228be2f None admin] RBAC: Adding query filter params (name=network) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:46.580680 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a411db74-8878-401b-b0d6-5d953228be2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:46.584800 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a411db74-8878-401b-b0d6-5d953228be2f None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:46.591022 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 411/826] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:53:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:46.600790 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 416/827] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Jun 8 11:53:46 2022] GET /identity/v3/services?name=network => generated 124 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:46.600881 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1422d13-d3dc-4726-9af2-2fe3e50bfcf6 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:46.603117 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:46.603410 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a411db74-8878-401b-b0d6-5d953228be2f None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:46.718715 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1422d13-d3dc-4726-9af2-2fe3e50bfcf6 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:46.740923 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:46.747246 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a411db74-8878-401b-b0d6-5d953228be2f None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:46.757716 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef8e10-f765-4a19-afab-e972df8a2b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:46.758731 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef8e10-f765-4a19-afab-e972df8a2b60 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:46.759009 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef8e10-f765-4a19-afab-e972df8a2b60 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:46.759305 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef8e10-f765-4a19-afab-e972df8a2b60 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:46.759997 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef8e10-f765-4a19-afab-e972df8a2b60 None admin] RBAC: Adding query filter params (type=network) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:46.761202 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef8e10-f765-4a19-afab-e972df8a2b60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:46.762392 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef8e10-f765-4a19-afab-e972df8a2b60 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:46.767924 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 412/828] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Jun 8 11:53:46 2022] GET /identity/v3/services?type=network => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:46.773309 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef8e10-f765-4a19-afab-e972df8a2b60 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:46.797764 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae35a30d-d878-4337-aa58-c69de8e2dbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:46.799410 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae35a30d-d878-4337-aa58-c69de8e2dbf9 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:46.799889 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae35a30d-d878-4337-aa58-c69de8e2dbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:46.800676 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae35a30d-d878-4337-aa58-c69de8e2dbf9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:46.811411 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae35a30d-d878-4337-aa58-c69de8e2dbf9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:46.813288 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae35a30d-d878-4337-aa58-c69de8e2dbf9 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:46.833699 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-ae35a30d-d878-4337-aa58-c69de8e2dbf9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:53:46.833699 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:46.833699 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:46.833699 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:46.833699 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:46.833699 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:46.833699 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:46.833699 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:46.833699 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:46.833699 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:46.833699 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:46.833699 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:46.833699 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 11:53:46.833699 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 11:53:46.833699 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 11:53:46.834632 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 11:53:46.834632 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:46.834632 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:46.834632 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:46.834632 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:46.834632 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:46.834632 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:46.834632 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:46.834632 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:46.834632 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:46.834632 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:46.834632 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:46.834632 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:46.834632 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:46.834632 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:46.834632 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:46.834632 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:46.835523 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 11:53:46.835523 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 11:53:46.835523 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 11:53:46.835523 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 11:53:46.835523 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 11:53:46.835523 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 11:53:46.835523 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:53:46.835523 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:46.837979 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 417/829] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Jun 8 11:53:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 11:53:46.845105 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae35a30d-d878-4337-aa58-c69de8e2dbf9 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:46.860704 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:46.906198 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef8e10-f765-4a19-afab-e972df8a2b60 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:46.953830 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12d08a-5f90-4249-8ca6-878af773ab62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:46.954754 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12d08a-5f90-4249-8ca6-878af773ab62 None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:46.955219 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12d08a-5f90-4249-8ca6-878af773ab62 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:46.955750 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12d08a-5f90-4249-8ca6-878af773ab62 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:46.956684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f12d08a-5f90-4249-8ca6-878af773ab62 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:46.958355 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f12d08a-5f90-4249-8ca6-878af773ab62 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:46.984327 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae35a30d-d878-4337-aa58-c69de8e2dbf9 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:47.001196 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 413/830] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Jun 8 11:53:46 2022] POST /identity/v3/endpoints => generated 327 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 11:53:47.035747 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b109b2e8-676c-4bb9-8c58-563f87b9369d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:47.036450 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109b2e8-676c-4bb9-8c58-563f87b9369d None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:47.036735 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109b2e8-676c-4bb9-8c58-563f87b9369d None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:47.037013 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109b2e8-676c-4bb9-8c58-563f87b9369d None admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:47.037800 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b109b2e8-676c-4bb9-8c58-563f87b9369d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:47.038111 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b109b2e8-676c-4bb9-8c58-563f87b9369d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:47.039817 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b109b2e8-676c-4bb9-8c58-563f87b9369d None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:47.056606 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 418/831] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Jun 8 11:53:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:47.058648 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12d08a-5f90-4249-8ca6-878af773ab62 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:47.203105 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12d08a-5f90-4249-8ca6-878af773ab62 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:47.236509 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:47.254050 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f12b649-0c0b-4593-ac5c-68510208c024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:47.255067 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12b649-0c0b-4593-ac5c-68510208c024 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:47.255575 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12b649-0c0b-4593-ac5c-68510208c024 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:47.256066 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12b649-0c0b-4593-ac5c-68510208c024 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:47.257187 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f12b649-0c0b-4593-ac5c-68510208c024 None admin] RBAC: Adding query filter params (role.id=028d4429a4554bbb88b3aec9f6a9d937, scope.project.id=6a7fee684e8b43e199c95aeeb92640d4, user.id=7ef7edb5e9ce49e6b098f48bf060b228) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:47.257696 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f12b649-0c0b-4593-ac5c-68510208c024 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:47.259917 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f12b649-0c0b-4593-ac5c-68510208c024 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:47.266929 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 414/832] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Jun 8 11:53:47 2022] GET /identity/v3/role_assignments?user.id=7ef7edb5e9ce49e6b098f48bf060b228&scope.project.id=6a7fee684e8b43e199c95aeeb92640d4&role.id=028d4429a4554bbb88b3aec9f6a9d937 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:47.799557 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf614153-08ed-456d-baae-27dbc53bc8f1 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:47.800249 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf614153-08ed-456d-baae-27dbc53bc8f1 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:47.800743 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf614153-08ed-456d-baae-27dbc53bc8f1 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:47.802527 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 419/833] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:53:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:53:47.808659 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728142c4-6c02-410d-9caf-86998f416c46 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:47.809170 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728142c4-6c02-410d-9caf-86998f416c46 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:47.809708 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728142c4-6c02-410d-9caf-86998f416c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:47.827818 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-728142c4-6c02-410d-9caf-86998f416c46 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:53:47.829335 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-728142c4-6c02-410d-9caf-86998f416c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:53:47.899934 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 415/834] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:53:47 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 11:53:47.924696 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf614153-08ed-456d-baae-27dbc53bc8f1 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:47.945178 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:48.038926 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf614153-08ed-456d-baae-27dbc53bc8f1 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:48.075436 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5244c-f49c-4640-9854-0d15a80fb191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:48.077216 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5244c-f49c-4640-9854-0d15a80fb191 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:48.077723 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5244c-f49c-4640-9854-0d15a80fb191 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:48.078268 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5244c-f49c-4640-9854-0d15a80fb191 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:48.092611 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af5244c-f49c-4640-9854-0d15a80fb191 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:53:48.101190 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-5af5244c-f49c-4640-9854-0d15a80fb191 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:53:48.101190 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:48.101190 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:48.101190 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:48.101190 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:48.101190 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:48.101190 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:48.101190 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:48.101190 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:48.101190 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:48.101190 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:48.101190 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:48.101190 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:53:48.101190 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:53:48.101190 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:53:48.101190 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:53:48.102469 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:53:48.102469 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:53:48.102469 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:53:48.102469 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:53:48.102469 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:48.102469 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:48.102469 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:48.102469 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:48.102469 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:48.102469 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:48.102469 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:48.102469 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:48.102469 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:48.102469 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:48.102469 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:48.102469 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:48.103390 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:48.103390 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:48.103390 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:48.103390 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:48.103390 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:53:48.103390 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:53:48.103390 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:53:48.103390 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:53:48.103390 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:53:48.103390 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:53:48.103390 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:53:48.103390 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:48.106434 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 420/835] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Jun 8 11:53:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:48.112752 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728142c4-6c02-410d-9caf-86998f416c46 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:48.215230 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728142c4-6c02-410d-9caf-86998f416c46 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:48.233295 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:48.251700 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a67d727-5461-4f6e-be6e-f68a423df3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:48.252504 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67d727-5461-4f6e-be6e-f68a423df3d9 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:48.252796 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67d727-5461-4f6e-be6e-f68a423df3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:48.253072 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67d727-5461-4f6e-be6e-f68a423df3d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:48.253886 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a67d727-5461-4f6e-be6e-f68a423df3d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:48.254194 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a67d727-5461-4f6e-be6e-f68a423df3d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:48.255619 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a67d727-5461-4f6e-be6e-f68a423df3d9 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:48.268490 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 416/836] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:53:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:48.269914 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5244c-f49c-4640-9854-0d15a80fb191 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:48.356618 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:48.375113 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5244c-f49c-4640-9854-0d15a80fb191 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:48.411126 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f09c2-f32d-401b-84e4-5e19013bc834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:48.411976 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f09c2-f32d-401b-84e4-5e19013bc834 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:48.412281 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f09c2-f32d-401b-84e4-5e19013bc834 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:48.412555 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f09c2-f32d-401b-84e4-5e19013bc834 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:48.422924 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f09c2-f32d-401b-84e4-5e19013bc834 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:48.424461 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f09c2-f32d-401b-84e4-5e19013bc834 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:48.442616 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-f98f09c2-f32d-401b-84e4-5e19013bc834 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:48.442616 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:48.442616 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:48.442616 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:48.442616 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:48.442616 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:48.442616 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:48.442616 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:48.442616 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:48.442616 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:48.442616 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:48.442616 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:48.442616 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:53:48.442616 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:53:48.442616 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:53:48.443595 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:53:48.443595 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:48.443595 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:48.443595 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:48.443595 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:48.443595 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:48.443595 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:48.443595 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:48.443595 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:48.443595 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:48.443595 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:48.443595 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:48.443595 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:48.443595 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:48.443595 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:48.443595 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:48.443595 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:48.444542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:53:48.444542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:53:48.444542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:48.444542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:48.444542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 421/837] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:53:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:48.449939 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f09c2-f32d-401b-84e4-5e19013bc834 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:48.450634 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1ce20-8570-468f-a432-91d97b393135 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:48.451157 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1ce20-8570-468f-a432-91d97b393135 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:48.451652 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1ce20-8570-468f-a432-91d97b393135 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:48.453539 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 417/838] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:53:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:53:48.458902 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba371c1-85c8-4f1e-ba38-0ead798cd84f None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:48.459460 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba371c1-85c8-4f1e-ba38-0ead798cd84f None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:48.459954 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba371c1-85c8-4f1e-ba38-0ead798cd84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:48.479470 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-3ba371c1-85c8-4f1e-ba38-0ead798cd84f None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:53:48.481166 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-3ba371c1-85c8-4f1e-ba38-0ead798cd84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:53:48.568432 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 418/839] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:53:48 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 11:53:48.577589 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f09c2-f32d-401b-84e4-5e19013bc834 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:48.589538 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba371c1-85c8-4f1e-ba38-0ead798cd84f None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:48.611283 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:48.622414 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c4cb81-7d62-4896-8a88-722aa8558285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:48.623093 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4cb81-7d62-4896-8a88-722aa8558285 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:48.623376 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4cb81-7d62-4896-8a88-722aa8558285 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:48.623650 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4cb81-7d62-4896-8a88-722aa8558285 None admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:48.624580 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c4cb81-7d62-4896-8a88-722aa8558285 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:48.624898 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c4cb81-7d62-4896-8a88-722aa8558285 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:48.626816 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c4cb81-7d62-4896-8a88-722aa8558285 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:48.646005 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 422/840] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:53:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:48.647094 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c4cb81-7d62-4896-8a88-722aa8558285 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:48.706911 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba371c1-85c8-4f1e-ba38-0ead798cd84f None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:48.740650 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:48.748088 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6229ac-11ad-44ef-9cfe-04ae23706be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:48.749384 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6229ac-11ad-44ef-9cfe-04ae23706be7 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:48.749896 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6229ac-11ad-44ef-9cfe-04ae23706be7 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:48.750458 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6229ac-11ad-44ef-9cfe-04ae23706be7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:48.754342 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c4cb81-7d62-4896-8a88-722aa8558285 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:48.764818 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6229ac-11ad-44ef-9cfe-04ae23706be7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:53:48.773900 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-3d6229ac-11ad-44ef-9cfe-04ae23706be7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 11:53:48.773900 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:48.773900 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:48.773900 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:48.773900 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:48.773900 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:48.773900 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:48.773900 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:48.773900 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:48.773900 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:48.773900 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:48.773900 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:48.773900 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:53:48.773900 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:53:48.773900 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:53:48.773900 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:53:48.775775 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:53:48.775775 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:53:48.775775 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:53:48.775775 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:53:48.775775 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:48.775775 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:48.775775 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:48.775775 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:48.775775 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:48.775775 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:48.775775 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:48.775775 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:48.775775 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:48.775775 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:48.775775 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:48.775775 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:48.777287 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:48.777287 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:48.777287 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:48.777287 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:48.777287 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:53:48.777287 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:53:48.777287 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:53:48.777287 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:53:48.777287 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:53:48.777287 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:53:48.777287 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 11:53:48.777287 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:48.784578 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 419/841] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Jun 8 11:53:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 11:53:48.786824 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6229ac-11ad-44ef-9cfe-04ae23706be7 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:48.792096 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2bdd0a-4884-4129-8525-01a9dd1440ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:48.792996 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2bdd0a-4884-4129-8525-01a9dd1440ce None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:48.793344 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2bdd0a-4884-4129-8525-01a9dd1440ce None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:48.793683 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2bdd0a-4884-4129-8525-01a9dd1440ce None admin] PATH_INFO: `/v3/users/swift` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:48.801083 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2bdd0a-4884-4129-8525-01a9dd1440ce None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:48.802610 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2bdd0a-4884-4129-8525-01a9dd1440ce None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:48.817989 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-fa2bdd0a-4884-4129-8525-01a9dd1440ce None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 08 11:53:48.817989 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:48.817989 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:48.817989 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:48.817989 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:48.817989 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:48.817989 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:48.817989 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:48.817989 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:48.817989 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:48.817989 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:48.817989 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:48.817989 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 11:53:48.817989 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 11:53:48.817989 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 11:53:48.817989 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 11:53:48.819002 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:48.819002 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:48.819002 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 11:53:48.819002 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:53:48.819002 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 11:53:48.819002 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:53:48.819002 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:48.819002 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:48.819002 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:48.819002 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:48.819002 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:48.819002 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:48.819002 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:48.819002 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:48.819002 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:48.819002 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:48.819002 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:48.819002 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:48.819956 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:48.819956 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:48.819956 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 11:53:48.819956 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 11:53:48.819956 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 11:53:48.819956 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 11:53:48.819956 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 11:53:48.819956 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 11:53:48.819956 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 08 11:53:48.819956 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:48.824085 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 423/842] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Jun 8 11:53:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:48.824953 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2bdd0a-4884-4129-8525-01a9dd1440ce None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:48.875292 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:48.903008 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6229ac-11ad-44ef-9cfe-04ae23706be7 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:48.926359 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2bdd0a-4884-4129-8525-01a9dd1440ce None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:48.941826 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd86b6f-4f75-4f0d-a887-de2e9431c88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:48.942808 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd86b6f-4f75-4f0d-a887-de2e9431c88c None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:48.943411 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd86b6f-4f75-4f0d-a887-de2e9431c88c None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:48.943992 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd86b6f-4f75-4f0d-a887-de2e9431c88c None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:48.945000 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd86b6f-4f75-4f0d-a887-de2e9431c88c None admin] RBAC: Adding query filter params (name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:48.945700 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd86b6f-4f75-4f0d-a887-de2e9431c88c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:48.947645 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd86b6f-4f75-4f0d-a887-de2e9431c88c None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:48.962638 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 420/843] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Jun 8 11:53:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:53:48.963475 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd86b6f-4f75-4f0d-a887-de2e9431c88c None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:48.967660 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec9359-dbd5-42be-8eac-b2759fe44a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:48.968924 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec9359-dbd5-42be-8eac-b2759fe44a51 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:48.968924 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec9359-dbd5-42be-8eac-b2759fe44a51 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:48.968924 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec9359-dbd5-42be-8eac-b2759fe44a51 None admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:48.969731 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec9359-dbd5-42be-8eac-b2759fe44a51 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:48.970038 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec9359-dbd5-42be-8eac-b2759fe44a51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:48.971456 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec9359-dbd5-42be-8eac-b2759fe44a51 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:48.995210 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 424/844] 10.222.0.39 () {56 vars in 1135 bytes} [Wed Jun 8 11:53:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:53:48.996236 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec9359-dbd5-42be-8eac-b2759fe44a51 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:49.001830 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:49.081642 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd86b6f-4f75-4f0d-a887-de2e9431c88c None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:49.099122 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec9359-dbd5-42be-8eac-b2759fe44a51 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:49.107655 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:49.121380 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3cfb0-23b7-4cf7-9998-d746fd3325de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:49.122182 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3cfb0-23b7-4cf7-9998-d746fd3325de None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:49.122463 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3cfb0-23b7-4cf7-9998-d746fd3325de None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:49.122737 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3cfb0-23b7-4cf7-9998-d746fd3325de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:49.133958 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3cfb0-23b7-4cf7-9998-d746fd3325de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:49.135420 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3cfb0-23b7-4cf7-9998-d746fd3325de None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:49.141444 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb159b-2c20-471a-a2d7-844865b65e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:49.142506 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb159b-2c20-471a-a2d7-844865b65e11 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:49.142795 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb159b-2c20-471a-a2d7-844865b65e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:49.143075 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb159b-2c20-471a-a2d7-844865b65e11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:49.152906 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-d0b3cfb0-23b7-4cf7-9998-d746fd3325de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:49.152906 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:49.152906 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:49.152906 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:49.152906 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:49.152906 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:49.152906 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:49.152906 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:49.152906 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:49.152906 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:49.152906 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:49.152906 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:49.152906 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:53:49.152906 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:53:49.152906 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:53:49.153831 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:53:49.153831 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:49.153831 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:49.153831 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:49.153831 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:49.153831 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:49.153831 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:49.153831 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:49.153831 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:49.153831 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:49.153831 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:49.153831 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:49.153831 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:49.153831 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:49.153831 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:49.153831 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:49.153831 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:49.154720 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:53:49.154720 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:53:49.154720 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:49.154720 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:49.158776 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 421/845] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:53:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:49.159887 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2a330-1009-47be-b91d-8c071ca00496 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:49.160198 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2a330-1009-47be-b91d-8c071ca00496 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:49.160466 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2a330-1009-47be-b91d-8c071ca00496 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:49.161985 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 422/846] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:53:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:53:49.162438 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2a330-1009-47be-b91d-8c071ca00496 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:49.220286 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb159b-2c20-471a-a2d7-844865b65e11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:49.221746 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb159b-2c20-471a-a2d7-844865b65e11 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:49.252557 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:49.276694 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2a330-1009-47be-b91d-8c071ca00496 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:49.311759 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f4b34-141a-4c65-ab95-a8791a7285ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:49.312455 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f4b34-141a-4c65-ab95-a8791a7285ec None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:49.312791 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f4b34-141a-4c65-ab95-a8791a7285ec None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:49.313069 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f4b34-141a-4c65-ab95-a8791a7285ec None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:49.313788 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2f4b34-141a-4c65-ab95-a8791a7285ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:49.314093 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2f4b34-141a-4c65-ab95-a8791a7285ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:49.315458 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2f4b34-141a-4c65-ab95-a8791a7285ec None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:49.331909 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 425/847] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:53:48 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 11:53:49.331909 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944168e8-5bb7-4654-b961-0edd24e5c1b3 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:49.331909 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944168e8-5bb7-4654-b961-0edd24e5c1b3 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:49.331909 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944168e8-5bb7-4654-b961-0edd24e5c1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:49.333018 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 423/848] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:53:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:49.333611 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f4b34-141a-4c65-ab95-a8791a7285ec None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:49.342539 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:49.350228 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-944168e8-5bb7-4654-b961-0edd24e5c1b3 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:53:49.352332 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-944168e8-5bb7-4654-b961-0edd24e5c1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:53:49.435028 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 426/849] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:53:49 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 11:53:49.444374 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944168e8-5bb7-4654-b961-0edd24e5c1b3 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:49.455957 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f4b34-141a-4c65-ab95-a8791a7285ec None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:49.497682 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe0d8da-1165-4515-bbc7-14574050548e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:49.498638 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0d8da-1165-4515-bbc7-14574050548e None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:49.498933 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0d8da-1165-4515-bbc7-14574050548e None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:49.499207 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0d8da-1165-4515-bbc7-14574050548e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:49.512382 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe0d8da-1165-4515-bbc7-14574050548e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:49.513868 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe0d8da-1165-4515-bbc7-14574050548e None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:49.515657 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:49.532299 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-bbe0d8da-1165-4515-bbc7-14574050548e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:49.532299 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:49.532299 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:49.532299 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:49.532299 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:49.532299 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:49.532299 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:49.532299 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:49.532299 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:49.532299 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:49.532299 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:49.532299 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:49.532299 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:53:49.532299 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:53:49.532299 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:53:49.533242 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:53:49.533242 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:49.533242 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:49.533242 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:49.533242 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:49.533242 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:49.533242 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:49.533242 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:49.533242 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:49.533242 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:49.533242 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:49.533242 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:49.533242 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:49.533242 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:49.533242 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:49.533242 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:49.533242 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:49.534120 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:53:49.534120 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:53:49.534120 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:49.534120 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:49.534120 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 424/850] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:53:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:49.534947 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe0d8da-1165-4515-bbc7-14574050548e None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:49.561575 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944168e8-5bb7-4654-b961-0edd24e5c1b3 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:49.603336 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e455bf4-9926-4631-a8dc-d1bbb57db2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:49.604210 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e455bf4-9926-4631-a8dc-d1bbb57db2d3 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:49.604502 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e455bf4-9926-4631-a8dc-d1bbb57db2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:49.604778 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e455bf4-9926-4631-a8dc-d1bbb57db2d3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:49.607746 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:49.613166 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e455bf4-9926-4631-a8dc-d1bbb57db2d3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:49.615832 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e455bf4-9926-4631-a8dc-d1bbb57db2d3 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:49.635085 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-8e455bf4-9926-4631-a8dc-d1bbb57db2d3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 08 11:53:49.635085 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:49.635085 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:49.635085 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:49.635085 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:49.635085 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:49.635085 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:49.635085 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:49.635085 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:49.635085 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:49.635085 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:49.635085 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:49.635085 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 11:53:49.635085 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 11:53:49.635085 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 11:53:49.635085 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 11:53:49.636157 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:49.636157 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:49.636157 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 11:53:49.636157 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:53:49.636157 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 11:53:49.636157 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:53:49.636157 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:49.636157 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:49.636157 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:49.636157 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:49.636157 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:49.636157 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:49.636157 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:49.636157 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:49.636157 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:49.636157 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:49.636157 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:49.636157 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:49.638087 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:49.638087 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:49.638087 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 11:53:49.638087 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 11:53:49.638087 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 11:53:49.638087 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 11:53:49.638087 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 11:53:49.638087 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 11:53:49.638087 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 08 11:53:49.638087 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:49.640318 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 427/851] 10.222.0.39 () {56 vars in 1117 bytes} [Wed Jun 8 11:53:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:49.641949 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e455bf4-9926-4631-a8dc-d1bbb57db2d3 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:49.652298 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe0d8da-1165-4515-bbc7-14574050548e None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:49.689452 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ee1d2-836b-4f0c-a4c7-26c317ab124c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:49.690253 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ee1d2-836b-4f0c-a4c7-26c317ab124c None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:49.690535 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ee1d2-836b-4f0c-a4c7-26c317ab124c None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:49.690815 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ee1d2-836b-4f0c-a4c7-26c317ab124c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:49.691462 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ee1d2-836b-4f0c-a4c7-26c317ab124c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:49.692878 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ee1d2-836b-4f0c-a4c7-26c317ab124c None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:49.705015 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-2c5ee1d2-836b-4f0c-a4c7-26c317ab124c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 08 11:53:49.705015 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:49.705015 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 11:53:49.705015 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 11:53:49.705015 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 11:53:49.705015 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 11:53:49.705015 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 11:53:49.705015 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 11:53:49.705015 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 08 11:53:49.705015 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:49.705015 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 11:53:49.705015 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:49.705015 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:49.705015 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:49.705015 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:49.705015 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:49.705015 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:49.706091 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:49.706091 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:49.706091 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:49.706091 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:49.706091 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:49.706091 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:49.706091 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 11:53:49.706091 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 11:53:49.706091 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 11:53:49.706091 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 11:53:49.706091 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:49.706091 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:49.706091 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:49.706091 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:49.706091 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:49.706091 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:49.706969 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:49.706969 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:49.706969 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:49.706969 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:49.706969 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:49.706969 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:49.706969 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:49.706969 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:49.706969 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:49.706969 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:49.706969 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 11:53:49.706969 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 11:53:49.706969 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 08 11:53:49.706969 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:49.706969 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 425/852] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Jun 8 11:53:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:49.708495 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ee1d2-836b-4f0c-a4c7-26c317ab124c None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:49.764977 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e455bf4-9926-4631-a8dc-d1bbb57db2d3 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:49.770446 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:49.798758 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8360de-a835-4f68-a9d0-f9f5f023fe85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:49.799427 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8360de-a835-4f68-a9d0-f9f5f023fe85 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:49.799715 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8360de-a835-4f68-a9d0-f9f5f023fe85 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:49.800000 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8360de-a835-4f68-a9d0-f9f5f023fe85 None admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:49.800769 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8360de-a835-4f68-a9d0-f9f5f023fe85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:49.801080 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8360de-a835-4f68-a9d0-f9f5f023fe85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:49.802454 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8360de-a835-4f68-a9d0-f9f5f023fe85 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:49.814142 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 428/853] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:53:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:49.814934 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8360de-a835-4f68-a9d0-f9f5f023fe85 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:49.816216 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ee1d2-836b-4f0c-a4c7-26c317ab124c None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:49.850842 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9757692-facf-4954-a69c-88a8415e0338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:49.851504 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9757692-facf-4954-a69c-88a8415e0338 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:49.852921 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9757692-facf-4954-a69c-88a8415e0338 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:49.853201 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9757692-facf-4954-a69c-88a8415e0338 None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:49.854028 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9757692-facf-4954-a69c-88a8415e0338 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:49.854335 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9757692-facf-4954-a69c-88a8415e0338 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:49.855771 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9757692-facf-4954-a69c-88a8415e0338 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:49.871341 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:49.877593 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 426/854] 10.222.0.39 () {56 vars in 1149 bytes} [Wed Jun 8 11:53:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:49.877593 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e3b38-d11b-499e-84bf-2b0f1cd790ef None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:49.877593 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e3b38-d11b-499e-84bf-2b0f1cd790ef None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:49.877593 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e3b38-d11b-499e-84bf-2b0f1cd790ef None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:49.877593 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 427/855] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:53:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:53:49.877593 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e3b38-d11b-499e-84bf-2b0f1cd790ef None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:49.918879 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8360de-a835-4f68-a9d0-f9f5f023fe85 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:49.951225 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547823c3-0627-4919-9437-4d58fb9a1c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:49.951887 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547823c3-0627-4919-9437-4d58fb9a1c48 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:49.952195 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547823c3-0627-4919-9437-4d58fb9a1c48 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:49.952479 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547823c3-0627-4919-9437-4d58fb9a1c48 None admin] PATH_INFO: `/v3/services` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:49.953189 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547823c3-0627-4919-9437-4d58fb9a1c48 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:49.953500 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547823c3-0627-4919-9437-4d58fb9a1c48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:49.954874 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547823c3-0627-4919-9437-4d58fb9a1c48 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:49.959492 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 429/856] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Jun 8 11:53:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:49.960308 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547823c3-0627-4919-9437-4d58fb9a1c48 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:49.981102 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e3b38-d11b-499e-84bf-2b0f1cd790ef None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:49.997831 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:50.016287 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89d22f-6c39-43dc-97dc-19da2f1285a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:50.017022 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89d22f-6c39-43dc-97dc-19da2f1285a3 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:50.017306 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89d22f-6c39-43dc-97dc-19da2f1285a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:50.017578 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89d22f-6c39-43dc-97dc-19da2f1285a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:50.024806 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad89d22f-6c39-43dc-97dc-19da2f1285a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:50.026242 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad89d22f-6c39-43dc-97dc-19da2f1285a3 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:50.040306 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-ad89d22f-6c39-43dc-97dc-19da2f1285a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:53:50.040306 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:50.040306 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:50.040306 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:50.040306 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:50.040306 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:50.040306 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:50.040306 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:50.040306 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:50.040306 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:50.040306 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:50.040306 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:50.040306 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 11:53:50.040306 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 11:53:50.040306 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 11:53:50.041185 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 11:53:50.041185 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:50.041185 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:50.041185 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:50.041185 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:50.041185 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:50.041185 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:50.041185 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:50.041185 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:50.041185 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:50.041185 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:50.041185 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:50.041185 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:50.041185 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:50.041185 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:50.041185 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:50.041185 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:50.042063 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 11:53:50.042063 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 11:53:50.042063 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 11:53:50.042063 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 11:53:50.042063 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 11:53:50.042063 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 11:53:50.042063 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:53:50.042063 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:50.042063 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 428/857] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Jun 8 11:53:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:50.042999 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380542eb-ad0b-4f3b-95a6-72fb18665738 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:50.043247 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380542eb-ad0b-4f3b-95a6-72fb18665738 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:50.043527 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380542eb-ad0b-4f3b-95a6-72fb18665738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:50.060336 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-380542eb-ad0b-4f3b-95a6-72fb18665738 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:53:50.061534 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-380542eb-ad0b-4f3b-95a6-72fb18665738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:53:50.062546 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547823c3-0627-4919-9437-4d58fb9a1c48 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:50.082423 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:50.097288 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd67b176-0157-4c66-a873-9fb0d765493e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:50.098197 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67b176-0157-4c66-a873-9fb0d765493e None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:50.098482 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67b176-0157-4c66-a873-9fb0d765493e None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:50.098756 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67b176-0157-4c66-a873-9fb0d765493e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:50.128781 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 429/858] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:53:50 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 11:53:50.129613 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380542eb-ad0b-4f3b-95a6-72fb18665738 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:50.168894 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd67b176-0157-4c66-a873-9fb0d765493e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:50.170362 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd67b176-0157-4c66-a873-9fb0d765493e None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:50.235561 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380542eb-ad0b-4f3b-95a6-72fb18665738 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:50.242788 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:50.269111 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 430/859] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:53:49 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 11:53:50.269870 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd67b176-0157-4c66-a873-9fb0d765493e None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:50.270867 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7542369-c036-42dc-af3b-2d614fed489d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:50.271544 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7542369-c036-42dc-af3b-2d614fed489d None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:50.271832 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7542369-c036-42dc-af3b-2d614fed489d None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:50.272112 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7542369-c036-42dc-af3b-2d614fed489d None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:50.272856 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7542369-c036-42dc-af3b-2d614fed489d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:50.273164 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7542369-c036-42dc-af3b-2d614fed489d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:50.274675 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7542369-c036-42dc-af3b-2d614fed489d None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:50.279925 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 430/860] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Jun 8 11:53:50 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:50.280754 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7542369-c036-42dc-af3b-2d614fed489d None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:50.303103 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:50.397510 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd67b176-0157-4c66-a873-9fb0d765493e None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:50.399389 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7542369-c036-42dc-af3b-2d614fed489d None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:50.437115 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775e5e4d-281f-470f-9134-0799e52b314d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:50.437793 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e5e4d-281f-470f-9134-0799e52b314d None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:50.438083 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e5e4d-281f-470f-9134-0799e52b314d None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:50.438365 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e5e4d-281f-470f-9134-0799e52b314d None admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:50.439161 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775e5e4d-281f-470f-9134-0799e52b314d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:50.439485 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775e5e4d-281f-470f-9134-0799e52b314d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:50.440072 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac33432-51cd-4d8d-9234-f7dfbeafccec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:50.440933 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac33432-51cd-4d8d-9234-f7dfbeafccec None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:50.441031 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775e5e4d-281f-470f-9134-0799e52b314d None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:50.441211 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac33432-51cd-4d8d-9234-f7dfbeafccec None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:50.441489 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac33432-51cd-4d8d-9234-f7dfbeafccec None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:50.442146 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac33432-51cd-4d8d-9234-f7dfbeafccec None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:50.443557 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac33432-51cd-4d8d-9234-f7dfbeafccec None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:50.459226 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 431/861] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Jun 8 11:53:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:50.459226 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775e5e4d-281f-470f-9134-0799e52b314d None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:50.459534 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-4ac33432-51cd-4d8d-9234-f7dfbeafccec None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 08 11:53:50.459534 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:50.459534 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 11:53:50.459534 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 11:53:50.459534 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 11:53:50.459534 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 11:53:50.459534 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 11:53:50.459534 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 11:53:50.459534 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 08 11:53:50.459534 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:50.459534 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 11:53:50.459534 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:50.459534 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:50.459534 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:50.459534 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:50.459534 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:50.460670 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:50.460670 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:50.460670 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:50.460670 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:50.460670 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:50.460670 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:50.460670 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:50.460670 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 11:53:50.460670 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 11:53:50.460670 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 11:53:50.460670 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 11:53:50.460670 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:50.460670 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:50.460670 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:50.460670 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:50.460670 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:50.462014 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:50.462014 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:50.462014 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:50.462014 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:50.462014 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:50.462014 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:50.462014 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:50.462014 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:50.462014 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:50.462014 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:50.462014 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:50.462014 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 11:53:50.462014 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 11:53:50.462014 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 08 11:53:50.462014 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:50.462014 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 431/862] 10.222.0.39 () {56 vars in 1132 bytes} [Wed Jun 8 11:53:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:50.463628 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac33432-51cd-4d8d-9234-f7dfbeafccec None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:50.503022 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:50.568862 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:50.582342 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac33432-51cd-4d8d-9234-f7dfbeafccec None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:50.591475 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775e5e4d-281f-470f-9134-0799e52b314d None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:50.624887 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872bb85d-625e-4d31-82ef-9e7697571b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:50.625316 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c455a54-d1ce-4acf-a181-4a926f61b477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:50.625554 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872bb85d-625e-4d31-82ef-9e7697571b83 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:50.625839 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872bb85d-625e-4d31-82ef-9e7697571b83 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:50.626112 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872bb85d-625e-4d31-82ef-9e7697571b83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:50.626217 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c455a54-d1ce-4acf-a181-4a926f61b477 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:50.626399 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c455a54-d1ce-4acf-a181-4a926f61b477 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:50.626677 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c455a54-d1ce-4acf-a181-4a926f61b477 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:50.627076 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872bb85d-625e-4d31-82ef-9e7697571b83 None admin] RBAC: Adding query filter params (role.id=028d4429a4554bbb88b3aec9f6a9d937, scope.project.id=6a7fee684e8b43e199c95aeeb92640d4, user.id=753bde6a72d64045abd3ad44b9b0de04) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:50.627384 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872bb85d-625e-4d31-82ef-9e7697571b83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:50.629031 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872bb85d-625e-4d31-82ef-9e7697571b83 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:50.635708 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 432/863] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Jun 8 11:53:50 2022] GET /identity/v3/role_assignments?user.id=753bde6a72d64045abd3ad44b9b0de04&scope.project.id=6a7fee684e8b43e199c95aeeb92640d4&role.id=028d4429a4554bbb88b3aec9f6a9d937 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:50.637740 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872bb85d-625e-4d31-82ef-9e7697571b83 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:50.638726 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c455a54-d1ce-4acf-a181-4a926f61b477 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:50.640369 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c455a54-d1ce-4acf-a181-4a926f61b477 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:50.660685 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-8c455a54-d1ce-4acf-a181-4a926f61b477 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:50.660685 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:50.660685 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:50.660685 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:50.660685 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:50.660685 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:50.660685 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:50.660685 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:50.660685 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:50.660685 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:50.660685 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:50.660685 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:50.660685 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:53:50.660685 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:53:50.660685 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:53:50.661676 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:53:50.661676 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:50.661676 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:50.661676 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:50.661676 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:50.661676 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:50.661676 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:50.661676 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:50.661676 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:50.661676 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:50.661676 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:50.661676 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:50.661676 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:50.661676 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:50.661676 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:50.661676 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:50.661676 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:50.662560 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:53:50.662560 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:53:50.662560 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:50.662560 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:50.667692 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 432/864] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:53:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:50.668743 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c455a54-d1ce-4acf-a181-4a926f61b477 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:50.776680 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:50.782759 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872bb85d-625e-4d31-82ef-9e7697571b83 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:50.800598 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c455a54-d1ce-4acf-a181-4a926f61b477 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:50.832330 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a9bec-0355-477a-84c4-d0bcfccfedec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:50.833549 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a9bec-0355-477a-84c4-d0bcfccfedec None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:50.834043 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a9bec-0355-477a-84c4-d0bcfccfedec None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:50.834266 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:50.834729 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a9bec-0355-477a-84c4-d0bcfccfedec None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:50.836054 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6a9bec-0355-477a-84c4-d0bcfccfedec None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:50.837293 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6a9bec-0355-477a-84c4-d0bcfccfedec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:50.838701 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6a9bec-0355-477a-84c4-d0bcfccfedec None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:50.843392 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf7c57-02c9-42d2-9965-2de11a3e112c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:50.844065 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf7c57-02c9-42d2-9965-2de11a3e112c None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:50.844389 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf7c57-02c9-42d2-9965-2de11a3e112c None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:50.844667 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf7c57-02c9-42d2-9965-2de11a3e112c None admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:50.845398 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf7c57-02c9-42d2-9965-2de11a3e112c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:50.845713 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf7c57-02c9-42d2-9965-2de11a3e112c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:50.846237 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 433/865] 10.222.0.39 () {56 vars in 1126 bytes} [Wed Jun 8 11:53:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:50.847233 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf7c57-02c9-42d2-9965-2de11a3e112c None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:50.851644 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a9bec-0355-477a-84c4-d0bcfccfedec None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:50.867575 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 433/866] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:53:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:50.869849 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf7c57-02c9-42d2-9965-2de11a3e112c None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:50.983844 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a9bec-0355-477a-84c4-d0bcfccfedec None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:50.984706 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf7c57-02c9-42d2-9965-2de11a3e112c None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:51.020559 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f0a38-b933-40ba-ab76-63818797e19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:51.021393 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f0a38-b933-40ba-ab76-63818797e19a None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:51.021678 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f0a38-b933-40ba-ab76-63818797e19a None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:51.021956 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f0a38-b933-40ba-ab76-63818797e19a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:51.022458 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619375af-fba8-4d1e-b754-af679b0df1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:51.023346 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619375af-fba8-4d1e-b754-af679b0df1e1 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:51.024296 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619375af-fba8-4d1e-b754-af679b0df1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:51.024795 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619375af-fba8-4d1e-b754-af679b0df1e1 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:51.026139 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619375af-fba8-4d1e-b754-af679b0df1e1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:51.026645 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619375af-fba8-4d1e-b754-af679b0df1e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:51.028252 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619375af-fba8-4d1e-b754-af679b0df1e1 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:51.029915 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f0a38-b933-40ba-ab76-63818797e19a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:51.031445 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f0a38-b933-40ba-ab76-63818797e19a None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:51.035101 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 434/867] 10.222.0.39 () {56 vars in 1126 bytes} [Wed Jun 8 11:53:50 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:53:51.049120 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-d28f0a38-b933-40ba-ab76-63818797e19a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:53:51.049120 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:51.049120 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:51.049120 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:51.049120 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:51.049120 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:51.049120 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:51.049120 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:51.049120 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:51.049120 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:51.049120 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:51.049120 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:51.049120 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 11:53:51.049120 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 11:53:51.049120 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 11:53:51.050085 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 11:53:51.050085 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:51.050085 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:51.050085 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:51.050085 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:51.050085 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:51.050085 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:51.050085 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:51.050085 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:51.050085 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:51.050085 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:51.050085 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:51.050085 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:51.050085 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:51.050085 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:51.050085 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:51.050085 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:51.050977 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 11:53:51.050977 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 11:53:51.050977 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 11:53:51.050977 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 11:53:51.050977 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 11:53:51.050977 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 11:53:51.050977 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:53:51.050977 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:51.050977 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 434/868] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Jun 8 11:53:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:51.058474 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619375af-fba8-4d1e-b754-af679b0df1e1 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:51.092652 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:51.175469 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619375af-fba8-4d1e-b754-af679b0df1e1 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:51.214617 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c85c9-cba5-4392-bb8f-1681a0de794f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:51.215563 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c85c9-cba5-4392-bb8f-1681a0de794f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:51.216027 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c85c9-cba5-4392-bb8f-1681a0de794f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:51.216474 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c85c9-cba5-4392-bb8f-1681a0de794f None admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:51.217425 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8c85c9-cba5-4392-bb8f-1681a0de794f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:51.217901 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8c85c9-cba5-4392-bb8f-1681a0de794f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:51.219516 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8c85c9-cba5-4392-bb8f-1681a0de794f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:51.235490 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 435/869] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Jun 8 11:53:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:51.241344 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f0a38-b933-40ba-ab76-63818797e19a None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:51.302217 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:51.355015 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f0a38-b933-40ba-ab76-63818797e19a None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:51.390077 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6428515-80cf-414f-88ed-4f7011d7d18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:51.390738 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6428515-80cf-414f-88ed-4f7011d7d18d None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:51.391025 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6428515-80cf-414f-88ed-4f7011d7d18d None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:51.391305 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6428515-80cf-414f-88ed-4f7011d7d18d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:51.392141 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6428515-80cf-414f-88ed-4f7011d7d18d None admin] RBAC: Adding query filter params (role.id=125b7374688b4b009d443f1b34947c49, scope.project.id=6a7fee684e8b43e199c95aeeb92640d4, user.id=d52efc21c66d4300a8a979d92dbfeb47) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:51.392485 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6428515-80cf-414f-88ed-4f7011d7d18d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:51.393927 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6428515-80cf-414f-88ed-4f7011d7d18d None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:51.401008 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 435/870] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Jun 8 11:53:51 2022] GET /identity/v3/role_assignments?user.id=d52efc21c66d4300a8a979d92dbfeb47&scope.project.id=6a7fee684e8b43e199c95aeeb92640d4&role.id=125b7374688b4b009d443f1b34947c49 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:52.597343 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078e7af-87c4-4a1a-b4e7-33eaf870e09b None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:52.598487 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078e7af-87c4-4a1a-b4e7-33eaf870e09b None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:52.598986 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078e7af-87c4-4a1a-b4e7-33eaf870e09b None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:52.600811 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 436/871] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:53:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:53:52.607040 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b593b-3123-47d8-afa7-fe76634a064c None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:52.607880 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b593b-3123-47d8-afa7-fe76634a064c None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:52.608401 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b593b-3123-47d8-afa7-fe76634a064c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:52.625844 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-863b593b-3123-47d8-afa7-fe76634a064c None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:53:52.627341 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-863b593b-3123-47d8-afa7-fe76634a064c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:53:52.698410 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 436/872] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:53:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 11:53:52.722214 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2078e7af-87c4-4a1a-b4e7-33eaf870e09b None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:52.815535 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:52.833742 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2078e7af-87c4-4a1a-b4e7-33eaf870e09b None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:52.870180 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef3d1d-21f8-43bb-bb3b-3c73c4788802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:52.871192 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef3d1d-21f8-43bb-bb3b-3c73c4788802 None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:52.871683 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef3d1d-21f8-43bb-bb3b-3c73c4788802 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:52.872160 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef3d1d-21f8-43bb-bb3b-3c73c4788802 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:52.873219 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ef3d1d-21f8-43bb-bb3b-3c73c4788802 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:52.874892 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ef3d1d-21f8-43bb-bb3b-3c73c4788802 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:52.892891 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 437/873] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Jun 8 11:53:52 2022] POST /identity/v3/services => generated 251 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 11:53:53.072998 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7853750-e3da-4537-b21c-0bd7a446808c None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:53.073768 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7853750-e3da-4537-b21c-0bd7a446808c None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:53.074288 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7853750-e3da-4537-b21c-0bd7a446808c None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:53.076524 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 437/874] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:53:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:53:53.082068 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5144c-d91d-478d-94d7-6a6dda849e35 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:53.082702 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5144c-d91d-478d-94d7-6a6dda849e35 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:53.083184 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5144c-d91d-478d-94d7-6a6dda849e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:53.102990 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-bcb5144c-d91d-478d-94d7-6a6dda849e35 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:53:53.104609 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-bcb5144c-d91d-478d-94d7-6a6dda849e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:53:53.186208 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 438/875] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:53:53 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 11:53:53.208287 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7853750-e3da-4537-b21c-0bd7a446808c None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:53.262456 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:53.326395 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7853750-e3da-4537-b21c-0bd7a446808c None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:53.363449 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad43d28-0632-479c-bd93-efa3acfe5f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:53.364290 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad43d28-0632-479c-bd93-efa3acfe5f72 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:53.364577 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad43d28-0632-479c-bd93-efa3acfe5f72 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:53.364852 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad43d28-0632-479c-bd93-efa3acfe5f72 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:53.365511 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad43d28-0632-479c-bd93-efa3acfe5f72 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:53.366902 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad43d28-0632-479c-bd93-efa3acfe5f72 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:53.379790 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-5ad43d28-0632-479c-bd93-efa3acfe5f72 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 11:53:53.379790 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:53.379790 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 11:53:53.379790 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 11:53:53.379790 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 11:53:53.379790 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 11:53:53.379790 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 11:53:53.379790 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 11:53:53.379790 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 11:53:53.379790 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:53.379790 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 11:53:53.379790 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:53.379790 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:53.379790 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:53.379790 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:53.379790 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:53.379790 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:53.380853 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:53.380853 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:53.380853 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:53.380853 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:53.380853 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:53.380853 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:53.380853 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 11:53:53.380853 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 11:53:53.380853 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 11:53:53.380853 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 11:53:53.380853 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:53.380853 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:53.380853 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:53.380853 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:53.380853 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:53.380853 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:53.381675 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:53.381675 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:53.381675 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:53.381675 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:53.381675 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:53.381675 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:53.381675 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:53.381675 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:53.381675 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:53.381675 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:53.381675 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 11:53:53.381675 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 11:53:53.381675 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 11:53:53.381675 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:53.381675 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 438/876] 10.222.0.39 () {56 vars in 1126 bytes} [Wed Jun 8 11:53:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:53.387668 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb5144c-d91d-478d-94d7-6a6dda849e35 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:53.407045 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00aa4f-8a0c-497e-9176-57afb3658e2d None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:53.407337 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00aa4f-8a0c-497e-9176-57afb3658e2d None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:53.407622 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00aa4f-8a0c-497e-9176-57afb3658e2d None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:53.409267 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 439/877] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:53:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 11:53:53.414241 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c61796-5ba6-4662-8d90-c91265372fcc None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:53.414530 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c61796-5ba6-4662-8d90-c91265372fcc None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:53.414814 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c61796-5ba6-4662-8d90-c91265372fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:53.432692 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-38c61796-5ba6-4662-8d90-c91265372fcc None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:53:53.433997 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-38c61796-5ba6-4662-8d90-c91265372fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:53:53.478428 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:53.503862 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb5144c-d91d-478d-94d7-6a6dda849e35 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:53.514009 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 440/878] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:53:53 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 11:53:53.541306 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c61796-5ba6-4662-8d90-c91265372fcc None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:53.555168 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e339f0-9400-4af3-befc-b3dde286073f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:53.555986 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e339f0-9400-4af3-befc-b3dde286073f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:53.556448 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e339f0-9400-4af3-befc-b3dde286073f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:53.556721 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e339f0-9400-4af3-befc-b3dde286073f None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:53.557883 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e339f0-9400-4af3-befc-b3dde286073f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:53.558459 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e339f0-9400-4af3-befc-b3dde286073f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:53.560137 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e339f0-9400-4af3-befc-b3dde286073f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:53.566554 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 439/879] 10.222.0.39 () {56 vars in 1122 bytes} [Wed Jun 8 11:53:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:53.572118 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e339f0-9400-4af3-befc-b3dde286073f None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:53.587869 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:53.651017 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c61796-5ba6-4662-8d90-c91265372fcc None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:53.687261 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b1e331-dfc0-47bd-a564-75c9bce359fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:53.687939 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1e331-dfc0-47bd-a564-75c9bce359fa None admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:53.688253 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1e331-dfc0-47bd-a564-75c9bce359fa None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:53.688536 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1e331-dfc0-47bd-a564-75c9bce359fa None admin] PATH_INFO: `/v3/services` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:53.689282 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b1e331-dfc0-47bd-a564-75c9bce359fa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:53.690665 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b1e331-dfc0-47bd-a564-75c9bce359fa None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:53.693149 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e339f0-9400-4af3-befc-b3dde286073f None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:53.712697 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 441/880] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Jun 8 11:53:53 2022] POST /identity/v3/services => generated 269 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 11:53:53.738572 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:53.744380 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed217f-9737-4ac2-910e-24bcda173df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:53.745270 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed217f-9737-4ac2-910e-24bcda173df1 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:53.745755 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed217f-9737-4ac2-910e-24bcda173df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:53.746031 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed217f-9737-4ac2-910e-24bcda173df1 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:53.746753 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed217f-9737-4ac2-910e-24bcda173df1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:53.747057 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed217f-9737-4ac2-910e-24bcda173df1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:53.748503 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed217f-9737-4ac2-910e-24bcda173df1 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:53.754582 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 440/881] 10.222.0.39 () {56 vars in 1122 bytes} [Wed Jun 8 11:53:53 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:53:53.807359 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b10eec-6488-4f5f-8893-b0d84bad7bec None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:53.807703 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b10eec-6488-4f5f-8893-b0d84bad7bec None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:53.807929 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b10eec-6488-4f5f-8893-b0d84bad7bec None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:53.809777 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 442/882] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:53:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:53:53.815614 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3516f-253a-4f4b-8638-245eeb33ee23 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:53.815928 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3516f-253a-4f4b-8638-245eeb33ee23 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:53.816192 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3516f-253a-4f4b-8638-245eeb33ee23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:53.835478 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-31b3516f-253a-4f4b-8638-245eeb33ee23 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:53:53.836907 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-31b3516f-253a-4f4b-8638-245eeb33ee23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:53:53.920351 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 441/883] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:53:53 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 11:53:53.941139 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b10eec-6488-4f5f-8893-b0d84bad7bec None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:54.048742 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:54.053055 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b10eec-6488-4f5f-8893-b0d84bad7bec None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:54.088908 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e8846-0b51-4658-a8bf-5636e0bd0506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:54.089726 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e8846-0b51-4658-a8bf-5636e0bd0506 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:54.090009 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e8846-0b51-4658-a8bf-5636e0bd0506 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:54.090284 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e8846-0b51-4658-a8bf-5636e0bd0506 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:54.101205 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e8846-0b51-4658-a8bf-5636e0bd0506 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:53:54.110395 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-2f3e8846-0b51-4658-a8bf-5636e0bd0506 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 08 11:53:54.110395 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:54.110395 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:54.110395 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:54.110395 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:54.110395 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:54.110395 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:54.110395 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:54.110395 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:54.110395 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:54.110395 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:54.110395 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:54.110395 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:53:54.110395 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:53:54.110395 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:53:54.110395 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:53:54.112667 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:53:54.112667 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:53:54.112667 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:53:54.112667 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:53:54.112667 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:54.112667 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:54.112667 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:54.112667 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:54.112667 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:54.112667 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:54.112667 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:54.112667 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:54.112667 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:54.112667 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:54.112667 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:54.112667 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:54.114663 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:54.114663 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:54.114663 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:54.114663 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:54.114663 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:53:54.114663 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:53:54.114663 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:53:54.114663 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:53:54.114663 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:53:54.114663 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:53:54.114663 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 08 11:53:54.114663 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:54.120218 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 443/884] 10.222.0.39 () {56 vars in 1120 bytes} [Wed Jun 8 11:53:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:54.120408 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b3516f-253a-4f4b-8638-245eeb33ee23 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:54.226389 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b3516f-253a-4f4b-8638-245eeb33ee23 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:54.254759 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:54.264967 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44954da9-13cf-41df-b6f9-1b168a25fa2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:54.265919 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44954da9-13cf-41df-b6f9-1b168a25fa2a None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:54.266393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44954da9-13cf-41df-b6f9-1b168a25fa2a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:54.266869 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44954da9-13cf-41df-b6f9-1b168a25fa2a None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:54.267813 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44954da9-13cf-41df-b6f9-1b168a25fa2a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:54.268353 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44954da9-13cf-41df-b6f9-1b168a25fa2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:54.269913 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44954da9-13cf-41df-b6f9-1b168a25fa2a None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:54.284276 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 442/885] 10.222.0.39 () {56 vars in 1115 bytes} [Wed Jun 8 11:53:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:53:54.286198 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e8846-0b51-4658-a8bf-5636e0bd0506 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:54.396737 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e8846-0b51-4658-a8bf-5636e0bd0506 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:54.432574 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb637e82-f4d0-44df-ae3d-9916029f4471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:54.433378 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb637e82-f4d0-44df-ae3d-9916029f4471 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:54.433664 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb637e82-f4d0-44df-ae3d-9916029f4471 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:54.433939 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb637e82-f4d0-44df-ae3d-9916029f4471 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:54.444828 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb637e82-f4d0-44df-ae3d-9916029f4471 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:54.446475 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb637e82-f4d0-44df-ae3d-9916029f4471 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:54.464641 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-cb637e82-f4d0-44df-ae3d-9916029f4471 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:54.464641 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:54.464641 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:54.464641 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:54.464641 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:54.464641 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:54.464641 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:54.464641 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:54.464641 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:54.464641 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:54.464641 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:54.464641 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:54.464641 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:53:54.464641 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:53:54.464641 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:53:54.465561 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:53:54.465561 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:54.465561 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:54.465561 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:54.465561 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:54.465561 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:54.465561 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:54.465561 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:54.465561 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:54.465561 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:54.465561 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:54.465561 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:54.465561 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:54.465561 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:54.465561 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:54.465561 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:54.465561 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:54.466828 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:53:54.466828 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:53:54.466828 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:54.466828 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:54.466828 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 444/886] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:53:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:54.473073 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44954da9-13cf-41df-b6f9-1b168a25fa2a None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:54.586534 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44954da9-13cf-41df-b6f9-1b168a25fa2a None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:54.623884 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabdcc67-22f9-4fbd-bc50-968e71962989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:54.624596 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabdcc67-22f9-4fbd-bc50-968e71962989 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:54.624883 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabdcc67-22f9-4fbd-bc50-968e71962989 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:54.625169 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabdcc67-22f9-4fbd-bc50-968e71962989 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:54.625895 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabdcc67-22f9-4fbd-bc50-968e71962989 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:54.626206 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabdcc67-22f9-4fbd-bc50-968e71962989 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:54.627583 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabdcc67-22f9-4fbd-bc50-968e71962989 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:54.645387 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 443/887] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:53:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:54.649356 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb637e82-f4d0-44df-ae3d-9916029f4471 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:54.668358 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:54.764485 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb637e82-f4d0-44df-ae3d-9916029f4471 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:54.802365 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d49e7-4fdb-4a66-bff4-dbc362a40d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:54.803196 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d49e7-4fdb-4a66-bff4-dbc362a40d74 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:54.803482 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d49e7-4fdb-4a66-bff4-dbc362a40d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:54.803759 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d49e7-4fdb-4a66-bff4-dbc362a40d74 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:54.812206 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649d49e7-4fdb-4a66-bff4-dbc362a40d74 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:54.813884 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649d49e7-4fdb-4a66-bff4-dbc362a40d74 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:54.829590 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-649d49e7-4fdb-4a66-bff4-dbc362a40d74 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 08 11:53:54.829590 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:54.829590 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:54.829590 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:54.829590 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:54.829590 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:54.829590 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:54.829590 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:54.829590 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:54.829590 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:54.829590 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:54.829590 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:54.829590 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 11:53:54.829590 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 11:53:54.829590 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 11:53:54.829590 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 11:53:54.830592 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:54.830592 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:54.830592 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 11:53:54.830592 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:53:54.830592 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 11:53:54.830592 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:53:54.830592 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:54.830592 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:54.830592 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:54.830592 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:54.830592 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:54.830592 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:54.830592 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:54.830592 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:54.830592 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:54.830592 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:54.830592 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:54.830592 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:54.831814 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:54.831814 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:54.831814 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 11:53:54.831814 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 11:53:54.831814 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 11:53:54.831814 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 11:53:54.831814 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 11:53:54.831814 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 11:53:54.831814 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 08 11:53:54.831814 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:54.831814 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 445/888] 10.222.0.39 () {56 vars in 1117 bytes} [Wed Jun 8 11:53:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:54.838703 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabdcc67-22f9-4fbd-bc50-968e71962989 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:54.893553 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:54.955601 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabdcc67-22f9-4fbd-bc50-968e71962989 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:54.995397 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d996d6f-a755-4a5d-b82a-5a45b8059d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:54.996469 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d996d6f-a755-4a5d-b82a-5a45b8059d41 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:54.996967 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d996d6f-a755-4a5d-b82a-5a45b8059d41 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:54.997452 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d996d6f-a755-4a5d-b82a-5a45b8059d41 None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:54.998513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d996d6f-a755-4a5d-b82a-5a45b8059d41 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:54.999048 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d996d6f-a755-4a5d-b82a-5a45b8059d41 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:55.000771 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d996d6f-a755-4a5d-b82a-5a45b8059d41 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:55.024270 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 444/889] 10.222.0.39 () {56 vars in 1149 bytes} [Wed Jun 8 11:53:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:55.027462 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d49e7-4fdb-4a66-bff4-dbc362a40d74 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:55.111744 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:55.144750 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d49e7-4fdb-4a66-bff4-dbc362a40d74 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:55.184071 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1107787-b028-4acb-b141-705fb1298f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:55.184769 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1107787-b028-4acb-b141-705fb1298f45 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:55.185054 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1107787-b028-4acb-b141-705fb1298f45 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:55.185333 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1107787-b028-4acb-b141-705fb1298f45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:55.255697 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1107787-b028-4acb-b141-705fb1298f45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:55.257109 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1107787-b028-4acb-b141-705fb1298f45 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:55.276271 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6351c0f-b8b0-4349-96be-8b2f6b196809 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:55.276563 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6351c0f-b8b0-4349-96be-8b2f6b196809 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:55.276828 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6351c0f-b8b0-4349-96be-8b2f6b196809 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:55.278321 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 445/890] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:53:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:53:55.284610 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58b6c5-e920-4974-9dca-4ec5bba3d684 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:55.285434 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58b6c5-e920-4974-9dca-4ec5bba3d684 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:55.286074 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58b6c5-e920-4974-9dca-4ec5bba3d684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:55.307416 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-de58b6c5-e920-4974-9dca-4ec5bba3d684 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:53:55.309123 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-de58b6c5-e920-4974-9dca-4ec5bba3d684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:53:55.339341 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:55.366472 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 446/891] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:53:55 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 11:53:55.371885 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1107787-b028-4acb-b141-705fb1298f45 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:55.412229 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 446/892] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:53:55 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 11:53:55.432800 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de58b6c5-e920-4974-9dca-4ec5bba3d684 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:55.469383 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:55.487752 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1107787-b028-4acb-b141-705fb1298f45 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:55.526781 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c6b457-925d-4672-a0dd-42aa2637df0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:55.527811 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c6b457-925d-4672-a0dd-42aa2637df0e None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:55.528273 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c6b457-925d-4672-a0dd-42aa2637df0e None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:55.528701 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c6b457-925d-4672-a0dd-42aa2637df0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:55.541233 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de58b6c5-e920-4974-9dca-4ec5bba3d684 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:55.543437 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c6b457-925d-4672-a0dd-42aa2637df0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:55.545681 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c6b457-925d-4672-a0dd-42aa2637df0e None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:55.569319 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-54c6b457-925d-4672-a0dd-42aa2637df0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:55.569319 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:55.569319 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:55.569319 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:55.569319 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:55.569319 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:55.569319 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:55.569319 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:55.569319 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:55.569319 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:55.569319 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:55.569319 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:55.569319 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:53:55.569319 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:53:55.569319 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:53:55.570828 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:53:55.570828 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:55.570828 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:55.570828 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:55.570828 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:55.570828 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:55.570828 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:55.570828 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:55.570828 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:55.570828 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:55.570828 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:55.570828 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:55.570828 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:55.570828 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:55.570828 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:55.570828 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:55.570828 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:55.571716 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:53:55.571716 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:53:55.571716 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:55.571716 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:55.578870 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 447/893] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:53:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 11:53:55.580397 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c6b457-925d-4672-a0dd-42aa2637df0e None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:55.587400 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d63ef2-002b-4c64-a011-d07b249111c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:55.588464 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d63ef2-002b-4c64-a011-d07b249111c6 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:55.588939 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d63ef2-002b-4c64-a011-d07b249111c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:55.589328 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d63ef2-002b-4c64-a011-d07b249111c6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:55.590266 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d63ef2-002b-4c64-a011-d07b249111c6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:55.591818 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d63ef2-002b-4c64-a011-d07b249111c6 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:55.608908 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-44d63ef2-002b-4c64-a011-d07b249111c6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 08 11:53:55.608908 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:55.608908 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 11:53:55.608908 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 11:53:55.608908 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 11:53:55.608908 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 11:53:55.608908 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 11:53:55.608908 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 11:53:55.608908 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 08 11:53:55.608908 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:55.608908 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 11:53:55.608908 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:55.608908 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:55.608908 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:55.608908 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:55.608908 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:55.608908 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:55.610178 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:55.610178 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:55.610178 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:55.610178 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:55.610178 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:55.610178 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:55.610178 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 11:53:55.610178 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 11:53:55.610178 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 11:53:55.610178 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 11:53:55.610178 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:55.610178 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:55.610178 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:55.610178 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:55.610178 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:55.610178 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:55.611221 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:55.611221 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:55.611221 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:55.611221 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:55.611221 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:55.611221 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:55.611221 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:55.611221 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:55.611221 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:55.611221 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:55.611221 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 11:53:55.611221 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 11:53:55.611221 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 08 11:53:55.611221 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:55.615005 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:55.618576 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 447/894] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Jun 8 11:53:55 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 11:53:55.619579 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d63ef2-002b-4c64-a011-d07b249111c6 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:55.723942 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c6b457-925d-4672-a0dd-42aa2637df0e None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:55.732545 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:55.736134 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d63ef2-002b-4c64-a011-d07b249111c6 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:55.773772 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d10105-29ae-4de0-81fe-efa1fd7db974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:55.774623 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d10105-29ae-4de0-81fe-efa1fd7db974 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:55.775007 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d10105-29ae-4de0-81fe-efa1fd7db974 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:55.775350 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6da47f-2d62-4370-b5c3-f51607ebae0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:55.775482 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d10105-29ae-4de0-81fe-efa1fd7db974 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:55.776319 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6da47f-2d62-4370-b5c3-f51607ebae0e None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:55.776456 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d10105-29ae-4de0-81fe-efa1fd7db974 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:55.776863 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d10105-29ae-4de0-81fe-efa1fd7db974 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:55.777083 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6da47f-2d62-4370-b5c3-f51607ebae0e None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:55.777520 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6da47f-2d62-4370-b5c3-f51607ebae0e None admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:55.778427 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6da47f-2d62-4370-b5c3-f51607ebae0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:55.778676 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d10105-29ae-4de0-81fe-efa1fd7db974 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:55.779074 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6da47f-2d62-4370-b5c3-f51607ebae0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:55.780985 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6da47f-2d62-4370-b5c3-f51607ebae0e None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:55.788042 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 448/895] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Jun 8 11:53:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:55.794673 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d10105-29ae-4de0-81fe-efa1fd7db974 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:55.807602 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 448/896] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:53:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:53:55.809367 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6da47f-2d62-4370-b5c3-f51607ebae0e None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:55.928258 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:55.932531 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d10105-29ae-4de0-81fe-efa1fd7db974 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:55.953929 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6da47f-2d62-4370-b5c3-f51607ebae0e None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:55.974952 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c383015-6a61-42d1-924e-3ca5d2cde56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:55.975630 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c383015-6a61-42d1-924e-3ca5d2cde56d None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:55.975912 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c383015-6a61-42d1-924e-3ca5d2cde56d None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:55.976199 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c383015-6a61-42d1-924e-3ca5d2cde56d None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:55.977324 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c383015-6a61-42d1-924e-3ca5d2cde56d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:55.977694 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c383015-6a61-42d1-924e-3ca5d2cde56d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:55.979188 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c383015-6a61-42d1-924e-3ca5d2cde56d None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:55.989341 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 449/897] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Jun 8 11:53:55 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:53:55.991255 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c383015-6a61-42d1-924e-3ca5d2cde56d None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:56.005229 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3502e13-5437-42da-a408-b1f9d78471e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:56.006048 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3502e13-5437-42da-a408-b1f9d78471e5 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:56.006332 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3502e13-5437-42da-a408-b1f9d78471e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:56.006602 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3502e13-5437-42da-a408-b1f9d78471e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:56.016585 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3502e13-5437-42da-a408-b1f9d78471e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:56.018213 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3502e13-5437-42da-a408-b1f9d78471e5 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:56.034095 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:56.046472 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-b3502e13-5437-42da-a408-b1f9d78471e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:53:56.046472 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:56.046472 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:56.046472 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:56.046472 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:56.046472 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:56.046472 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:56.046472 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:56.046472 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:56.046472 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:56.046472 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:56.046472 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:56.046472 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 11:53:56.046472 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 11:53:56.046472 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 11:53:56.047408 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 11:53:56.047408 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:56.047408 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:56.047408 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:56.047408 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:56.047408 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:56.047408 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:56.047408 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:56.047408 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:56.047408 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:56.047408 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:56.047408 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:56.047408 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:56.047408 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:56.047408 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:56.047408 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:56.047408 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:56.048357 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 11:53:56.048357 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 11:53:56.048357 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 11:53:56.048357 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 11:53:56.048357 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 11:53:56.048357 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 11:53:56.048357 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:53:56.048357 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:56.052298 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 449/898] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Jun 8 11:53:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 11:53:56.054036 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3502e13-5437-42da-a408-b1f9d78471e5 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:56.131995 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c383015-6a61-42d1-924e-3ca5d2cde56d None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:56.165923 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3502e13-5437-42da-a408-b1f9d78471e5 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:56.171937 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1340f628-7c80-4407-b06a-82e359c7e287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:56.172639 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340f628-7c80-4407-b06a-82e359c7e287 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:56.172927 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340f628-7c80-4407-b06a-82e359c7e287 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:56.173607 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340f628-7c80-4407-b06a-82e359c7e287 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:56.174428 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1340f628-7c80-4407-b06a-82e359c7e287 None admin] RBAC: Adding query filter params (interface=public, service_id=bcc508bbab694c11a6c7656056887dc6, region_id=RegionOne) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:56.174741 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1340f628-7c80-4407-b06a-82e359c7e287 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:56.176831 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1340f628-7c80-4407-b06a-82e359c7e287 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:56.183286 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 450/899] 10.222.0.39 () {56 vars in 1251 bytes} [Wed Jun 8 11:53:55 2022] GET /identity/v3/endpoints?service_id=bcc508bbab694c11a6c7656056887dc6&interface=public®ion_id=RegionOne => generated 194 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:56.184578 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01f3bd-9ac7-4865-8a3a-02a0bdf625bd None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:56.184865 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01f3bd-9ac7-4865-8a3a-02a0bdf625bd None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:56.185143 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01f3bd-9ac7-4865-8a3a-02a0bdf625bd None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:56.186516 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 451/900] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:53:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:53:56.191260 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01f3bd-9ac7-4865-8a3a-02a0bdf625bd None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:56.207175 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3053c4a1-d677-4a12-903a-94b89dda2369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:56.208089 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053c4a1-d677-4a12-903a-94b89dda2369 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:56.208589 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053c4a1-d677-4a12-903a-94b89dda2369 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:56.208867 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053c4a1-d677-4a12-903a-94b89dda2369 None admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:56.209650 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3053c4a1-d677-4a12-903a-94b89dda2369 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:56.209957 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3053c4a1-d677-4a12-903a-94b89dda2369 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:56.211466 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3053c4a1-d677-4a12-903a-94b89dda2369 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:56.228674 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 450/901] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Jun 8 11:53:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:53:56.228674 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63efccf-8041-45cf-91e9-0b01a051c2b7 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:56.228674 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63efccf-8041-45cf-91e9-0b01a051c2b7 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:56.228674 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63efccf-8041-45cf-91e9-0b01a051c2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:56.231705 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:56.244825 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-b63efccf-8041-45cf-91e9-0b01a051c2b7 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:53:56.246366 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-b63efccf-8041-45cf-91e9-0b01a051c2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:53:56.295736 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:56.306573 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01f3bd-9ac7-4865-8a3a-02a0bdf625bd None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:56.314163 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 451/902] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:53:56 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 11:53:56.315195 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63efccf-8041-45cf-91e9-0b01a051c2b7 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:56.359544 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f574265-a0d5-444e-bb78-f59dd80d1868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:56.360237 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f574265-a0d5-444e-bb78-f59dd80d1868 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:56.360526 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f574265-a0d5-444e-bb78-f59dd80d1868 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:56.360808 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f574265-a0d5-444e-bb78-f59dd80d1868 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:56.361490 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f574265-a0d5-444e-bb78-f59dd80d1868 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:56.362875 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f574265-a0d5-444e-bb78-f59dd80d1868 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:56.369265 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 452/903] 10.222.0.39 () {56 vars in 1087 bytes} [Wed Jun 8 11:53:56 2022] GET /identity/v3/services => generated 1268 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 11:53:56.370524 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f4517-fd97-42d0-b2f0-e2ab71262e82 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:56.370815 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f4517-fd97-42d0-b2f0-e2ab71262e82 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:56.371097 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f4517-fd97-42d0-b2f0-e2ab71262e82 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:56.372382 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 453/904] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:53:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:53:56.373112 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f4517-fd97-42d0-b2f0-e2ab71262e82 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:56.436344 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63efccf-8041-45cf-91e9-0b01a051c2b7 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:56.480289 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b2aa9-a710-4006-9d40-93dea560a4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:56.480962 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b2aa9-a710-4006-9d40-93dea560a4c6 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:56.481270 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b2aa9-a710-4006-9d40-93dea560a4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:56.481571 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b2aa9-a710-4006-9d40-93dea560a4c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:56.482381 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b2aa9-a710-4006-9d40-93dea560a4c6 None admin] RBAC: Adding query filter params (role.id=c19874f86dad4aa1bfa44ebf9eaf6de4, scope.project.id=6a7fee684e8b43e199c95aeeb92640d4, user.id=d52efc21c66d4300a8a979d92dbfeb47) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:56.482695 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b2aa9-a710-4006-9d40-93dea560a4c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:56.484163 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b2aa9-a710-4006-9d40-93dea560a4c6 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:56.486518 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:56.495123 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f4517-fd97-42d0-b2f0-e2ab71262e82 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:56.504627 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 452/905] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Jun 8 11:53:56 2022] GET /identity/v3/role_assignments?user.id=d52efc21c66d4300a8a979d92dbfeb47&scope.project.id=6a7fee684e8b43e199c95aeeb92640d4&role.id=c19874f86dad4aa1bfa44ebf9eaf6de4 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:56.507340 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9232f-87c6-4264-9ca3-4e93af5db480 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:56.509027 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9232f-87c6-4264-9ca3-4e93af5db480 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:56.509859 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9232f-87c6-4264-9ca3-4e93af5db480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:56.539974 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf6bcf-ffa1-4adf-b7f3-9685ff57bf2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:56.541362 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf6bcf-ffa1-4adf-b7f3-9685ff57bf2b None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:56.541719 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf6bcf-ffa1-4adf-b7f3-9685ff57bf2b None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:56.542094 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf6bcf-ffa1-4adf-b7f3-9685ff57bf2b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:56.542788 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf6bcf-ffa1-4adf-b7f3-9685ff57bf2b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:56.544325 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf6bcf-ffa1-4adf-b7f3-9685ff57bf2b None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:56.550894 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-e6c9232f-87c6-4264-9ca3-4e93af5db480 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:53:56.552541 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-e6c9232f-87c6-4264-9ca3-4e93af5db480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:53:56.558906 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-e3bf6bcf-ffa1-4adf-b7f3-9685ff57bf2b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 08 11:53:56.558906 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:56.558906 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 11:53:56.558906 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 11:53:56.558906 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 11:53:56.558906 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 11:53:56.558906 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 11:53:56.558906 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 11:53:56.558906 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 08 11:53:56.558906 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:56.558906 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 11:53:56.558906 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:56.558906 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:56.558906 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:56.558906 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:56.558906 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:56.559944 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:56.559944 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:56.559944 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:56.559944 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:56.559944 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:56.559944 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:56.559944 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:56.559944 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 11:53:56.559944 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 11:53:56.559944 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 11:53:56.559944 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 11:53:56.559944 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:56.559944 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:56.559944 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:56.559944 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:56.559944 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:56.560813 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:56.560813 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:56.560813 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:56.560813 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:56.560813 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:56.560813 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:56.560813 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:56.560813 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:56.560813 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:56.560813 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:56.560813 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:56.560813 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 11:53:56.560813 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 11:53:56.560813 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 08 11:53:56.560813 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:56.560813 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 454/906] 10.222.0.39 () {56 vars in 1132 bytes} [Wed Jun 8 11:53:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:56.566732 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf6bcf-ffa1-4adf-b7f3-9685ff57bf2b None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:56.596133 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:56.655291 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 453/907] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:53:56 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 11:53:56.677888 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9232f-87c6-4264-9ca3-4e93af5db480 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:56.707235 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf6bcf-ffa1-4adf-b7f3-9685ff57bf2b None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:56.749000 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94e06b-9ada-4b82-a844-8750289ec6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:56.749671 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94e06b-9ada-4b82-a844-8750289ec6ad None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:56.749952 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94e06b-9ada-4b82-a844-8750289ec6ad None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:56.750224 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94e06b-9ada-4b82-a844-8750289ec6ad None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:56.750932 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d94e06b-9ada-4b82-a844-8750289ec6ad None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:56.751236 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d94e06b-9ada-4b82-a844-8750289ec6ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:56.752755 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d94e06b-9ada-4b82-a844-8750289ec6ad None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:56.759244 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 455/908] 10.222.0.39 () {56 vars in 1126 bytes} [Wed Jun 8 11:53:56 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:56.764280 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94e06b-9ada-4b82-a844-8750289ec6ad None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:56.798894 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9232f-87c6-4264-9ca3-4e93af5db480 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:56.838364 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:56.849232 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a813e827-f934-40de-be57-799c6e596a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:56.849909 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813e827-f934-40de-be57-799c6e596a6b None admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:56.850192 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813e827-f934-40de-be57-799c6e596a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:56.850464 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813e827-f934-40de-be57-799c6e596a6b None admin] PATH_INFO: `/v3/services` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:56.851271 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a813e827-f934-40de-be57-799c6e596a6b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:56.852839 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a813e827-f934-40de-be57-799c6e596a6b None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:56.867080 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:56.873372 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 454/909] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Jun 8 11:53:56 2022] POST /identity/v3/services => generated 241 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 11:53:56.895417 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94e06b-9ada-4b82-a844-8750289ec6ad None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:56.951534 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a436410-ae77-44ce-8d01-4ae46663a80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:56.953124 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a436410-ae77-44ce-8d01-4ae46663a80c None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:56.953641 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a436410-ae77-44ce-8d01-4ae46663a80c None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:56.954235 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a436410-ae77-44ce-8d01-4ae46663a80c None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:56.955160 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a436410-ae77-44ce-8d01-4ae46663a80c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:56.955658 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a436410-ae77-44ce-8d01-4ae46663a80c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:56.957336 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a436410-ae77-44ce-8d01-4ae46663a80c None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:56.965798 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 456/910] 10.222.0.39 () {56 vars in 1126 bytes} [Wed Jun 8 11:53:56 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:56.973717 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a813e827-f934-40de-be57-799c6e596a6b None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:57.092890 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a813e827-f934-40de-be57-799c6e596a6b None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:57.130487 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1050d0e0-7b77-41d8-a90b-c9231b1b79cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:57.131151 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050d0e0-7b77-41d8-a90b-c9231b1b79cd None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:57.131436 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050d0e0-7b77-41d8-a90b-c9231b1b79cd None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:57.131711 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050d0e0-7b77-41d8-a90b-c9231b1b79cd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:57.133497 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1050d0e0-7b77-41d8-a90b-c9231b1b79cd None admin] RBAC: Adding query filter params (interface=public, service_id=83325a80bdeb4aa7b23dc305651c2949, region_id=RegionOne) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:57.133822 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1050d0e0-7b77-41d8-a90b-c9231b1b79cd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:57.135187 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1050d0e0-7b77-41d8-a90b-c9231b1b79cd None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:57.140922 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 455/911] 10.222.0.39 () {56 vars in 1251 bytes} [Wed Jun 8 11:53:56 2022] GET /identity/v3/endpoints?service_id=83325a80bdeb4aa7b23dc305651c2949&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:57.146428 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a436410-ae77-44ce-8d01-4ae46663a80c None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:57.261542 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a436410-ae77-44ce-8d01-4ae46663a80c None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:57.299226 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10580d-bb1c-43d6-8920-5e72e60a78b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:57.299962 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10580d-bb1c-43d6-8920-5e72e60a78b0 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:57.300324 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10580d-bb1c-43d6-8920-5e72e60a78b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:57.300600 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10580d-bb1c-43d6-8920-5e72e60a78b0 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:57.301282 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b10580d-bb1c-43d6-8920-5e72e60a78b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:57.302656 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b10580d-bb1c-43d6-8920-5e72e60a78b0 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:57.310298 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 457/912] 10.222.0.39 () {56 vars in 1087 bytes} [Wed Jun 8 11:53:57 2022] GET /identity/v3/services => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 11:53:58.766069 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e35cfc-c2f8-4608-9c82-cd1a9c9ae936 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:58.766587 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e35cfc-c2f8-4608-9c82-cd1a9c9ae936 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:58.766665 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e35cfc-c2f8-4608-9c82-cd1a9c9ae936 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:58.768233 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 456/913] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:53:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:53:58.774293 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4affd3d4-d012-4c15-847c-c64e4705669e None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:58.774811 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4affd3d4-d012-4c15-847c-c64e4705669e None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:58.774970 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4affd3d4-d012-4c15-847c-c64e4705669e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:58.794278 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-4affd3d4-d012-4c15-847c-c64e4705669e None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:53:58.795779 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-4affd3d4-d012-4c15-847c-c64e4705669e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:53:58.798237 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:58.862706 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f965462-c4df-4ecb-8a7b-6e153e0aedef None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:58.862879 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f965462-c4df-4ecb-8a7b-6e153e0aedef None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:58.863083 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f965462-c4df-4ecb-8a7b-6e153e0aedef None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:58.865687 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 457/914] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:53:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:53:58.870583 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e2306-0e30-47c6-910d-4c3d44edf068 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:58.870899 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e2306-0e30-47c6-910d-4c3d44edf068 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:58.871182 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e2306-0e30-47c6-910d-4c3d44edf068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:58.872470 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 458/915] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:53:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 11:53:58.888736 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-520e2306-0e30-47c6-910d-4c3d44edf068 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:53:58.889935 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-520e2306-0e30-47c6-910d-4c3d44edf068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:53:58.895289 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4affd3d4-d012-4c15-847c-c64e4705669e None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:58.940354 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:58.972865 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 458/916] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:53:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 11:53:58.987380 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520e2306-0e30-47c6-910d-4c3d44edf068 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:59.012232 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4affd3d4-d012-4c15-847c-c64e4705669e None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:59.051806 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f800564e-bb00-48b1-add1-88cff93428be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:59.052640 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800564e-bb00-48b1-add1-88cff93428be None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:59.052918 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800564e-bb00-48b1-add1-88cff93428be None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:59.053284 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800564e-bb00-48b1-add1-88cff93428be None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:59.054037 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f800564e-bb00-48b1-add1-88cff93428be None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:59.055737 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f800564e-bb00-48b1-add1-88cff93428be None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:59.068232 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-f800564e-bb00-48b1-add1-88cff93428be None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 08 11:53:59.068232 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:59.068232 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 11:53:59.068232 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 11:53:59.068232 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 11:53:59.068232 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 11:53:59.068232 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 11:53:59.068232 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 11:53:59.068232 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 08 11:53:59.068232 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:59.068232 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 11:53:59.068232 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:59.068232 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:59.068232 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:59.068232 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:59.068232 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:59.068232 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:59.069252 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:59.069252 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:59.069252 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:59.069252 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:59.069252 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:59.069252 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:59.069252 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 11:53:59.069252 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 11:53:59.069252 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 11:53:59.069252 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 11:53:59.069252 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:59.069252 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:59.069252 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:59.069252 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:59.069252 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:59.069252 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:59.070734 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:59.070734 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:59.070734 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:59.070734 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:59.070734 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:59.070734 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:59.070734 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:59.070734 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:59.070734 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:59.070734 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:59.070734 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 11:53:59.070734 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 11:53:59.070734 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 08 11:53:59.070734 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:59.070734 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 459/917] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Jun 8 11:53:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 11:53:59.077759 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f800564e-bb00-48b1-add1-88cff93428be None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:59.084388 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:59.100310 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520e2306-0e30-47c6-910d-4c3d44edf068 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:59.140057 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b459a8a9-c55c-48ce-b486-625de1068799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:59.141290 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459a8a9-c55c-48ce-b486-625de1068799 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:59.141785 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459a8a9-c55c-48ce-b486-625de1068799 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:59.142304 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459a8a9-c55c-48ce-b486-625de1068799 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:59.154126 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b459a8a9-c55c-48ce-b486-625de1068799 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:53:59.162917 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-b459a8a9-c55c-48ce-b486-625de1068799 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 08 11:53:59.162917 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:59.162917 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:59.162917 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:59.162917 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:59.162917 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:59.162917 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:59.162917 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:59.162917 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:59.162917 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:59.162917 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:59.162917 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:59.162917 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:53:59.162917 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:53:59.162917 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:53:59.162917 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:53:59.164655 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:53:59.164655 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:53:59.164655 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:53:59.164655 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:53:59.164655 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:59.164655 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:59.164655 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:59.164655 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:59.164655 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:59.164655 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:59.164655 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:59.164655 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:59.164655 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:59.164655 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:59.164655 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:59.164655 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:59.165539 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:59.165539 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:59.165539 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:59.165539 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:59.165539 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:53:59.165539 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:53:59.165539 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:53:59.165539 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:53:59.165539 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:53:59.165539 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:53:59.165539 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 08 11:53:59.165539 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:59.172276 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 459/918] 10.222.0.39 () {56 vars in 1120 bytes} [Wed Jun 8 11:53:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:59.174020 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b459a8a9-c55c-48ce-b486-625de1068799 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:59.208475 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f800564e-bb00-48b1-add1-88cff93428be None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:59.228216 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:59.255928 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200abe2d-cdea-43ea-8bdd-e942b0cf4a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:59.256652 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200abe2d-cdea-43ea-8bdd-e942b0cf4a46 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:59.256940 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200abe2d-cdea-43ea-8bdd-e942b0cf4a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:59.258087 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200abe2d-cdea-43ea-8bdd-e942b0cf4a46 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:59.258829 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200abe2d-cdea-43ea-8bdd-e942b0cf4a46 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:59.259132 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200abe2d-cdea-43ea-8bdd-e942b0cf4a46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:59.261196 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200abe2d-cdea-43ea-8bdd-e942b0cf4a46 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:59.274385 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 460/919] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Jun 8 11:53:59 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:59.275793 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200abe2d-cdea-43ea-8bdd-e942b0cf4a46 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:59.309825 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b459a8a9-c55c-48ce-b486-625de1068799 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:59.357695 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d89e1-e4ed-49c3-97b5-8b68e96cbccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:59.358395 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d89e1-e4ed-49c3-97b5-8b68e96cbccd None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:59.358685 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d89e1-e4ed-49c3-97b5-8b68e96cbccd None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:59.358949 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d89e1-e4ed-49c3-97b5-8b68e96cbccd None admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:59.359703 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d89e1-e4ed-49c3-97b5-8b68e96cbccd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:59.360016 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d89e1-e4ed-49c3-97b5-8b68e96cbccd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:59.361447 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d89e1-e4ed-49c3-97b5-8b68e96cbccd None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:59.367270 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:59.370007 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 460/920] 10.222.0.39 () {56 vars in 1115 bytes} [Wed Jun 8 11:53:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:53:59.371365 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719eadb9-1a78-4efe-be8c-012fb7659409 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:59.371653 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719eadb9-1a78-4efe-be8c-012fb7659409 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:59.371960 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719eadb9-1a78-4efe-be8c-012fb7659409 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:59.373428 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 461/921] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:53:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:53:59.376013 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719eadb9-1a78-4efe-be8c-012fb7659409 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:59.412234 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200abe2d-cdea-43ea-8bdd-e942b0cf4a46 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:59.450358 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedfb40f-19a4-4ac2-8bed-0bde87a2a50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:59.451030 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedfb40f-19a4-4ac2-8bed-0bde87a2a50e None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:59.451634 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedfb40f-19a4-4ac2-8bed-0bde87a2a50e None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:59.451634 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedfb40f-19a4-4ac2-8bed-0bde87a2a50e None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:59.452306 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedfb40f-19a4-4ac2-8bed-0bde87a2a50e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:59.452617 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedfb40f-19a4-4ac2-8bed-0bde87a2a50e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:59.453988 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedfb40f-19a4-4ac2-8bed-0bde87a2a50e None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:59.458944 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 461/922] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Jun 8 11:53:59 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:59.460264 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e905d6-cac1-4a7e-ae24-eeb776ce6c51 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:59.460624 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e905d6-cac1-4a7e-ae24-eeb776ce6c51 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:59.460910 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e905d6-cac1-4a7e-ae24-eeb776ce6c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:59.478094 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-e0e905d6-cac1-4a7e-ae24-eeb776ce6c51 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:53:59.479597 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-e0e905d6-cac1-4a7e-ae24-eeb776ce6c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:53:59.493051 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719eadb9-1a78-4efe-be8c-012fb7659409 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:59.495556 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:59.528609 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f62eb8b-0f91-4ce5-9936-d0eb5a1a6a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:59.529414 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62eb8b-0f91-4ce5-9936-d0eb5a1a6a30 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:59.529695 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62eb8b-0f91-4ce5-9936-d0eb5a1a6a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:59.529975 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62eb8b-0f91-4ce5-9936-d0eb5a1a6a30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:59.541564 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f62eb8b-0f91-4ce5-9936-d0eb5a1a6a30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:59.543010 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f62eb8b-0f91-4ce5-9936-d0eb5a1a6a30 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:59.560079 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-6f62eb8b-0f91-4ce5-9936-d0eb5a1a6a30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:59.560079 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:59.560079 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:59.560079 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:59.560079 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:59.560079 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:59.560079 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:59.560079 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:59.560079 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:59.560079 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:59.560079 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:59.560079 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:59.560079 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:53:59.560079 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:53:59.560079 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:53:59.568755 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:53:59.568755 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:59.568755 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:59.568755 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:59.568755 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:59.568755 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:59.568755 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:59.568755 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:59.568755 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:59.568755 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:59.568755 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:59.568755 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:59.568755 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:59.568755 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:59.568755 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:59.568755 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:59.568755 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:59.570197 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:53:59.570197 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:53:59.570197 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:53:59.570197 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:59.573789 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 462/923] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:53:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 11:53:59.573871 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 462/924] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:53:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 11:53:59.573939 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e905d6-cac1-4a7e-ae24-eeb776ce6c51 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:59.574008 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f62eb8b-0f91-4ce5-9936-d0eb5a1a6a30 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:59.632439 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:59.673250 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e905d6-cac1-4a7e-ae24-eeb776ce6c51 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:59.680591 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f62eb8b-0f91-4ce5-9936-d0eb5a1a6a30 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:59.706185 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8c32be-8336-4c22-8fb3-065a99503078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:59.706842 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c32be-8336-4c22-8fb3-065a99503078 None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:59.707121 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c32be-8336-4c22-8fb3-065a99503078 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:59.707394 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c32be-8336-4c22-8fb3-065a99503078 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:59.708122 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8c32be-8336-4c22-8fb3-065a99503078 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:59.709503 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8c32be-8336-4c22-8fb3-065a99503078 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:59.713866 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc2212-b643-4498-a9a5-0aa7e8bfbf04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:59.714530 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc2212-b643-4498-a9a5-0aa7e8bfbf04 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:59.714813 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc2212-b643-4498-a9a5-0aa7e8bfbf04 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:59.715090 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc2212-b643-4498-a9a5-0aa7e8bfbf04 None admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:59.715837 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defc2212-b643-4498-a9a5-0aa7e8bfbf04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:53:59.716142 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defc2212-b643-4498-a9a5-0aa7e8bfbf04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:59.717527 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defc2212-b643-4498-a9a5-0aa7e8bfbf04 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:59.728669 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 463/925] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Jun 8 11:53:59 2022] POST /identity/v3/endpoints => generated 346 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 11:53:59.729297 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8c32be-8336-4c22-8fb3-065a99503078 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:59.731525 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 463/926] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:53:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:53:59.733071 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da765982-a456-4eed-88a0-fc45f438001c None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:59.733364 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da765982-a456-4eed-88a0-fc45f438001c None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:59.733671 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da765982-a456-4eed-88a0-fc45f438001c None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:59.739225 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 464/927] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:53:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:53:59.740514 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da765982-a456-4eed-88a0-fc45f438001c None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:59.760507 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:59.864523 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da765982-a456-4eed-88a0-fc45f438001c None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:59.867476 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8c32be-8336-4c22-8fb3-065a99503078 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:53:59.881703 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:53:59.904022 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37037d74-80f7-496f-9228-9cd88d29f063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:59.904923 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37037d74-80f7-496f-9228-9cd88d29f063 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:59.905212 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37037d74-80f7-496f-9228-9cd88d29f063 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:59.905504 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37037d74-80f7-496f-9228-9cd88d29f063 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:59.910549 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44894b-f249-4922-a2ac-9feef8fe5d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:53:59.911675 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44894b-f249-4922-a2ac-9feef8fe5d25 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:59.912140 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44894b-f249-4922-a2ac-9feef8fe5d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:59.912630 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44894b-f249-4922-a2ac-9feef8fe5d25 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:59.913362 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d44894b-f249-4922-a2ac-9feef8fe5d25 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:59.914380 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37037d74-80f7-496f-9228-9cd88d29f063 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:53:59.915333 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d44894b-f249-4922-a2ac-9feef8fe5d25 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:59.915838 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37037d74-80f7-496f-9228-9cd88d29f063 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:53:59.929402 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-9d44894b-f249-4922-a2ac-9feef8fe5d25 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 11:53:59.929402 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:59.929402 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 11:53:59.929402 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 11:53:59.929402 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 11:53:59.929402 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 11:53:59.929402 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 11:53:59.929402 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 11:53:59.929402 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 11:53:59.929402 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:59.929402 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 11:53:59.929402 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:59.929402 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:59.929402 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:59.929402 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:59.929402 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:59.929402 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:59.930393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:59.930393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:59.930393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:59.930393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:59.930393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:59.930393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:59.930393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 11:53:59.930393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 11:53:59.930393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 11:53:59.930393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 11:53:59.930393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:59.930393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:59.930393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:59.930393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:59.930393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:59.930393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:59.931230 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:59.931230 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:59.931230 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:59.931230 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:59.931230 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:59.931230 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:59.931230 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:59.931230 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:59.931230 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:59.931230 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:59.931230 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 11:53:59.931230 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 11:53:59.931230 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 11:53:59.931230 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:53:59.931230 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 464/928] 10.222.0.39 () {56 vars in 1126 bytes} [Wed Jun 8 11:53:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:59.932045 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-37037d74-80f7-496f-9228-9cd88d29f063 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 08 11:53:59.932045 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:53:59.932045 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:53:59.932045 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:53:59.932045 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:53:59.932045 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:53:59.932045 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:53:59.932045 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:53:59.932045 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:53:59.932045 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:53:59.932045 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:53:59.932045 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:53:59.932045 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 11:53:59.932045 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 11:53:59.932045 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 11:53:59.932045 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 11:53:59.934331 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:53:59.934331 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:53:59.934331 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 11:53:59.934331 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:53:59.934331 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 11:53:59.934331 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:53:59.934331 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:53:59.934331 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:53:59.934331 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:53:59.934331 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:53:59.934331 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:53:59.934331 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:53:59.934331 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:53:59.934331 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:53:59.934331 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:53:59.934331 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:53:59.934331 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:53:59.934331 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:53:59.936529 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:53:59.936529 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:53:59.936529 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 11:53:59.936529 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 11:53:59.936529 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 11:53:59.936529 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 11:53:59.936529 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 11:53:59.936529 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 11:53:59.936529 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 08 11:53:59.936529 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:53:59.939668 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb37c8-bbee-4647-8961-457f35a194f1 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:53:59.939668 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb37c8-bbee-4647-8961-457f35a194f1 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:53:59.939668 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb37c8-bbee-4647-8961-457f35a194f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:53:59.940043 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 465/929] 10.222.0.39 () {56 vars in 1117 bytes} [Wed Jun 8 11:53:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:53:59.940043 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37037d74-80f7-496f-9228-9cd88d29f063 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:53:59.951432 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-7bfb37c8-bbee-4647-8961-457f35a194f1 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:53:59.952645 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-7bfb37c8-bbee-4647-8961-457f35a194f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:54:00.021939 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:00.030451 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 465/930] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:53:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 11:54:00.031378 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb37c8-bbee-4647-8961-457f35a194f1 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:00.064111 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37037d74-80f7-496f-9228-9cd88d29f063 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:00.100529 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b4c32-259a-40fb-a2b6-02ad7c6a951b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:00.101236 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b4c32-259a-40fb-a2b6-02ad7c6a951b None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:00.101704 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b4c32-259a-40fb-a2b6-02ad7c6a951b None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:00.101978 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b4c32-259a-40fb-a2b6-02ad7c6a951b None admin] PATH_INFO: `/v3/services` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:00.102678 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b4c32-259a-40fb-a2b6-02ad7c6a951b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:00.102990 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b4c32-259a-40fb-a2b6-02ad7c6a951b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:00.104411 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b4c32-259a-40fb-a2b6-02ad7c6a951b None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:00.114279 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 466/931] 10.222.0.39 () {56 vars in 1122 bytes} [Wed Jun 8 11:53:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:00.115021 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b4c32-259a-40fb-a2b6-02ad7c6a951b None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:00.136608 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb37c8-bbee-4647-8961-457f35a194f1 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:00.145085 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:00.174875 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a9fdc-9449-4b5c-ac4d-bfcb816aba1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:00.175559 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a9fdc-9449-4b5c-ac4d-bfcb816aba1e None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:00.175844 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a9fdc-9449-4b5c-ac4d-bfcb816aba1e None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:00.176124 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a9fdc-9449-4b5c-ac4d-bfcb816aba1e None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:00.176995 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366a9fdc-9449-4b5c-ac4d-bfcb816aba1e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:00.177310 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366a9fdc-9449-4b5c-ac4d-bfcb816aba1e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:00.178747 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366a9fdc-9449-4b5c-ac4d-bfcb816aba1e None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:00.197598 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 466/932] 10.222.0.39 () {56 vars in 1149 bytes} [Wed Jun 8 11:54:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:00.201138 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a9fdc-9449-4b5c-ac4d-bfcb816aba1e None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:00.223713 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b4c32-259a-40fb-a2b6-02ad7c6a951b None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:00.261696 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bbd34c-56ec-4eca-bfbb-57f7c21a1353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:00.262519 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbd34c-56ec-4eca-bfbb-57f7c21a1353 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:00.262804 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbd34c-56ec-4eca-bfbb-57f7c21a1353 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:00.263081 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbd34c-56ec-4eca-bfbb-57f7c21a1353 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:00.263740 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bbd34c-56ec-4eca-bfbb-57f7c21a1353 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:00.265155 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bbd34c-56ec-4eca-bfbb-57f7c21a1353 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:00.267860 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:00.280741 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-f5bbd34c-56ec-4eca-bfbb-57f7c21a1353 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 08 11:54:00.280741 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:00.280741 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 11:54:00.280741 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 11:54:00.280741 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 11:54:00.280741 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 11:54:00.280741 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 11:54:00.280741 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 11:54:00.280741 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 08 11:54:00.280741 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:54:00.280741 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 11:54:00.280741 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:54:00.280741 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:00.280741 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:54:00.280741 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:54:00.280741 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:54:00.281887 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:54:00.281887 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:54:00.281887 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:54:00.281887 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:54:00.281887 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:54:00.281887 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:54:00.281887 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:54:00.281887 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 11:54:00.281887 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 11:54:00.281887 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 11:54:00.281887 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 11:54:00.281887 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:54:00.281887 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:54:00.281887 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:54:00.281887 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:54:00.281887 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:54:00.282934 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:54:00.282934 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:54:00.282934 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:54:00.282934 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:54:00.282934 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:54:00.282934 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:54:00.282934 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:54:00.282934 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:54:00.282934 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:54:00.282934 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:54:00.282934 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:54:00.282934 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 11:54:00.282934 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 11:54:00.282934 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 08 11:54:00.282934 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:54:00.285358 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 467/933] 10.222.0.39 () {56 vars in 1132 bytes} [Wed Jun 8 11:54:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:54:00.286410 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bbd34c-56ec-4eca-bfbb-57f7c21a1353 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:00.312924 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a9fdc-9449-4b5c-ac4d-bfcb816aba1e None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:00.351651 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e3faa-7b96-4a45-8139-f6f1386937ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:00.352363 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e3faa-7b96-4a45-8139-f6f1386937ae None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:00.352654 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e3faa-7b96-4a45-8139-f6f1386937ae None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:00.352934 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e3faa-7b96-4a45-8139-f6f1386937ae None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:00.353647 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930e3faa-7b96-4a45-8139-f6f1386937ae None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:00.353958 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930e3faa-7b96-4a45-8139-f6f1386937ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:00.355331 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930e3faa-7b96-4a45-8139-f6f1386937ae None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:00.360436 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 467/934] 10.222.0.39 () {56 vars in 1122 bytes} [Wed Jun 8 11:54:00 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:00.361218 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e3faa-7b96-4a45-8139-f6f1386937ae None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:00.398329 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:00.408806 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bbd34c-56ec-4eca-bfbb-57f7c21a1353 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:00.444886 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf998461-26de-417d-aa8e-97206a3af5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:00.445764 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf998461-26de-417d-aa8e-97206a3af5fb None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:00.446084 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf998461-26de-417d-aa8e-97206a3af5fb None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:00.446364 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf998461-26de-417d-aa8e-97206a3af5fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:00.457330 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf998461-26de-417d-aa8e-97206a3af5fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:00.458723 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf998461-26de-417d-aa8e-97206a3af5fb None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:00.477619 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-bf998461-26de-417d-aa8e-97206a3af5fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:54:00.477619 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:00.477619 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:54:00.477619 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:54:00.477619 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:54:00.477619 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:54:00.477619 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:54:00.477619 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:54:00.477619 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:54:00.477619 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:54:00.477619 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:54:00.477619 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:54:00.477619 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:54:00.477619 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:54:00.477619 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:54:00.478556 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:54:00.478556 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:54:00.478556 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:54:00.478556 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:54:00.478556 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:54:00.478556 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:54:00.478556 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:54:00.478556 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:54:00.478556 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:54:00.478556 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:54:00.478556 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:54:00.478556 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:54:00.478556 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:54:00.478556 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:54:00.478556 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:54:00.478556 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:54:00.478556 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:54:00.479478 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:54:00.479478 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:54:00.479478 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:54:00.479478 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:54:00.479478 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 468/935] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:54:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:54:00.480274 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf998461-26de-417d-aa8e-97206a3af5fb None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:00.493041 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e3faa-7b96-4a45-8139-f6f1386937ae None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:00.529678 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9a551-c269-456f-a3cc-385bd2b4a4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:00.530346 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9a551-c269-456f-a3cc-385bd2b4a4b9 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:00.530629 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9a551-c269-456f-a3cc-385bd2b4a4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:00.530902 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9a551-c269-456f-a3cc-385bd2b4a4b9 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:00.531606 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e9a551-c269-456f-a3cc-385bd2b4a4b9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:00.531908 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e9a551-c269-456f-a3cc-385bd2b4a4b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:00.533312 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e9a551-c269-456f-a3cc-385bd2b4a4b9 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:00.538116 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 468/936] 10.222.0.39 () {56 vars in 1126 bytes} [Wed Jun 8 11:54:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:00.540594 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:00.544453 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9a551-c269-456f-a3cc-385bd2b4a4b9 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:00.598987 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf998461-26de-417d-aa8e-97206a3af5fb None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:00.638204 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534bc380-2036-4e5b-8c5d-cb19e420dbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:00.638864 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534bc380-2036-4e5b-8c5d-cb19e420dbbb None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:00.639148 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534bc380-2036-4e5b-8c5d-cb19e420dbbb None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:00.639420 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534bc380-2036-4e5b-8c5d-cb19e420dbbb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:00.640231 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534bc380-2036-4e5b-8c5d-cb19e420dbbb None admin] RBAC: Adding query filter params (interface=public, service_id=90b5af5944ee4e47944e491b626045f0, region_id=RegionOne) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:00.640543 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534bc380-2036-4e5b-8c5d-cb19e420dbbb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:00.641906 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534bc380-2036-4e5b-8c5d-cb19e420dbbb None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:00.646592 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:00.650400 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 469/937] 10.222.0.39 () {56 vars in 1251 bytes} [Wed Jun 8 11:54:00 2022] GET /identity/v3/endpoints?service_id=90b5af5944ee4e47944e491b626045f0&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:00.651201 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534bc380-2036-4e5b-8c5d-cb19e420dbbb None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:00.662060 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9a551-c269-456f-a3cc-385bd2b4a4b9 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:00.698060 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb8ed3-4bca-4966-8b8b-58348bb602b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:00.698727 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb8ed3-4bca-4966-8b8b-58348bb602b6 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:00.699015 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb8ed3-4bca-4966-8b8b-58348bb602b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:00.706627 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb8ed3-4bca-4966-8b8b-58348bb602b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:00.706627 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eb8ed3-4bca-4966-8b8b-58348bb602b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:00.706627 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eb8ed3-4bca-4966-8b8b-58348bb602b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:00.706627 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eb8ed3-4bca-4966-8b8b-58348bb602b6 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:00.717926 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 469/938] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:54:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:00.717926 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb8ed3-4bca-4966-8b8b-58348bb602b6 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:00.774648 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534bc380-2036-4e5b-8c5d-cb19e420dbbb None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:00.790437 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:00.808845 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed442c7-1b41-4122-a376-5e31c4d5270d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:00.809523 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed442c7-1b41-4122-a376-5e31c4d5270d None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:00.809809 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed442c7-1b41-4122-a376-5e31c4d5270d None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:00.810086 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed442c7-1b41-4122-a376-5e31c4d5270d None admin] PATH_INFO: `/v3/services` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:00.810788 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed442c7-1b41-4122-a376-5e31c4d5270d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:00.811100 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed442c7-1b41-4122-a376-5e31c4d5270d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:00.812498 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed442c7-1b41-4122-a376-5e31c4d5270d None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:00.817425 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 470/939] 10.222.0.39 () {56 vars in 1126 bytes} [Wed Jun 8 11:54:00 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:00.818207 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed442c7-1b41-4122-a376-5e31c4d5270d None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:00.835691 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb8ed3-4bca-4966-8b8b-58348bb602b6 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:00.872707 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e76f39-e549-492b-9e36-0d76bd06875a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:00.874056 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e76f39-e549-492b-9e36-0d76bd06875a None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:00.874520 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e76f39-e549-492b-9e36-0d76bd06875a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:00.874945 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e76f39-e549-492b-9e36-0d76bd06875a None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:00.875764 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e76f39-e549-492b-9e36-0d76bd06875a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:00.877298 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e76f39-e549-492b-9e36-0d76bd06875a None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:00.884097 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 470/940] 10.222.0.39 () {56 vars in 1087 bytes} [Wed Jun 8 11:54:00 2022] GET /identity/v3/services => generated 1497 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 11:54:00.885380 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e76f39-e549-492b-9e36-0d76bd06875a None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:00.922137 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:00.948069 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed442c7-1b41-4122-a376-5e31c4d5270d None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:00.988682 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8283e0-d971-4b66-ac6c-21a6a7a92cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:00.989424 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8283e0-d971-4b66-ac6c-21a6a7a92cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:00.989735 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8283e0-d971-4b66-ac6c-21a6a7a92cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:00.989995 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8283e0-d971-4b66-ac6c-21a6a7a92cc3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:00.998603 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8283e0-d971-4b66-ac6c-21a6a7a92cc3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:01.000147 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8283e0-d971-4b66-ac6c-21a6a7a92cc3 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:01.016571 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-9e8283e0-d971-4b66-ac6c-21a6a7a92cc3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:54:01.016571 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:01.016571 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:54:01.016571 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:54:01.016571 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:54:01.016571 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:54:01.016571 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:54:01.016571 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:54:01.016571 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:54:01.016571 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:54:01.016571 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:54:01.016571 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:54:01.016571 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 11:54:01.016571 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 11:54:01.016571 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 11:54:01.017589 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 11:54:01.017589 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:54:01.017589 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:54:01.017589 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:54:01.017589 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:54:01.017589 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:54:01.017589 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:54:01.017589 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:54:01.017589 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:54:01.017589 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:54:01.017589 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:54:01.017589 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:54:01.017589 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:54:01.017589 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:54:01.017589 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:54:01.017589 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:54:01.017589 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:54:01.018656 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 11:54:01.018656 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 11:54:01.018656 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 11:54:01.018656 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 11:54:01.018656 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 11:54:01.018656 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 11:54:01.018656 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:54:01.018656 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:54:01.018656 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 471/941] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Jun 8 11:54:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:54:01.024018 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8283e0-d971-4b66-ac6c-21a6a7a92cc3 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:01.056457 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e76f39-e549-492b-9e36-0d76bd06875a None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:01.081593 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:01.111409 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1418042-d565-450e-ad70-3e274a02ab5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:01.111936 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1418042-d565-450e-ad70-3e274a02ab5c None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:01.112249 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1418042-d565-450e-ad70-3e274a02ab5c None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:01.112530 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1418042-d565-450e-ad70-3e274a02ab5c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:01.113328 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1418042-d565-450e-ad70-3e274a02ab5c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:01.114754 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1418042-d565-450e-ad70-3e274a02ab5c None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:01.139607 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 471/942] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Jun 8 11:54:00 2022] POST /identity/v3/endpoints => generated 347 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 11:54:01.166333 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8283e0-d971-4b66-ac6c-21a6a7a92cc3 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:01.213152 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b04986-8c9b-4a56-bb71-04cffef05024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:01.214340 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b04986-8c9b-4a56-bb71-04cffef05024 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:01.214800 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b04986-8c9b-4a56-bb71-04cffef05024 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:01.215392 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b04986-8c9b-4a56-bb71-04cffef05024 None admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:01.216504 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b04986-8c9b-4a56-bb71-04cffef05024 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:01.217038 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b04986-8c9b-4a56-bb71-04cffef05024 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:01.218868 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b04986-8c9b-4a56-bb71-04cffef05024 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:01.234433 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 472/943] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Jun 8 11:54:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:54:01.241403 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1418042-d565-450e-ad70-3e274a02ab5c None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:01.322426 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:01.365594 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1418042-d565-450e-ad70-3e274a02ab5c None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:01.403107 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe23eb-117d-47ec-9d97-8b9cf5b40359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:01.404003 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe23eb-117d-47ec-9d97-8b9cf5b40359 None admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:01.404320 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe23eb-117d-47ec-9d97-8b9cf5b40359 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:01.404597 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe23eb-117d-47ec-9d97-8b9cf5b40359 None admin] PATH_INFO: `/v3/projects/6a7fee684e8b43e199c95aeeb92640d4/users/d52efc21c66d4300a8a979d92dbfeb47/roles/c19874f86dad4aa1bfa44ebf9eaf6de4` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:01.406748 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fe23eb-117d-47ec-9d97-8b9cf5b40359 None admin] RBAC: Authorizing `identity:create_grant(project_id=6a7fee684e8b43e199c95aeeb92640d4, user_id=d52efc21c66d4300a8a979d92dbfeb47, role_id=c19874f86dad4aa1bfa44ebf9eaf6de4)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:01.408199 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fe23eb-117d-47ec-9d97-8b9cf5b40359 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:01.423410 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 472/944] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Jun 8 11:54:01 2022] PUT /identity/v3/projects/6a7fee684e8b43e199c95aeeb92640d4/users/d52efc21c66d4300a8a979d92dbfeb47/roles/c19874f86dad4aa1bfa44ebf9eaf6de4 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 11:54:02.068677 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25ed38-8d84-49f1-b74d-df8fb80aa290 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:02.069211 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25ed38-8d84-49f1-b74d-df8fb80aa290 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:02.069211 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25ed38-8d84-49f1-b74d-df8fb80aa290 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:02.071541 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 473/945] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:54:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:54:02.077336 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357b152-dce9-4648-a699-3e44dda768e4 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:02.077776 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357b152-dce9-4648-a699-3e44dda768e4 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:02.077967 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357b152-dce9-4648-a699-3e44dda768e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:02.096709 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-b357b152-dce9-4648-a699-3e44dda768e4 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:54:02.098299 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b357b152-dce9-4648-a699-3e44dda768e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:54:02.180772 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 473/946] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:54:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 11:54:02.204629 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25ed38-8d84-49f1-b74d-df8fb80aa290 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:02.302370 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:02.309858 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25ed38-8d84-49f1-b74d-df8fb80aa290 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:02.345770 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c16b61-6b64-43b2-b102-5d31b30fbb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:02.346431 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c16b61-6b64-43b2-b102-5d31b30fbb7a None admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:02.346718 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c16b61-6b64-43b2-b102-5d31b30fbb7a None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:02.347022 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c16b61-6b64-43b2-b102-5d31b30fbb7a None admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:02.347994 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c16b61-6b64-43b2-b102-5d31b30fbb7a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:02.349493 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c16b61-6b64-43b2-b102-5d31b30fbb7a None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:02.351445 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: WARNING keystone.server.flask.common [None req-24c16b61-6b64-43b2-b102-5d31b30fbb7a None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 08 11:54:02.372754 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.sql.core [None req-24c16b61-6b64-43b2-b102-5d31b30fbb7a None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 08 11:54:02.372754 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 08 11:54:02.372754 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [parameters: {'id': 'd9bc91de2b1e475fbb8906c6ca7cf553', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 08 11:54:02.372754 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80216) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 08 11:54:02.391057 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-24c16b61-6b64-43b2-b102-5d31b30fbb7a None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d9bc91de2b1e475fbb8906c6ca7cf553.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d9bc91de2b1e475fbb8906c6ca7cf553. Jun 08 11:54:02.391057 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:02.391057 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 08 11:54:02.391057 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 08 11:54:02.391057 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 08 11:54:02.391057 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 08 11:54:02.391057 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 08 11:54:02.391057 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application result = self._query(query) Jun 08 11:54:02.391057 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 08 11:54:02.391057 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application conn.query(q) Jun 08 11:54:02.391057 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 08 11:54:02.391057 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 08 11:54:02.391057 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 08 11:54:02.391942 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application result.read() Jun 08 11:54:02.391942 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 08 11:54:02.391942 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 08 11:54:02.391942 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 08 11:54:02.391942 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 08 11:54:02.391942 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 08 11:54:02.391942 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 08 11:54:02.391942 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 08 11:54:02.391942 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 08 11:54:02.391942 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 08 11:54:02.391942 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:54:02.391942 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 08 11:54:02.391942 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:54:02.391942 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:02.391942 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 08 11:54:02.391942 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 08 11:54:02.391942 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 08 11:54:02.391942 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 08 11:54:02.392928 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 08 11:54:02.392928 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application next(self.gen) Jun 08 11:54:02.392928 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 08 11:54:02.392928 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application yield resource Jun 08 11:54:02.392928 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 08 11:54:02.392928 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application next(self.gen) Jun 08 11:54:02.392928 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 08 11:54:02.392928 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application self.session.rollback() Jun 08 11:54:02.392928 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 08 11:54:02.392928 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application self.force_reraise() Jun 08 11:54:02.392928 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 08 11:54:02.392928 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise self.value Jun 08 11:54:02.392928 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 08 11:54:02.392928 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 08 11:54:02.392928 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 08 11:54:02.392928 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application session.commit() Jun 08 11:54:02.392928 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 08 11:54:02.393807 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 08 11:54:02.393807 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 08 11:54:02.393807 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application self._prepare_impl() Jun 08 11:54:02.393807 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 08 11:54:02.393807 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application self.session.flush() Jun 08 11:54:02.393807 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 08 11:54:02.393807 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application self._flush(objects) Jun 08 11:54:02.393807 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 08 11:54:02.393807 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 08 11:54:02.393807 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 08 11:54:02.393807 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application compat.raise_( Jun 08 11:54:02.393807 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 08 11:54:02.393807 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception Jun 08 11:54:02.393807 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 08 11:54:02.393807 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application flush_context.execute() Jun 08 11:54:02.393807 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 08 11:54:02.393807 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rec.execute(self) Jun 08 11:54:02.394688 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 08 11:54:02.394688 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 08 11:54:02.394688 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 08 11:54:02.394688 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 08 11:54:02.394688 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 08 11:54:02.394688 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 08 11:54:02.394688 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 08 11:54:02.394688 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 08 11:54:02.394688 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 08 11:54:02.394688 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 08 11:54:02.394688 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 08 11:54:02.394688 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 08 11:54:02.394688 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 08 11:54:02.394688 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 08 11:54:02.394688 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 08 11:54:02.395466 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 08 11:54:02.395466 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 08 11:54:02.395466 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception Jun 08 11:54:02.395466 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 08 11:54:02.395466 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 08 11:54:02.395466 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 08 11:54:02.395466 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 08 11:54:02.395466 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 08 11:54:02.395466 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application result = self._query(query) Jun 08 11:54:02.395466 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 08 11:54:02.395466 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application conn.query(q) Jun 08 11:54:02.395466 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 08 11:54:02.395466 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 08 11:54:02.395466 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 08 11:54:02.395466 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application result.read() Jun 08 11:54:02.395466 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 08 11:54:02.395466 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 08 11:54:02.400620 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 08 11:54:02.400620 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 08 11:54:02.400620 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 08 11:54:02.400620 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 08 11:54:02.400620 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 08 11:54:02.400620 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 08 11:54:02.400620 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 08 11:54:02.400620 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 08 11:54:02.400620 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [parameters: {'id': 'd9bc91de2b1e475fbb8906c6ca7cf553', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 08 11:54:02.400620 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 08 11:54:02.400620 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:54:02.400620 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 11:54:02.400620 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:54:02.400620 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:02.400620 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 08 11:54:02.402303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 08 11:54:02.402303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 08 11:54:02.402303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 08 11:54:02.402303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 08 11:54:02.402303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:54:02.402303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 11:54:02.402303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:54:02.402303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:02.402303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:54:02.402303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:54:02.402303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:54:02.402303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:54:02.402303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:54:02.402303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:54:02.402303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:54:02.402303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:54:02.402303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:54:02.404359 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:54:02.404359 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 08 11:54:02.404359 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 08 11:54:02.404359 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:54:02.404359 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:54:02.404359 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 08 11:54:02.404359 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 08 11:54:02.404359 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d9bc91de2b1e475fbb8906c6ca7cf553. Jun 08 11:54:02.404359 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:54:02.404359 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 474/947] 10.222.0.39 () {60 vars in 1140 bytes} [Wed Jun 8 11:54:02 2022] POST /identity/v3/projects => generated 262 bytes in 189 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:54:02.405770 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b357b152-dce9-4648-a699-3e44dda768e4 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:02.466559 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:02.508081 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b357b152-dce9-4648-a699-3e44dda768e4 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:02.543830 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c24032-fcb5-498e-bc7d-0502d86c496f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:02.544671 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c24032-fcb5-498e-bc7d-0502d86c496f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:02.544961 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c24032-fcb5-498e-bc7d-0502d86c496f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:02.545243 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c24032-fcb5-498e-bc7d-0502d86c496f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:02.552417 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c24032-fcb5-498e-bc7d-0502d86c496f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:02.553871 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c24032-fcb5-498e-bc7d-0502d86c496f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:02.569155 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-97c24032-fcb5-498e-bc7d-0502d86c496f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:54:02.569155 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:02.569155 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:54:02.569155 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:54:02.569155 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:54:02.569155 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:54:02.569155 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:54:02.569155 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:54:02.569155 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:54:02.569155 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:54:02.569155 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:54:02.569155 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:54:02.569155 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 11:54:02.569155 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 11:54:02.569155 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 11:54:02.571331 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 11:54:02.571331 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:54:02.571331 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:54:02.571331 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:54:02.571331 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:54:02.571331 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:54:02.571331 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:54:02.571331 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:54:02.571331 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:54:02.571331 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:54:02.571331 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:54:02.571331 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:54:02.571331 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:54:02.571331 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:54:02.571331 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:54:02.571331 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:54:02.571331 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:54:02.573404 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 11:54:02.573404 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 11:54:02.573404 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 11:54:02.573404 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 11:54:02.573404 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 11:54:02.573404 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 11:54:02.573404 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:54:02.573404 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:54:02.573404 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 474/948] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Jun 8 11:54:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:54:02.582469 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c16b61-6b64-43b2-b102-5d31b30fbb7a None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:02.704361 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c16b61-6b64-43b2-b102-5d31b30fbb7a None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:02.740854 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4d983-fe8c-4f8e-a88d-f24e9110de3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:02.741425 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4d983-fe8c-4f8e-a88d-f24e9110de3d None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:02.742246 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4d983-fe8c-4f8e-a88d-f24e9110de3d None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:02.742525 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4d983-fe8c-4f8e-a88d-f24e9110de3d None admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:02.743301 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b4d983-fe8c-4f8e-a88d-f24e9110de3d None admin] RBAC: Adding query filter params (name=service) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:02.743611 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b4d983-fe8c-4f8e-a88d-f24e9110de3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:02.745283 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b4d983-fe8c-4f8e-a88d-f24e9110de3d None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:02.766362 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 475/949] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Jun 8 11:54:02 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:03.293374 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222fd16-c2cf-4f93-a8cb-56e5233238d0 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:03.293374 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222fd16-c2cf-4f93-a8cb-56e5233238d0 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:03.293374 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222fd16-c2cf-4f93-a8cb-56e5233238d0 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:03.294620 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 475/950] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:54:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:54:03.302178 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a392f-a480-4e08-9dce-c909dd37901e None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:03.302178 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a392f-a480-4e08-9dce-c909dd37901e None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:03.302178 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a392f-a480-4e08-9dce-c909dd37901e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:03.319984 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-f62a392f-a480-4e08-9dce-c909dd37901e None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:54:03.321851 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-f62a392f-a480-4e08-9dce-c909dd37901e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:54:03.330628 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:03.404378 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 476/951] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:54:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 11:54:03.432686 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5222fd16-c2cf-4f93-a8cb-56e5233238d0 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:03.544967 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5222fd16-c2cf-4f93-a8cb-56e5233238d0 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:03.569650 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:03.570598 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8306726-9062-4530-944b-348436aa7216 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:03.570915 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8306726-9062-4530-944b-348436aa7216 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:03.571202 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8306726-9062-4530-944b-348436aa7216 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:03.576369 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 477/952] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:54:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:54:03.579923 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89b0b5-040b-4c9d-aedb-b05ce08bfebf None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:03.580245 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89b0b5-040b-4c9d-aedb-b05ce08bfebf None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:03.580608 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89b0b5-040b-4c9d-aedb-b05ce08bfebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:03.599009 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42492a3c-0beb-4eb0-9208-b958c9b5f346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:03.599835 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42492a3c-0beb-4eb0-9208-b958c9b5f346 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:03.600118 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42492a3c-0beb-4eb0-9208-b958c9b5f346 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:03.600517 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42492a3c-0beb-4eb0-9208-b958c9b5f346 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:03.601612 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42492a3c-0beb-4eb0-9208-b958c9b5f346 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:03.603132 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42492a3c-0beb-4eb0-9208-b958c9b5f346 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:03.606692 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-ac89b0b5-040b-4c9d-aedb-b05ce08bfebf None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:54:03.608474 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-ac89b0b5-040b-4c9d-aedb-b05ce08bfebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:54:03.617786 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-42492a3c-0beb-4eb0-9208-b958c9b5f346 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 11:54:03.617786 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:03.617786 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 11:54:03.617786 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 11:54:03.617786 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 11:54:03.617786 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 11:54:03.617786 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 11:54:03.617786 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 11:54:03.617786 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 11:54:03.617786 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:54:03.617786 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 11:54:03.617786 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:54:03.617786 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:03.617786 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:54:03.617786 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:54:03.617786 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:54:03.617786 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:54:03.618942 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:54:03.618942 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:54:03.618942 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:54:03.618942 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:54:03.618942 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:54:03.618942 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:54:03.618942 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 11:54:03.618942 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 11:54:03.618942 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 11:54:03.618942 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 11:54:03.618942 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:54:03.618942 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:54:03.618942 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:54:03.618942 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:54:03.618942 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:54:03.618942 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:54:03.619841 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:54:03.619841 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:54:03.619841 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:54:03.619841 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:54:03.619841 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:54:03.619841 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:54:03.619841 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:54:03.619841 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:54:03.619841 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:54:03.619841 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:54:03.619841 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 11:54:03.619841 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 11:54:03.619841 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 11:54:03.619841 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:54:03.619841 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 476/953] 10.222.0.39 () {56 vars in 1126 bytes} [Wed Jun 8 11:54:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:54:03.625050 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42492a3c-0beb-4eb0-9208-b958c9b5f346 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:03.704085 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 478/954] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:54:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 11:54:03.727656 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac89b0b5-040b-4c9d-aedb-b05ce08bfebf None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:03.735847 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42492a3c-0beb-4eb0-9208-b958c9b5f346 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:03.777849 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7beebf-806f-48b7-a2b7-d8ab683b4519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:03.778518 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7beebf-806f-48b7-a2b7-d8ab683b4519 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:03.778801 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7beebf-806f-48b7-a2b7-d8ab683b4519 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:03.779074 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7beebf-806f-48b7-a2b7-d8ab683b4519 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:03.779801 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7beebf-806f-48b7-a2b7-d8ab683b4519 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:03.780108 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7beebf-806f-48b7-a2b7-d8ab683b4519 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:03.781738 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7beebf-806f-48b7-a2b7-d8ab683b4519 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:03.792511 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 477/955] 10.222.0.39 () {56 vars in 1122 bytes} [Wed Jun 8 11:54:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:03.794194 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3380ed-30c1-46d9-8e18-b99828c6277a None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:03.794337 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3380ed-30c1-46d9-8e18-b99828c6277a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:03.794602 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3380ed-30c1-46d9-8e18-b99828c6277a None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:03.796370 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 478/956] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:54:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:54:03.796864 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3380ed-30c1-46d9-8e18-b99828c6277a None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:03.808920 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:03.840187 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac89b0b5-040b-4c9d-aedb-b05ce08bfebf None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:03.855462 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:03.879373 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c1fe0-1568-439e-b992-a3e69c762f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:03.880212 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c1fe0-1568-439e-b992-a3e69c762f0c None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:03.880508 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c1fe0-1568-439e-b992-a3e69c762f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:03.880787 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c1fe0-1568-439e-b992-a3e69c762f0c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:03.881443 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981c1fe0-1568-439e-b992-a3e69c762f0c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:03.883527 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981c1fe0-1568-439e-b992-a3e69c762f0c None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:03.896361 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-981c1fe0-1568-439e-b992-a3e69c762f0c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 08 11:54:03.896361 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:03.896361 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 11:54:03.896361 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 11:54:03.896361 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 11:54:03.896361 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 11:54:03.896361 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 11:54:03.896361 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 11:54:03.896361 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 08 11:54:03.896361 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:54:03.896361 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 11:54:03.896361 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:54:03.896361 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:03.896361 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:54:03.896361 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:54:03.896361 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:54:03.896361 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:54:03.897647 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:54:03.897647 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:54:03.897647 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:54:03.897647 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:54:03.897647 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:54:03.897647 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:54:03.897647 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 11:54:03.897647 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 11:54:03.897647 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 11:54:03.897647 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 11:54:03.897647 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:54:03.897647 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:54:03.897647 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:54:03.897647 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:54:03.897647 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:54:03.897647 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:54:03.899467 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:54:03.899467 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:54:03.899467 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:54:03.899467 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:54:03.899467 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:54:03.899467 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:54:03.899467 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:54:03.899467 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:54:03.899467 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:54:03.899467 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:54:03.899467 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 11:54:03.899467 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 11:54:03.899467 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 08 11:54:03.899467 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:54:03.899467 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 479/957] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Jun 8 11:54:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 11:54:03.900576 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e64d5-220e-468d-8112-3c78e0c0ebf8 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:03.900576 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e64d5-220e-468d-8112-3c78e0c0ebf8 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:03.900576 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e64d5-220e-468d-8112-3c78e0c0ebf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:03.915014 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3380ed-30c1-46d9-8e18-b99828c6277a None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:03.918335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-3f3e64d5-220e-468d-8112-3c78e0c0ebf8 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:54:03.919628 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-3f3e64d5-220e-468d-8112-3c78e0c0ebf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:54:03.953969 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199652b0-83fb-467e-9302-bc3d2bfb4117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:03.954636 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199652b0-83fb-467e-9302-bc3d2bfb4117 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:03.954927 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199652b0-83fb-467e-9302-bc3d2bfb4117 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:03.955186 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199652b0-83fb-467e-9302-bc3d2bfb4117 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:03.955887 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199652b0-83fb-467e-9302-bc3d2bfb4117 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:03.956207 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199652b0-83fb-467e-9302-bc3d2bfb4117 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:03.957577 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199652b0-83fb-467e-9302-bc3d2bfb4117 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:03.968433 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 479/958] 10.222.0.39 () {56 vars in 1122 bytes} [Wed Jun 8 11:54:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:03.968433 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199652b0-83fb-467e-9302-bc3d2bfb4117 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:03.997082 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 480/959] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:54:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 11:54:03.998104 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e64d5-220e-468d-8112-3c78e0c0ebf8 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:04.068398 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:04.092200 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199652b0-83fb-467e-9302-bc3d2bfb4117 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:04.105574 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e64d5-220e-468d-8112-3c78e0c0ebf8 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:04.108845 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:04.130971 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea248f1b-ca2b-439c-86f8-405566b9543d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:04.131646 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea248f1b-ca2b-439c-86f8-405566b9543d None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:04.131930 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea248f1b-ca2b-439c-86f8-405566b9543d None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:04.132359 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea248f1b-ca2b-439c-86f8-405566b9543d None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:04.133160 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea248f1b-ca2b-439c-86f8-405566b9543d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:04.133474 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea248f1b-ca2b-439c-86f8-405566b9543d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:04.134851 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea248f1b-ca2b-439c-86f8-405566b9543d None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:04.139804 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 480/960] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Jun 8 11:54:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:04.140619 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea248f1b-ca2b-439c-86f8-405566b9543d None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:04.146948 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a666f30-ad1b-4470-90e1-686987b94a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:04.148700 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a666f30-ad1b-4470-90e1-686987b94a9b None admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:04.148700 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a666f30-ad1b-4470-90e1-686987b94a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:04.148880 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a666f30-ad1b-4470-90e1-686987b94a9b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:04.149592 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a666f30-ad1b-4470-90e1-686987b94a9b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:04.150962 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a666f30-ad1b-4470-90e1-686987b94a9b None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:04.170404 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 481/961] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Jun 8 11:54:03 2022] POST /identity/v3/endpoints => generated 349 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 11:54:04.171231 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a666f30-ad1b-4470-90e1-686987b94a9b None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:04.294731 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea248f1b-ca2b-439c-86f8-405566b9543d None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:04.314480 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a666f30-ad1b-4470-90e1-686987b94a9b None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:04.334276 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:04.352765 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b99d7-9520-4c3d-ae3d-b4d25d452394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:04.354637 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b99d7-9520-4c3d-ae3d-b4d25d452394 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:04.355086 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b99d7-9520-4c3d-ae3d-b4d25d452394 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:04.355519 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b99d7-9520-4c3d-ae3d-b4d25d452394 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:04.358437 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce0f7b-2d1b-403c-b468-570983a9fcd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:04.359248 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce0f7b-2d1b-403c-b468-570983a9fcd1 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:04.359679 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce0f7b-2d1b-403c-b468-570983a9fcd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:04.359995 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce0f7b-2d1b-403c-b468-570983a9fcd1 None admin] PATH_INFO: `/v3/services` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:04.360851 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce0f7b-2d1b-403c-b468-570983a9fcd1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:04.361258 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce0f7b-2d1b-403c-b468-570983a9fcd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:04.362895 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce0f7b-2d1b-403c-b468-570983a9fcd1 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:04.369224 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 482/962] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Jun 8 11:54:04 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:04.370580 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b99d7-9520-4c3d-ae3d-b4d25d452394 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:54:04.379063 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-916b99d7-9520-4c3d-ae3d-b4d25d452394 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 08 11:54:04.379063 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:04.379063 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:54:04.379063 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:54:04.379063 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:54:04.379063 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:54:04.379063 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:54:04.379063 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:54:04.379063 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:54:04.379063 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:54:04.379063 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:54:04.379063 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:54:04.379063 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:54:04.379063 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:54:04.379063 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:54:04.379063 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:54:04.380100 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:54:04.380100 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:54:04.380100 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:54:04.380100 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:54:04.380100 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:54:04.380100 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:54:04.380100 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:54:04.380100 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:54:04.380100 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:54:04.380100 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:54:04.380100 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:54:04.380100 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:54:04.380100 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:54:04.380100 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:54:04.380100 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:54:04.380100 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:54:04.381323 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:54:04.381323 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:54:04.381323 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:54:04.381323 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:54:04.381323 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:54:04.381323 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:54:04.381323 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:54:04.381323 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:54:04.381323 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:54:04.381323 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:54:04.381323 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 08 11:54:04.381323 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:54:04.381323 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 481/963] 10.222.0.39 () {56 vars in 1120 bytes} [Wed Jun 8 11:54:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:54:04.387720 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce0f7b-2d1b-403c-b468-570983a9fcd1 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:04.505660 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce0f7b-2d1b-403c-b468-570983a9fcd1 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:04.546550 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fdcc7c-a2ec-4397-be45-7751de85ea59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:04.547536 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fdcc7c-a2ec-4397-be45-7751de85ea59 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:04.547978 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fdcc7c-a2ec-4397-be45-7751de85ea59 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:04.548443 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fdcc7c-a2ec-4397-be45-7751de85ea59 None admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:04.549360 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fdcc7c-a2ec-4397-be45-7751de85ea59 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:04.549824 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fdcc7c-a2ec-4397-be45-7751de85ea59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:04.551402 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fdcc7c-a2ec-4397-be45-7751de85ea59 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:04.562439 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 483/964] 10.222.0.39 () {56 vars in 1115 bytes} [Wed Jun 8 11:54:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:04.568331 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b99d7-9520-4c3d-ae3d-b4d25d452394 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:04.623127 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:04.690405 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b99d7-9520-4c3d-ae3d-b4d25d452394 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:04.727166 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecffbf5-9ba6-4e45-9907-89358ffe5988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:04.727975 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecffbf5-9ba6-4e45-9907-89358ffe5988 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:04.728301 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecffbf5-9ba6-4e45-9907-89358ffe5988 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:04.728579 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecffbf5-9ba6-4e45-9907-89358ffe5988 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:04.744736 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecffbf5-9ba6-4e45-9907-89358ffe5988 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:04.746548 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecffbf5-9ba6-4e45-9907-89358ffe5988 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:04.764601 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-3ecffbf5-9ba6-4e45-9907-89358ffe5988 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:54:04.764601 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:04.764601 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:54:04.764601 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:54:04.764601 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:54:04.764601 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:54:04.764601 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:54:04.764601 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:54:04.764601 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:54:04.764601 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:54:04.764601 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:54:04.764601 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:54:04.764601 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:54:04.764601 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:54:04.764601 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:54:04.765561 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:54:04.765561 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:54:04.765561 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:54:04.765561 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:54:04.765561 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:54:04.765561 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:54:04.765561 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:54:04.765561 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:54:04.765561 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:54:04.765561 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:54:04.765561 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:54:04.765561 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:54:04.765561 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:54:04.765561 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:54:04.765561 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:54:04.765561 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:54:04.765561 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:54:04.766577 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:54:04.766577 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:54:04.766577 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:54:04.766577 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:54:04.768293 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 482/965] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:54:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:54:04.774826 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fdcc7c-a2ec-4397-be45-7751de85ea59 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:04.825935 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:04.894289 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fdcc7c-a2ec-4397-be45-7751de85ea59 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:04.930558 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa7447a-e72d-4dec-9f63-dd846465df85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:04.931396 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7447a-e72d-4dec-9f63-dd846465df85 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:04.931794 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7447a-e72d-4dec-9f63-dd846465df85 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:04.932192 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7447a-e72d-4dec-9f63-dd846465df85 None admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:04.933072 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa7447a-e72d-4dec-9f63-dd846465df85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:04.933489 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa7447a-e72d-4dec-9f63-dd846465df85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:04.934999 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa7447a-e72d-4dec-9f63-dd846465df85 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:04.948997 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 484/966] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:54:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:04.957273 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecffbf5-9ba6-4e45-9907-89358ffe5988 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:05.053539 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:05.065055 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecffbf5-9ba6-4e45-9907-89358ffe5988 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:05.101474 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40926e5-5004-4d45-996e-9c88e68a9d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:05.102584 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40926e5-5004-4d45-996e-9c88e68a9d66 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:05.103018 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40926e5-5004-4d45-996e-9c88e68a9d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:05.103439 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40926e5-5004-4d45-996e-9c88e68a9d66 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:05.111681 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40926e5-5004-4d45-996e-9c88e68a9d66 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:05.113349 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40926e5-5004-4d45-996e-9c88e68a9d66 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:05.128303 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-b40926e5-5004-4d45-996e-9c88e68a9d66 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 08 11:54:05.128303 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:05.128303 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:54:05.128303 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:54:05.128303 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:54:05.128303 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:54:05.128303 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:54:05.128303 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:54:05.128303 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:54:05.128303 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:54:05.128303 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:54:05.128303 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:54:05.128303 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 11:54:05.128303 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 11:54:05.128303 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 11:54:05.128303 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 11:54:05.129481 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:54:05.129481 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:54:05.129481 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 11:54:05.129481 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:54:05.129481 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 11:54:05.129481 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:54:05.129481 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:54:05.129481 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:54:05.129481 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:54:05.129481 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:54:05.129481 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:54:05.129481 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:54:05.129481 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:54:05.129481 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:54:05.129481 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:54:05.129481 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:54:05.129481 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:54:05.129481 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:54:05.130730 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:54:05.130730 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:54:05.130730 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 11:54:05.130730 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 11:54:05.130730 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 11:54:05.130730 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 11:54:05.130730 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 11:54:05.130730 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 11:54:05.130730 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 08 11:54:05.130730 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:54:05.133423 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 483/967] 10.222.0.39 () {56 vars in 1117 bytes} [Wed Jun 8 11:54:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:54:05.144193 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa7447a-e72d-4dec-9f63-dd846465df85 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:05.193339 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058616b-f82c-4295-833e-701a2e04ed82 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:05.193873 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058616b-f82c-4295-833e-701a2e04ed82 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:05.194151 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058616b-f82c-4295-833e-701a2e04ed82 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:05.196281 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 484/968] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:54:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 11:54:05.201197 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0cccb-be27-4805-85b9-1c0ac3e0fdfb None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:05.201487 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0cccb-be27-4805-85b9-1c0ac3e0fdfb None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:05.201765 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0cccb-be27-4805-85b9-1c0ac3e0fdfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:05.219969 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-19e0cccb-be27-4805-85b9-1c0ac3e0fdfb None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:54:05.221331 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-19e0cccb-be27-4805-85b9-1c0ac3e0fdfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:54:05.258010 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa7447a-e72d-4dec-9f63-dd846465df85 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:05.261878 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:05.302291 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 485/969] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:54:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 11:54:05.309089 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76468220-e3c0-4592-a6cb-fc07cb8dd325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:05.313690 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76468220-e3c0-4592-a6cb-fc07cb8dd325 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:05.313690 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76468220-e3c0-4592-a6cb-fc07cb8dd325 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:05.313690 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76468220-e3c0-4592-a6cb-fc07cb8dd325 None admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:05.313690 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76468220-e3c0-4592-a6cb-fc07cb8dd325 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:05.313690 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76468220-e3c0-4592-a6cb-fc07cb8dd325 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:05.313690 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76468220-e3c0-4592-a6cb-fc07cb8dd325 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:05.329532 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0cccb-be27-4805-85b9-1c0ac3e0fdfb None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:05.333688 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 485/970] 10.222.0.39 () {56 vars in 1149 bytes} [Wed Jun 8 11:54:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:05.341716 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76468220-e3c0-4592-a6cb-fc07cb8dd325 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:05.423184 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:05.445360 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0cccb-be27-4805-85b9-1c0ac3e0fdfb None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:05.449898 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76468220-e3c0-4592-a6cb-fc07cb8dd325 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:05.483481 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beda076-be58-46bf-b32f-4791a5530d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:05.484745 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beda076-be58-46bf-b32f-4791a5530d72 None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:05.485421 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beda076-be58-46bf-b32f-4791a5530d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:05.485885 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beda076-be58-46bf-b32f-4791a5530d72 None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:05.485995 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2668bfe9-a616-4193-8370-ea8ba766c9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:05.486730 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668bfe9-a616-4193-8370-ea8ba766c9b6 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:05.487089 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668bfe9-a616-4193-8370-ea8ba766c9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:05.487293 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beda076-be58-46bf-b32f-4791a5530d72 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:05.487503 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668bfe9-a616-4193-8370-ea8ba766c9b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:05.489210 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beda076-be58-46bf-b32f-4791a5530d72 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:05.490733 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: WARNING keystone.server.flask.common [None req-3beda076-be58-46bf-b32f-4791a5530d72 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 08 11:54:05.506542 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.sql.core [None req-3beda076-be58-46bf-b32f-4791a5530d72 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 08 11:54:05.506542 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 08 11:54:05.506542 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [parameters: {'user_id': '5cfd5d8b24d84edb84bee84a38c7a8ac', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 08 11:54:05.506542 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80217) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 08 11:54:05.518433 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-3beda076-be58-46bf-b32f-4791a5530d72 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 08 11:54:05.518433 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:05.518433 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 08 11:54:05.518433 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 08 11:54:05.518433 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 08 11:54:05.518433 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 08 11:54:05.518433 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 08 11:54:05.518433 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application result = self._query(query) Jun 08 11:54:05.518433 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 08 11:54:05.518433 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application conn.query(q) Jun 08 11:54:05.518433 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 08 11:54:05.518433 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 08 11:54:05.518433 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 08 11:54:05.518433 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application result.read() Jun 08 11:54:05.518433 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 08 11:54:05.519377 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 08 11:54:05.519377 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 08 11:54:05.519377 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 08 11:54:05.519377 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 08 11:54:05.519377 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 08 11:54:05.519377 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 08 11:54:05.519377 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 08 11:54:05.519377 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 08 11:54:05.519377 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:54:05.519377 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 08 11:54:05.519377 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:54:05.519377 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:05.519377 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 08 11:54:05.519377 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 08 11:54:05.519377 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 08 11:54:05.519377 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 08 11:54:05.519377 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 08 11:54:05.519377 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application next(self.gen) Jun 08 11:54:05.520393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 08 11:54:05.520393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application yield resource Jun 08 11:54:05.520393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 08 11:54:05.520393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application next(self.gen) Jun 08 11:54:05.520393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 08 11:54:05.520393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self.session.rollback() Jun 08 11:54:05.520393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 08 11:54:05.520393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self.force_reraise() Jun 08 11:54:05.520393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 08 11:54:05.520393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise self.value Jun 08 11:54:05.520393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 08 11:54:05.520393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 08 11:54:05.520393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 08 11:54:05.520393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application session.commit() Jun 08 11:54:05.520393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 08 11:54:05.520393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 08 11:54:05.520393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 08 11:54:05.521288 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._prepare_impl() Jun 08 11:54:05.521288 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 08 11:54:05.521288 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self.session.flush() Jun 08 11:54:05.521288 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 08 11:54:05.521288 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._flush(objects) Jun 08 11:54:05.521288 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 08 11:54:05.521288 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 08 11:54:05.521288 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 08 11:54:05.521288 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application compat.raise_( Jun 08 11:54:05.521288 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 08 11:54:05.521288 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception Jun 08 11:54:05.521288 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 08 11:54:05.521288 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application flush_context.execute() Jun 08 11:54:05.521288 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 08 11:54:05.521288 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rec.execute(self) Jun 08 11:54:05.521288 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 08 11:54:05.521288 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 08 11:54:05.522194 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 08 11:54:05.522194 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 08 11:54:05.522194 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 08 11:54:05.522194 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 08 11:54:05.522194 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 08 11:54:05.522194 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 08 11:54:05.522194 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 08 11:54:05.522194 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 08 11:54:05.522194 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 08 11:54:05.522194 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 08 11:54:05.522194 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 08 11:54:05.522194 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 08 11:54:05.522194 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 08 11:54:05.522194 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 08 11:54:05.522194 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 08 11:54:05.522194 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception Jun 08 11:54:05.523791 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 08 11:54:05.523791 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 08 11:54:05.523791 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 08 11:54:05.523791 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 08 11:54:05.523791 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 08 11:54:05.523791 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application result = self._query(query) Jun 08 11:54:05.523791 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 08 11:54:05.523791 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application conn.query(q) Jun 08 11:54:05.523791 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 08 11:54:05.523791 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 08 11:54:05.523791 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 08 11:54:05.523791 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application result.read() Jun 08 11:54:05.523791 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 08 11:54:05.523791 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 08 11:54:05.523791 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 08 11:54:05.523791 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 08 11:54:05.526546 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 08 11:54:05.526546 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 08 11:54:05.526546 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 08 11:54:05.526546 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 08 11:54:05.526546 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 08 11:54:05.526546 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 08 11:54:05.526546 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [parameters: {'user_id': '5cfd5d8b24d84edb84bee84a38c7a8ac', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 08 11:54:05.526546 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 08 11:54:05.526546 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:54:05.526546 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 11:54:05.526546 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:54:05.526546 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:05.526546 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:54:05.526546 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:54:05.526546 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:54:05.529058 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:54:05.529058 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:54:05.529058 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:54:05.529058 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:54:05.529058 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:54:05.529058 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:54:05.529058 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:54:05.529058 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 08 11:54:05.529058 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 08 11:54:05.529058 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:54:05.529058 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:54:05.529058 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 11:54:05.529058 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:54:05.529058 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 11:54:05.529058 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:54:05.529058 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 08 11:54:05.529058 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 08 11:54:05.531754 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 08 11:54:05.531754 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 08 11:54:05.531754 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 08 11:54:05.531754 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 08 11:54:05.531754 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 08 11:54:05.531754 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:54:05.531754 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 486/971] 10.222.0.39 () {60 vars in 1131 bytes} [Wed Jun 8 11:54:05 2022] POST /identity/v3/users => generated 160 bytes in 198 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:54:05.531754 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beda076-be58-46bf-b32f-4791a5530d72 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:05.533942 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:05.576692 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2668bfe9-a616-4193-8370-ea8ba766c9b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:05.578083 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2668bfe9-a616-4193-8370-ea8ba766c9b6 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:05.682579 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beda076-be58-46bf-b32f-4791a5530d72 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:05.696418 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 486/972] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:54:05 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 08 11:54:05.696900 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2668bfe9-a616-4193-8370-ea8ba766c9b6 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:05.728390 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47d976-3004-4502-baff-1d2f3f231bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:05.729196 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47d976-3004-4502-baff-1d2f3f231bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:05.729482 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47d976-3004-4502-baff-1d2f3f231bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:05.729754 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47d976-3004-4502-baff-1d2f3f231bf5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:05.738051 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e47d976-3004-4502-baff-1d2f3f231bf5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:05.739687 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e47d976-3004-4502-baff-1d2f3f231bf5 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:05.755322 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-7e47d976-3004-4502-baff-1d2f3f231bf5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 08 11:54:05.755322 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:05.755322 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:54:05.755322 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:54:05.755322 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:54:05.755322 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:54:05.755322 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:54:05.755322 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:54:05.755322 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:54:05.755322 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:54:05.755322 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:54:05.755322 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:54:05.755322 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 11:54:05.755322 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 11:54:05.755322 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 11:54:05.755322 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 11:54:05.756340 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:54:05.756340 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:54:05.756340 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 11:54:05.756340 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:54:05.756340 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 11:54:05.756340 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:54:05.756340 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:54:05.756340 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:54:05.756340 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:54:05.756340 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:54:05.756340 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:54:05.756340 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:54:05.756340 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:54:05.756340 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:54:05.756340 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:54:05.756340 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:54:05.756340 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:54:05.756340 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:54:05.757366 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:54:05.757366 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:54:05.757366 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 11:54:05.757366 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 11:54:05.757366 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 11:54:05.757366 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 11:54:05.757366 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 11:54:05.757366 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 11:54:05.757366 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 08 11:54:05.757366 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:54:05.761592 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 487/973] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:54:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:54:05.762910 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47d976-3004-4502-baff-1d2f3f231bf5 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:05.766045 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:05.787529 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:05.839251 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2668bfe9-a616-4193-8370-ea8ba766c9b6 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:05.877305 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e1886-d6ad-43c5-a37b-37c039b34678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:05.878038 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e1886-d6ad-43c5-a37b-37c039b34678 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:05.878324 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e1886-d6ad-43c5-a37b-37c039b34678 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:05.878604 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e1886-d6ad-43c5-a37b-37c039b34678 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:05.887239 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47d976-3004-4502-baff-1d2f3f231bf5 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:05.890613 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1e1886-d6ad-43c5-a37b-37c039b34678 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:05.891541 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1e1886-d6ad-43c5-a37b-37c039b34678 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:05.910443 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-9b1e1886-d6ad-43c5-a37b-37c039b34678 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:54:05.910443 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:05.910443 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:54:05.910443 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:54:05.910443 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:54:05.910443 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:54:05.910443 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:54:05.910443 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:54:05.910443 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:54:05.910443 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:54:05.910443 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:54:05.910443 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:54:05.910443 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:54:05.910443 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:54:05.910443 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:54:05.911401 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:54:05.911401 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:54:05.911401 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:54:05.911401 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:54:05.911401 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:54:05.911401 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:54:05.911401 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:54:05.911401 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:54:05.911401 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:54:05.911401 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:54:05.911401 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:54:05.911401 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:54:05.911401 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:54:05.911401 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:54:05.911401 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:54:05.911401 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:54:05.911401 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:54:05.912353 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:54:05.912353 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:54:05.912353 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:54:05.912353 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:54:05.916464 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 487/974] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:54:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:54:05.917761 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e1886-d6ad-43c5-a37b-37c039b34678 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:05.927642 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba0446-5376-4b1c-86f7-1fb6b0b888d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:05.928696 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba0446-5376-4b1c-86f7-1fb6b0b888d7 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:05.929244 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba0446-5376-4b1c-86f7-1fb6b0b888d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:05.929737 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba0446-5376-4b1c-86f7-1fb6b0b888d7 None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:05.930761 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba0446-5376-4b1c-86f7-1fb6b0b888d7 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:05.931287 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba0446-5376-4b1c-86f7-1fb6b0b888d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:05.933063 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba0446-5376-4b1c-86f7-1fb6b0b888d7 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:05.973316 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 488/975] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Jun 8 11:54:05 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:06.033534 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e1886-d6ad-43c5-a37b-37c039b34678 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:06.051181 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:06.076656 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056a7f8-8aac-4b9d-8f75-57a4c2bda745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:06.077799 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056a7f8-8aac-4b9d-8f75-57a4c2bda745 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:06.078310 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056a7f8-8aac-4b9d-8f75-57a4c2bda745 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:06.078815 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056a7f8-8aac-4b9d-8f75-57a4c2bda745 None admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:06.079797 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f056a7f8-8aac-4b9d-8f75-57a4c2bda745 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:06.080361 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f056a7f8-8aac-4b9d-8f75-57a4c2bda745 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:06.082050 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f056a7f8-8aac-4b9d-8f75-57a4c2bda745 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:06.100217 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 488/976] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:54:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:06.106870 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba0446-5376-4b1c-86f7-1fb6b0b888d7 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:06.181836 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:06.227939 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba0446-5376-4b1c-86f7-1fb6b0b888d7 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:06.269202 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5608be12-02b4-4aec-a892-0216a24570bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:06.270034 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608be12-02b4-4aec-a892-0216a24570bd None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:06.270320 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608be12-02b4-4aec-a892-0216a24570bd None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:06.270593 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608be12-02b4-4aec-a892-0216a24570bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:06.281012 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5608be12-02b4-4aec-a892-0216a24570bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:06.283129 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5608be12-02b4-4aec-a892-0216a24570bd None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:06.297661 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-5608be12-02b4-4aec-a892-0216a24570bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:54:06.297661 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:06.297661 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:54:06.297661 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:54:06.297661 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:54:06.297661 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:54:06.297661 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:54:06.297661 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:54:06.297661 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:54:06.297661 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:54:06.297661 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:54:06.297661 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:54:06.297661 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 11:54:06.297661 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 11:54:06.297661 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 11:54:06.298604 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 11:54:06.298604 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:54:06.298604 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:54:06.298604 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:54:06.298604 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:54:06.298604 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:54:06.298604 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:54:06.298604 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:54:06.298604 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:54:06.298604 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:54:06.298604 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:54:06.298604 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:54:06.298604 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:54:06.298604 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:54:06.298604 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:54:06.298604 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:54:06.298604 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:54:06.299506 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 11:54:06.299506 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 11:54:06.299506 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 11:54:06.299506 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 11:54:06.299506 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 11:54:06.299506 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 11:54:06.299506 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:54:06.299506 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:54:06.299506 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 489/977] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Jun 8 11:54:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:54:06.305209 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056a7f8-8aac-4b9d-8f75-57a4c2bda745 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:06.409185 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056a7f8-8aac-4b9d-8f75-57a4c2bda745 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:06.445983 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2be94-952a-48ab-a150-1ec0c6132eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:06.446681 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2be94-952a-48ab-a150-1ec0c6132eaa None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:06.446969 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2be94-952a-48ab-a150-1ec0c6132eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:06.447245 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2be94-952a-48ab-a150-1ec0c6132eaa None admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:06.448059 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae2be94-952a-48ab-a150-1ec0c6132eaa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:06.448405 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae2be94-952a-48ab-a150-1ec0c6132eaa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:06.449892 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae2be94-952a-48ab-a150-1ec0c6132eaa None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:06.468253 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 489/978] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Jun 8 11:54:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:54:06.469891 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5608be12-02b4-4aec-a892-0216a24570bd None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:06.572780 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5608be12-02b4-4aec-a892-0216a24570bd None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:06.599196 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:06.602592 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a33d862-bd65-458e-ba70-671dc1308854 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:06.602892 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a33d862-bd65-458e-ba70-671dc1308854 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:06.603178 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a33d862-bd65-458e-ba70-671dc1308854 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:06.604738 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 490/979] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:54:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 11:54:06.609635 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865aa4a3-eabd-40fd-a3b2-83f7acc2280b None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:06.609919 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865aa4a3-eabd-40fd-a3b2-83f7acc2280b None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:06.610213 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865aa4a3-eabd-40fd-a3b2-83f7acc2280b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:06.620409 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557247c3-ae96-40e0-917d-4f399e8c9936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:06.621087 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557247c3-ae96-40e0-917d-4f399e8c9936 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:06.621374 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557247c3-ae96-40e0-917d-4f399e8c9936 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:06.621659 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557247c3-ae96-40e0-917d-4f399e8c9936 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:06.622852 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557247c3-ae96-40e0-917d-4f399e8c9936 None admin] RBAC: Adding query filter params (role.id=c19874f86dad4aa1bfa44ebf9eaf6de4, scope.project.id=6a7fee684e8b43e199c95aeeb92640d4, user.id=d52efc21c66d4300a8a979d92dbfeb47) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:06.623185 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557247c3-ae96-40e0-917d-4f399e8c9936 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:06.624742 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557247c3-ae96-40e0-917d-4f399e8c9936 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:06.629678 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-865aa4a3-eabd-40fd-a3b2-83f7acc2280b None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:54:06.630888 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-865aa4a3-eabd-40fd-a3b2-83f7acc2280b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:54:06.640515 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 490/980] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Jun 8 11:54:06 2022] GET /identity/v3/role_assignments?user.id=d52efc21c66d4300a8a979d92dbfeb47&scope.project.id=6a7fee684e8b43e199c95aeeb92640d4&role.id=c19874f86dad4aa1bfa44ebf9eaf6de4 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:06.670923 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:06.720489 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 491/981] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:54:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 11:54:06.743774 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557247c3-ae96-40e0-917d-4f399e8c9936 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:06.774655 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a186472-ca54-4883-ab6f-14dfeaf0f19a None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:06.774942 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a186472-ca54-4883-ab6f-14dfeaf0f19a None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:06.775222 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a186472-ca54-4883-ab6f-14dfeaf0f19a None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:06.780659 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 492/982] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:54:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 11:54:06.782331 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045f4de-cde3-4fda-83b4-c420964da002 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:06.782624 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045f4de-cde3-4fda-83b4-c420964da002 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:06.782902 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045f4de-cde3-4fda-83b4-c420964da002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:06.799940 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-c045f4de-cde3-4fda-83b4-c420964da002 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:54:06.801198 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-c045f4de-cde3-4fda-83b4-c420964da002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:54:06.867139 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557247c3-ae96-40e0-917d-4f399e8c9936 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:06.875762 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 493/983] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:54:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 11:54:06.900455 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c045f4de-cde3-4fda-83b4-c420964da002 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:06.905475 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15162152-7c2f-4d83-bc45-7b77fe1c8098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:06.906291 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15162152-7c2f-4d83-bc45-7b77fe1c8098 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:06.906571 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15162152-7c2f-4d83-bc45-7b77fe1c8098 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:06.906845 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15162152-7c2f-4d83-bc45-7b77fe1c8098 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:06.907493 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15162152-7c2f-4d83-bc45-7b77fe1c8098 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:06.908908 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15162152-7c2f-4d83-bc45-7b77fe1c8098 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:06.921361 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-15162152-7c2f-4d83-bc45-7b77fe1c8098 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 11:54:06.921361 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:06.921361 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 11:54:06.921361 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 11:54:06.921361 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 11:54:06.921361 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 11:54:06.921361 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 11:54:06.921361 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 11:54:06.921361 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 11:54:06.921361 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:54:06.921361 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 11:54:06.921361 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:54:06.921361 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:06.921361 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:54:06.921361 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:54:06.921361 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:54:06.921361 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:54:06.922401 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:54:06.922401 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:54:06.922401 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:54:06.922401 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:54:06.922401 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:54:06.922401 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:54:06.922401 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 11:54:06.922401 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 11:54:06.922401 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 11:54:06.922401 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 11:54:06.922401 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:54:06.922401 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:54:06.922401 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:54:06.922401 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:54:06.922401 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:54:06.922401 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:54:06.924276 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:54:06.924276 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:54:06.924276 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:54:06.924276 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:54:06.924276 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:54:06.924276 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:54:06.924276 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:54:06.924276 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:54:06.924276 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:54:06.924276 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:54:06.924276 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 11:54:06.924276 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 11:54:06.924276 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 11:54:06.924276 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:54:06.924276 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 491/984] 10.222.0.39 () {56 vars in 1126 bytes} [Wed Jun 8 11:54:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:54:06.928354 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15162152-7c2f-4d83-bc45-7b77fe1c8098 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:06.985956 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:07.002792 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:07.010608 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c045f4de-cde3-4fda-83b4-c420964da002 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:07.044306 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15162152-7c2f-4d83-bc45-7b77fe1c8098 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:07.047822 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004167bf-f025-4b4e-8f79-769d1922a050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:07.048530 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004167bf-f025-4b4e-8f79-769d1922a050 None admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:07.048815 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004167bf-f025-4b4e-8f79-769d1922a050 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:07.049092 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004167bf-f025-4b4e-8f79-769d1922a050 None admin] PATH_INFO: `/v3/services` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:07.049813 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004167bf-f025-4b4e-8f79-769d1922a050 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:07.051181 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004167bf-f025-4b4e-8f79-769d1922a050 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:07.068203 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 494/985] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Jun 8 11:54:06 2022] POST /identity/v3/services => generated 242 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 11:54:07.093060 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b452587-97b8-452d-b2b4-3b3ce6fb079c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:07.093756 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b452587-97b8-452d-b2b4-3b3ce6fb079c None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:07.094040 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b452587-97b8-452d-b2b4-3b3ce6fb079c None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:07.094316 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b452587-97b8-452d-b2b4-3b3ce6fb079c None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:07.095057 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b452587-97b8-452d-b2b4-3b3ce6fb079c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:07.095359 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b452587-97b8-452d-b2b4-3b3ce6fb079c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:07.096826 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b452587-97b8-452d-b2b4-3b3ce6fb079c None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:07.107976 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 492/986] 10.222.0.39 () {56 vars in 1122 bytes} [Wed Jun 8 11:54:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:54:07.109428 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004167bf-f025-4b4e-8f79-769d1922a050 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:07.225116 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004167bf-f025-4b4e-8f79-769d1922a050 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:07.261166 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95023eb6-ebad-4430-8a91-27583edbbba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:07.261849 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95023eb6-ebad-4430-8a91-27583edbbba1 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:07.262138 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95023eb6-ebad-4430-8a91-27583edbbba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:07.262416 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95023eb6-ebad-4430-8a91-27583edbbba1 None admin] PATH_INFO: `/v3/services` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:07.263131 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95023eb6-ebad-4430-8a91-27583edbbba1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:07.263438 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95023eb6-ebad-4430-8a91-27583edbbba1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:07.265751 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95023eb6-ebad-4430-8a91-27583edbbba1 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:07.273207 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 495/987] 10.222.0.39 () {56 vars in 1122 bytes} [Wed Jun 8 11:54:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:07.278896 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b452587-97b8-452d-b2b4-3b3ce6fb079c None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:07.387141 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b452587-97b8-452d-b2b4-3b3ce6fb079c None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:07.396300 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:07.422665 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd84ad7c-035a-4ece-97e4-cd08e8e27ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:07.423338 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84ad7c-035a-4ece-97e4-cd08e8e27ca0 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:07.423625 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84ad7c-035a-4ece-97e4-cd08e8e27ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:07.423906 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84ad7c-035a-4ece-97e4-cd08e8e27ca0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:07.424746 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd84ad7c-035a-4ece-97e4-cd08e8e27ca0 None admin] RBAC: Adding query filter params (interface=admin, service_id=90b5af5944ee4e47944e491b626045f0, region_id=RegionOne) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:07.425067 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd84ad7c-035a-4ece-97e4-cd08e8e27ca0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:07.426445 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd84ad7c-035a-4ece-97e4-cd08e8e27ca0 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:07.431970 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 493/988] 10.222.0.39 () {56 vars in 1249 bytes} [Wed Jun 8 11:54:07 2022] GET /identity/v3/endpoints?service_id=90b5af5944ee4e47944e491b626045f0&interface=admin®ion_id=RegionOne => generated 193 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:07.437622 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95023eb6-ebad-4430-8a91-27583edbbba1 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:07.459071 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:07.547962 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95023eb6-ebad-4430-8a91-27583edbbba1 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:07.586914 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861579fd-b79c-402d-8ff8-b4233e1acde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:07.587590 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861579fd-b79c-402d-8ff8-b4233e1acde9 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:07.587874 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861579fd-b79c-402d-8ff8-b4233e1acde9 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:07.588152 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861579fd-b79c-402d-8ff8-b4233e1acde9 None admin] PATH_INFO: `/v3/services` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:07.591504 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861579fd-b79c-402d-8ff8-b4233e1acde9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:07.591504 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861579fd-b79c-402d-8ff8-b4233e1acde9 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:07.604253 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 496/989] 10.222.0.39 () {56 vars in 1087 bytes} [Wed Jun 8 11:54:07 2022] GET /identity/v3/services => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 11:54:08.931488 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67ffcb-71b2-4916-8d3b-ef55c59b8e7c None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:08.931991 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67ffcb-71b2-4916-8d3b-ef55c59b8e7c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:08.931991 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67ffcb-71b2-4916-8d3b-ef55c59b8e7c None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:08.933478 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 494/990] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:54:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:54:08.938419 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d1057-8d7f-41b6-91f1-44b0baf47e2e None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:08.938806 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d1057-8d7f-41b6-91f1-44b0baf47e2e None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:08.938964 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d1057-8d7f-41b6-91f1-44b0baf47e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:08.955965 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-4b7d1057-8d7f-41b6-91f1-44b0baf47e2e None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:54:08.957187 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-4b7d1057-8d7f-41b6-91f1-44b0baf47e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:54:09.025412 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 497/991] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:54:08 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 11:54:09.047723 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67ffcb-71b2-4916-8d3b-ef55c59b8e7c None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:09.151981 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67ffcb-71b2-4916-8d3b-ef55c59b8e7c None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:09.186180 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a8ef8-a9ef-4bdb-a8b6-30b57d87cc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:09.186898 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a8ef8-a9ef-4bdb-a8b6-30b57d87cc37 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:09.187179 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a8ef8-a9ef-4bdb-a8b6-30b57d87cc37 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:09.187452 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a8ef8-a9ef-4bdb-a8b6-30b57d87cc37 None admin] PATH_INFO: `/v3/services/image` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:09.188088 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4a8ef8-a9ef-4bdb-a8b6-30b57d87cc37 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:09.189495 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4a8ef8-a9ef-4bdb-a8b6-30b57d87cc37 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:09.201020 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-ce4a8ef8-a9ef-4bdb-a8b6-30b57d87cc37 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 08 11:54:09.201020 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:09.201020 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 11:54:09.201020 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 11:54:09.201020 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 11:54:09.201020 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 11:54:09.201020 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 11:54:09.201020 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 11:54:09.201020 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 08 11:54:09.201020 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:54:09.201020 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 11:54:09.201020 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:54:09.201020 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:09.201020 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:54:09.201020 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:54:09.201020 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:54:09.201020 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:54:09.202000 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:54:09.202000 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:54:09.202000 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:54:09.202000 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:54:09.202000 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:54:09.202000 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:54:09.202000 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 11:54:09.202000 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 11:54:09.202000 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 11:54:09.202000 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 11:54:09.202000 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:54:09.202000 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:54:09.202000 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:54:09.202000 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:54:09.202000 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:54:09.202000 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:54:09.202869 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:54:09.202869 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:54:09.202869 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:54:09.202869 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:54:09.202869 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:54:09.202869 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:54:09.202869 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:54:09.202869 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:54:09.202869 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:54:09.202869 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:54:09.202869 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 11:54:09.202869 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 11:54:09.202869 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 08 11:54:09.202869 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:54:09.204314 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 495/992] 10.222.0.39 () {56 vars in 1105 bytes} [Wed Jun 8 11:54:09 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:54:09.208197 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d1057-8d7f-41b6-91f1-44b0baf47e2e None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:09.223676 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:09.311917 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d1057-8d7f-41b6-91f1-44b0baf47e2e None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:09.347620 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff038d2-eeca-4dd6-a7f8-f7e91454c4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:09.348323 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff038d2-eeca-4dd6-a7f8-f7e91454c4da None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:09.348610 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff038d2-eeca-4dd6-a7f8-f7e91454c4da None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:09.348884 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff038d2-eeca-4dd6-a7f8-f7e91454c4da None admin] PATH_INFO: `/v3/services` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:09.349594 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff038d2-eeca-4dd6-a7f8-f7e91454c4da None admin] RBAC: Adding query filter params (name=image) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:09.349902 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff038d2-eeca-4dd6-a7f8-f7e91454c4da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:09.352022 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff038d2-eeca-4dd6-a7f8-f7e91454c4da None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:09.361653 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 498/993] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:54:09 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:09.363213 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a8ef8-a9ef-4bdb-a8b6-30b57d87cc37 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:09.381296 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb67d04-81a4-4554-957d-ba799eb6b1e5 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:09.381677 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb67d04-81a4-4554-957d-ba799eb6b1e5 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:09.381998 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb67d04-81a4-4554-957d-ba799eb6b1e5 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:09.383527 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 499/994] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:54:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 11:54:09.389254 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d5bbb6-ed3b-49ba-8452-21c5f9f05044 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:09.389549 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d5bbb6-ed3b-49ba-8452-21c5f9f05044 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:09.389940 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d5bbb6-ed3b-49ba-8452-21c5f9f05044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:09.403619 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:09.408458 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-18d5bbb6-ed3b-49ba-8452-21c5f9f05044 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:54:09.409798 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-18d5bbb6-ed3b-49ba-8452-21c5f9f05044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:54:09.484293 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 500/995] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:54:09 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 11:54:09.489853 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a8ef8-a9ef-4bdb-a8b6-30b57d87cc37 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:09.505856 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d5bbb6-ed3b-49ba-8452-21c5f9f05044 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:09.517021 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:09.529781 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec509269-8b8f-456c-80e8-1f988f0a28f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:09.530485 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec509269-8b8f-456c-80e8-1f988f0a28f9 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:09.530774 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec509269-8b8f-456c-80e8-1f988f0a28f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:09.531055 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec509269-8b8f-456c-80e8-1f988f0a28f9 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:09.531787 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec509269-8b8f-456c-80e8-1f988f0a28f9 None admin] RBAC: Adding query filter params (type=image) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:09.532101 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec509269-8b8f-456c-80e8-1f988f0a28f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:09.533596 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec509269-8b8f-456c-80e8-1f988f0a28f9 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:09.539752 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 496/996] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:54:09 2022] GET /identity/v3/services?type=image => generated 122 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:54:09.631025 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d5bbb6-ed3b-49ba-8452-21c5f9f05044 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:09.668694 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01336324-cc3d-47fb-8f41-ac92a440835f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:09.669517 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01336324-cc3d-47fb-8f41-ac92a440835f None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:09.669801 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01336324-cc3d-47fb-8f41-ac92a440835f None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:09.670075 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01336324-cc3d-47fb-8f41-ac92a440835f None admin] PATH_INFO: `/v3/services/compute` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:09.670739 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01336324-cc3d-47fb-8f41-ac92a440835f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:09.672132 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01336324-cc3d-47fb-8f41-ac92a440835f None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:09.685503 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-01336324-cc3d-47fb-8f41-ac92a440835f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 08 11:54:09.685503 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:09.685503 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 11:54:09.685503 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 11:54:09.685503 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 11:54:09.685503 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 11:54:09.685503 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 11:54:09.685503 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 11:54:09.685503 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 08 11:54:09.685503 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:54:09.685503 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 11:54:09.685503 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:54:09.685503 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:09.685503 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:54:09.685503 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:54:09.685503 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:54:09.685503 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:54:09.686565 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:54:09.686565 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:54:09.686565 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:54:09.686565 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:54:09.686565 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:54:09.686565 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:54:09.686565 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 11:54:09.686565 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 11:54:09.686565 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 11:54:09.686565 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 11:54:09.686565 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:54:09.686565 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:54:09.686565 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:54:09.686565 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:54:09.686565 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:54:09.686565 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:54:09.692727 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:54:09.692727 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:54:09.692727 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:54:09.692727 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:54:09.692727 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:54:09.692727 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:54:09.692727 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:54:09.692727 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:54:09.692727 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:54:09.692727 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:54:09.692727 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 11:54:09.692727 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 11:54:09.692727 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 08 11:54:09.692727 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:54:09.692727 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 501/997] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Jun 8 11:54:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 11:54:09.695775 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec509269-8b8f-456c-80e8-1f988f0a28f9 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:09.806201 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:09.809691 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec509269-8b8f-456c-80e8-1f988f0a28f9 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:09.844709 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c1965-6131-469b-8898-0858635d8905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:09.845385 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c1965-6131-469b-8898-0858635d8905 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:09.845669 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c1965-6131-469b-8898-0858635d8905 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:09.845943 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c1965-6131-469b-8898-0858635d8905 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:09.846647 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44c1965-6131-469b-8898-0858635d8905 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:09.846955 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44c1965-6131-469b-8898-0858635d8905 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:09.848627 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44c1965-6131-469b-8898-0858635d8905 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:09.858896 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 497/998] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Jun 8 11:54:09 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:09.859921 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01336324-cc3d-47fb-8f41-ac92a440835f None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:09.867825 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803bc0b-b70f-42da-8fc1-5e9971e6cd32 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:09.868110 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803bc0b-b70f-42da-8fc1-5e9971e6cd32 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:09.868437 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803bc0b-b70f-42da-8fc1-5e9971e6cd32 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:09.869800 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 498/999] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:54:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 11:54:09.874715 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb683a-3694-41c2-86bc-9232d4454537 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:09.875004 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb683a-3694-41c2-86bc-9232d4454537 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:09.875285 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb683a-3694-41c2-86bc-9232d4454537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:09.895774 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-cfeb683a-3694-41c2-86bc-9232d4454537 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:54:09.899085 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-cfeb683a-3694-41c2-86bc-9232d4454537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:54:09.935493 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:09.969247 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01336324-cc3d-47fb-8f41-ac92a440835f None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:09.976216 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 499/1000] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:54:09 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 11:54:09.998933 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb683a-3694-41c2-86bc-9232d4454537 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:10.008475 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3499d3eb-969e-4246-bda4-b669463cab7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:10.009157 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499d3eb-969e-4246-bda4-b669463cab7e None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:10.009442 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499d3eb-969e-4246-bda4-b669463cab7e None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:10.009720 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499d3eb-969e-4246-bda4-b669463cab7e None admin] PATH_INFO: `/v3/services` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:10.010429 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3499d3eb-969e-4246-bda4-b669463cab7e None admin] RBAC: Adding query filter params (type=compute) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:10.010746 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3499d3eb-969e-4246-bda4-b669463cab7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:10.012130 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3499d3eb-969e-4246-bda4-b669463cab7e None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:10.023598 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 502/1001] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Jun 8 11:54:09 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:54:10.024633 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3499d3eb-969e-4246-bda4-b669463cab7e None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:10.102218 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:10.110675 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb683a-3694-41c2-86bc-9232d4454537 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:10.132639 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3499d3eb-969e-4246-bda4-b669463cab7e None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:10.151191 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69daa2a7-1e51-4885-aa86-873f6f313210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:10.152004 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69daa2a7-1e51-4885-aa86-873f6f313210 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:10.152321 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69daa2a7-1e51-4885-aa86-873f6f313210 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:10.152600 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69daa2a7-1e51-4885-aa86-873f6f313210 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:10.153259 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69daa2a7-1e51-4885-aa86-873f6f313210 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:10.154641 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69daa2a7-1e51-4885-aa86-873f6f313210 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:10.166890 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-69daa2a7-1e51-4885-aa86-873f6f313210 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 11:54:10.166890 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:10.166890 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 11:54:10.166890 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 11:54:10.166890 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 11:54:10.166890 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 11:54:10.166890 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 11:54:10.166890 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 11:54:10.166890 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 11:54:10.166890 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:54:10.166890 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 11:54:10.166890 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:54:10.166890 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:10.166890 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:54:10.166890 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:54:10.166890 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:54:10.166890 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:54:10.168089 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:54:10.168089 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:54:10.168089 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:54:10.168089 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:54:10.168089 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:54:10.168089 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:54:10.168089 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 11:54:10.168089 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 11:54:10.168089 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 11:54:10.168089 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 11:54:10.168089 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:54:10.168089 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:54:10.168089 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:54:10.168089 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:54:10.168089 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:54:10.168089 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:54:10.168991 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:54:10.168991 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:54:10.168991 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:54:10.168991 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:54:10.168991 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:54:10.168991 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:54:10.168991 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:54:10.168991 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:54:10.168991 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:54:10.168991 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:54:10.168991 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 11:54:10.168991 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 11:54:10.168991 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 08 11:54:10.168991 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:54:10.168991 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 500/1002] 10.222.0.39 () {56 vars in 1126 bytes} [Wed Jun 8 11:54:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 11:54:10.171645 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c600494-1b5a-4085-8f06-d1d6331e84e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:10.172369 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c600494-1b5a-4085-8f06-d1d6331e84e5 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:10.172660 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c600494-1b5a-4085-8f06-d1d6331e84e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:10.172967 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c600494-1b5a-4085-8f06-d1d6331e84e5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:10.174356 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c600494-1b5a-4085-8f06-d1d6331e84e5 None admin] RBAC: Adding query filter params (interface=public, service_id=aa671b09161b41938aeb4fd91a2064b1, region_id=RegionOne) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:10.174781 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c600494-1b5a-4085-8f06-d1d6331e84e5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:10.175203 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69daa2a7-1e51-4885-aa86-873f6f313210 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:10.177182 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c600494-1b5a-4085-8f06-d1d6331e84e5 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:10.180570 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:10.186234 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 503/1003] 10.222.0.39 () {56 vars in 1251 bytes} [Wed Jun 8 11:54:10 2022] GET /identity/v3/endpoints?service_id=aa671b09161b41938aeb4fd91a2064b1&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:10.191565 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c600494-1b5a-4085-8f06-d1d6331e84e5 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:10.282879 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69daa2a7-1e51-4885-aa86-873f6f313210 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:10.303275 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c600494-1b5a-4085-8f06-d1d6331e84e5 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:10.321192 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988e280-8eca-4323-bfe4-f575d28288b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:10.321952 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988e280-8eca-4323-bfe4-f575d28288b0 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:10.322246 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988e280-8eca-4323-bfe4-f575d28288b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:10.322527 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988e280-8eca-4323-bfe4-f575d28288b0 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:10.323238 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0988e280-8eca-4323-bfe4-f575d28288b0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:10.323549 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0988e280-8eca-4323-bfe4-f575d28288b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:10.324952 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0988e280-8eca-4323-bfe4-f575d28288b0 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:10.330045 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 501/1004] 10.222.0.39 () {56 vars in 1122 bytes} [Wed Jun 8 11:54:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:54:10.335660 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988e280-8eca-4323-bfe4-f575d28288b0 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:10.339594 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb2854-4178-4dcb-8172-5a857723aa00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:10.340300 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb2854-4178-4dcb-8172-5a857723aa00 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:10.340594 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb2854-4178-4dcb-8172-5a857723aa00 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:10.340875 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb2854-4178-4dcb-8172-5a857723aa00 None admin] PATH_INFO: `/v3/services` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:10.341591 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eb2854-4178-4dcb-8172-5a857723aa00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:10.343192 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eb2854-4178-4dcb-8172-5a857723aa00 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:10.359409 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 504/1005] 10.222.0.39 () {56 vars in 1087 bytes} [Wed Jun 8 11:54:10 2022] GET /identity/v3/services => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 11:54:10.362585 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:10.450475 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988e280-8eca-4323-bfe4-f575d28288b0 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:10.487268 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3bed2-8d17-4655-b0bf-918cccb9cb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:10.487967 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3bed2-8d17-4655-b0bf-918cccb9cb05 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:10.488283 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3bed2-8d17-4655-b0bf-918cccb9cb05 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:10.488564 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3bed2-8d17-4655-b0bf-918cccb9cb05 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:10.489291 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb3bed2-8d17-4655-b0bf-918cccb9cb05 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:10.489603 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb3bed2-8d17-4655-b0bf-918cccb9cb05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:10.491613 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb3bed2-8d17-4655-b0bf-918cccb9cb05 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:10.502150 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 502/1006] 10.222.0.39 () {56 vars in 1122 bytes} [Wed Jun 8 11:54:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:10.503851 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb2854-4178-4dcb-8172-5a857723aa00 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:10.584541 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:10.625718 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb2854-4178-4dcb-8172-5a857723aa00 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:10.661240 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b518a3-5729-408f-8110-ad08bd969a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:10.661934 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b518a3-5729-408f-8110-ad08bd969a82 None admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:10.662223 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b518a3-5729-408f-8110-ad08bd969a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:10.662495 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b518a3-5729-408f-8110-ad08bd969a82 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:10.663798 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b518a3-5729-408f-8110-ad08bd969a82 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:10.665257 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b518a3-5729-408f-8110-ad08bd969a82 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:10.684484 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 505/1007] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Jun 8 11:54:10 2022] POST /identity/v3/endpoints => generated 325 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 11:54:11.813346 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a3f554-06e9-445c-81c4-7e412595bfbe None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:11.813915 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a3f554-06e9-445c-81c4-7e412595bfbe None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:11.813915 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a3f554-06e9-445c-81c4-7e412595bfbe None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:11.815391 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 503/1008] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:54:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:54:11.820892 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b5c87-3376-41a2-b6f5-eaa271dae64f None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:11.821314 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b5c87-3376-41a2-b6f5-eaa271dae64f None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:11.821503 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b5c87-3376-41a2-b6f5-eaa271dae64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:11.839497 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-245b5c87-3376-41a2-b6f5-eaa271dae64f None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:54:11.840775 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-245b5c87-3376-41a2-b6f5-eaa271dae64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:54:11.915360 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 506/1009] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:54:11 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 11:54:11.937941 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a3f554-06e9-445c-81c4-7e412595bfbe None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:12.027019 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:12.044606 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a3f554-06e9-445c-81c4-7e412595bfbe None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:12.082065 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e153d-5e8c-4080-b6d3-cd266ab3c03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:12.082743 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e153d-5e8c-4080-b6d3-cd266ab3c03f None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:12.083027 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e153d-5e8c-4080-b6d3-cd266ab3c03f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:12.083303 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e153d-5e8c-4080-b6d3-cd266ab3c03f None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:12.084035 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e153d-5e8c-4080-b6d3-cd266ab3c03f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:12.086341 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e153d-5e8c-4080-b6d3-cd266ab3c03f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:12.107121 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 504/1010] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Jun 8 11:54:11 2022] POST /identity/v3/services => generated 242 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 11:54:12.718144 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5516c8-4b22-4171-81f3-889e4277cc28 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:12.718462 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5516c8-4b22-4171-81f3-889e4277cc28 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:12.718707 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5516c8-4b22-4171-81f3-889e4277cc28 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:12.720253 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 507/1011] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:54:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:54:12.725673 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8676a4-1a04-4cfd-a725-c30b1bcee18a None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:12.725968 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8676a4-1a04-4cfd-a725-c30b1bcee18a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:12.726246 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8676a4-1a04-4cfd-a725-c30b1bcee18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:12.743703 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-cf8676a4-1a04-4cfd-a725-c30b1bcee18a None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:54:12.744940 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-cf8676a4-1a04-4cfd-a725-c30b1bcee18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:54:12.820425 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 505/1012] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:54:12 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 11:54:12.843462 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5516c8-4b22-4171-81f3-889e4277cc28 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:12.895639 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:12.951894 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5516c8-4b22-4171-81f3-889e4277cc28 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:12.983484 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4fa4b0-5fa4-4d93-ba54-6b91c34e70e7 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:12.983782 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4fa4b0-5fa4-4d93-ba54-6b91c34e70e7 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:12.984068 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4fa4b0-5fa4-4d93-ba54-6b91c34e70e7 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:12.985459 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 506/1013] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:54:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:54:12.990025 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d6384-027a-4ae8-ad55-99559aaedb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:12.990311 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7530b2b1-aac8-4993-8934-1a2a7cb440ef None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:12.990608 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7530b2b1-aac8-4993-8934-1a2a7cb440ef None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:12.990879 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d6384-027a-4ae8-ad55-99559aaedb3a None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:12.991054 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7530b2b1-aac8-4993-8934-1a2a7cb440ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:12.991274 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d6384-027a-4ae8-ad55-99559aaedb3a None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:12.991591 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d6384-027a-4ae8-ad55-99559aaedb3a None admin] PATH_INFO: `/v3/services/compute` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:12.992405 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8d6384-027a-4ae8-ad55-99559aaedb3a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:12.993788 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8d6384-027a-4ae8-ad55-99559aaedb3a None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:13.006535 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-4a8d6384-027a-4ae8-ad55-99559aaedb3a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 08 11:54:13.006535 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:13.006535 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 11:54:13.006535 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 11:54:13.006535 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 11:54:13.006535 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 11:54:13.006535 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 11:54:13.006535 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 11:54:13.006535 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 08 11:54:13.006535 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:54:13.006535 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 11:54:13.006535 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:54:13.006535 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:13.006535 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:54:13.006535 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:54:13.006535 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:54:13.006535 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:54:13.007571 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:54:13.007571 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:54:13.007571 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:54:13.007571 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:54:13.007571 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:54:13.007571 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:54:13.007571 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 11:54:13.007571 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 11:54:13.007571 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 11:54:13.007571 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 11:54:13.007571 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:54:13.007571 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:54:13.007571 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:54:13.007571 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:54:13.007571 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:54:13.007571 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:54:13.008974 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:54:13.008974 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:54:13.008974 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:54:13.008974 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:54:13.008974 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:54:13.008974 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:54:13.008974 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:54:13.008974 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:54:13.008974 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:54:13.008974 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:54:13.008974 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 11:54:13.008974 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 11:54:13.008974 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 08 11:54:13.008974 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:54:13.009895 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-7530b2b1-aac8-4993-8934-1a2a7cb440ef None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:54:13.009997 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 508/1014] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Jun 8 11:54:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:54:13.010086 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-7530b2b1-aac8-4993-8934-1a2a7cb440ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:54:13.013922 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d6384-027a-4ae8-ad55-99559aaedb3a None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:13.080205 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 507/1015] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:54:12 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 11:54:13.104379 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7530b2b1-aac8-4993-8934-1a2a7cb440ef None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:13.106360 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:13.118873 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d6384-027a-4ae8-ad55-99559aaedb3a None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:13.134446 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:13.158336 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b15e08-ccd5-41dd-91ae-5742b8fe1992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:13.159005 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b15e08-ccd5-41dd-91ae-5742b8fe1992 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:13.159314 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b15e08-ccd5-41dd-91ae-5742b8fe1992 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:13.159595 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b15e08-ccd5-41dd-91ae-5742b8fe1992 None admin] PATH_INFO: `/v3/services` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:13.160332 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b15e08-ccd5-41dd-91ae-5742b8fe1992 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:13.160641 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b15e08-ccd5-41dd-91ae-5742b8fe1992 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:13.162135 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b15e08-ccd5-41dd-91ae-5742b8fe1992 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:13.167282 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 509/1016] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Jun 8 11:54:13 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:54:13.173351 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b15e08-ccd5-41dd-91ae-5742b8fe1992 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:13.217665 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7530b2b1-aac8-4993-8934-1a2a7cb440ef None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:13.264492 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64cd72-e20a-4b6d-a6cb-1d2ea2d26f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:13.265888 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64cd72-e20a-4b6d-a6cb-1d2ea2d26f48 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:13.266383 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64cd72-e20a-4b6d-a6cb-1d2ea2d26f48 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:13.266938 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64cd72-e20a-4b6d-a6cb-1d2ea2d26f48 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:13.268727 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a64cd72-e20a-4b6d-a6cb-1d2ea2d26f48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:13.270785 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a64cd72-e20a-4b6d-a6cb-1d2ea2d26f48 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:13.273576 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 508/1017] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:54:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:54:13.279405 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64cd72-e20a-4b6d-a6cb-1d2ea2d26f48 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:13.279789 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b15e08-ccd5-41dd-91ae-5742b8fe1992 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:13.319739 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a884cc88-b1a4-4d6a-b518-7293da8211bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:13.320456 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884cc88-b1a4-4d6a-b518-7293da8211bd None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:13.320753 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884cc88-b1a4-4d6a-b518-7293da8211bd None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:13.321036 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884cc88-b1a4-4d6a-b518-7293da8211bd None admin] PATH_INFO: `/v3/services` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:13.321751 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a884cc88-b1a4-4d6a-b518-7293da8211bd None admin] RBAC: Adding query filter params (type=compute) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:13.322064 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a884cc88-b1a4-4d6a-b518-7293da8211bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:13.323457 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a884cc88-b1a4-4d6a-b518-7293da8211bd None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:13.333078 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 510/1018] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Jun 8 11:54:13 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:54:13.334803 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a884cc88-b1a4-4d6a-b518-7293da8211bd None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:13.358001 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:13.381983 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:13.391337 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64cd72-e20a-4b6d-a6cb-1d2ea2d26f48 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:13.427218 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f585dba-6192-44ba-bac8-df8e4ce32b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:13.427964 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f585dba-6192-44ba-bac8-df8e4ce32b84 None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:13.428148 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f585dba-6192-44ba-bac8-df8e4ce32b84 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:13.428743 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f585dba-6192-44ba-bac8-df8e4ce32b84 None admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:13.429487 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f585dba-6192-44ba-bac8-df8e4ce32b84 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:13.430925 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f585dba-6192-44ba-bac8-df8e4ce32b84 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:13.443719 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a884cc88-b1a4-4d6a-b518-7293da8211bd None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:13.459429 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 509/1019] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Jun 8 11:54:13 2022] POST /identity/v3/projects => generated 311 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 11:54:13.483215 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fab145-0ff9-4805-b887-f806b1e48264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:13.484340 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fab145-0ff9-4805-b887-f806b1e48264 None admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:13.484836 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fab145-0ff9-4805-b887-f806b1e48264 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:13.485342 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fab145-0ff9-4805-b887-f806b1e48264 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:13.486315 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fab145-0ff9-4805-b887-f806b1e48264 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:13.488109 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fab145-0ff9-4805-b887-f806b1e48264 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:13.519262 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 511/1020] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Jun 8 11:54:13 2022] POST /identity/v3/endpoints => generated 334 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 11:54:14.398448 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6c95f-55e3-4e4d-983b-ad5f49d66b94 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:14.398983 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6c95f-55e3-4e4d-983b-ad5f49d66b94 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:14.398983 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6c95f-55e3-4e4d-983b-ad5f49d66b94 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:14.400544 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 510/1021] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:54:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:54:14.405759 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2580fc-a828-4edc-a833-71efc2e4c68d None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:14.406156 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2580fc-a828-4edc-a833-71efc2e4c68d None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:14.406317 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2580fc-a828-4edc-a833-71efc2e4c68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:14.423597 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-bc2580fc-a828-4edc-a833-71efc2e4c68d None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:54:14.424826 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-bc2580fc-a828-4edc-a833-71efc2e4c68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:54:14.499390 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 512/1022] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:54:14 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 11:54:14.521602 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6c95f-55e3-4e4d-983b-ad5f49d66b94 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:14.639023 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6c95f-55e3-4e4d-983b-ad5f49d66b94 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:14.662216 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:14.677896 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de61e6f-21d6-4479-8a7a-74d89820d7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:14.678725 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de61e6f-21d6-4479-8a7a-74d89820d7d1 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:14.679007 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de61e6f-21d6-4479-8a7a-74d89820d7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:14.679279 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de61e6f-21d6-4479-8a7a-74d89820d7d1 None admin] PATH_INFO: `/v3/services/image` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:14.680047 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de61e6f-21d6-4479-8a7a-74d89820d7d1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:14.681455 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de61e6f-21d6-4479-8a7a-74d89820d7d1 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:14.693098 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-2de61e6f-21d6-4479-8a7a-74d89820d7d1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 08 11:54:14.693098 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:14.693098 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 11:54:14.693098 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 11:54:14.693098 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 11:54:14.693098 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 11:54:14.693098 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 11:54:14.693098 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 11:54:14.693098 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 08 11:54:14.693098 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:54:14.693098 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 11:54:14.693098 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:54:14.693098 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:14.693098 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:54:14.693098 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:54:14.693098 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:54:14.693098 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:54:14.694167 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:54:14.694167 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:54:14.694167 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:54:14.694167 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:54:14.694167 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:54:14.694167 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:54:14.694167 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 11:54:14.694167 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 11:54:14.694167 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 11:54:14.694167 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 11:54:14.694167 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:54:14.694167 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:54:14.694167 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:54:14.694167 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:54:14.694167 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:54:14.694167 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:54:14.699988 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:54:14.699988 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:54:14.699988 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:54:14.699988 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:54:14.699988 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:54:14.699988 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:54:14.699988 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:54:14.699988 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:54:14.699988 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:54:14.699988 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:54:14.699988 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 11:54:14.699988 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 11:54:14.699988 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 08 11:54:14.699988 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:54:14.699988 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 511/1023] 10.222.0.39 () {56 vars in 1105 bytes} [Wed Jun 8 11:54:14 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:54:14.702321 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2580fc-a828-4edc-a833-71efc2e4c68d None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:14.731732 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:14.820558 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2580fc-a828-4edc-a833-71efc2e4c68d None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:14.855309 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b02712-b427-464d-9fa5-1db1dd2b6bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:14.855991 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b02712-b427-464d-9fa5-1db1dd2b6bd4 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:14.856316 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b02712-b427-464d-9fa5-1db1dd2b6bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:14.856596 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b02712-b427-464d-9fa5-1db1dd2b6bd4 None admin] PATH_INFO: `/v3/services` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:14.857305 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b02712-b427-464d-9fa5-1db1dd2b6bd4 None admin] RBAC: Adding query filter params (name=image) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:14.857617 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b02712-b427-464d-9fa5-1db1dd2b6bd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:14.859064 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b02712-b427-464d-9fa5-1db1dd2b6bd4 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:14.869046 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 513/1024] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:54:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:14.870214 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de61e6f-21d6-4479-8a7a-74d89820d7d1 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:14.971867 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de61e6f-21d6-4479-8a7a-74d89820d7d1 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:15.005472 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e37f5a-7578-4a4a-a496-bb0e7075b83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:15.006132 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e37f5a-7578-4a4a-a496-bb0e7075b83b None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:15.006528 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e37f5a-7578-4a4a-a496-bb0e7075b83b None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:15.006816 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e37f5a-7578-4a4a-a496-bb0e7075b83b None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:15.007689 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e37f5a-7578-4a4a-a496-bb0e7075b83b None admin] RBAC: Adding query filter params (type=image) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:15.007996 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e37f5a-7578-4a4a-a496-bb0e7075b83b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:15.009406 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e37f5a-7578-4a4a-a496-bb0e7075b83b None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:15.018981 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 512/1025] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:54:14 2022] GET /identity/v3/services?type=image => generated 350 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:15.020186 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b02712-b427-464d-9fa5-1db1dd2b6bd4 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:15.105272 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:15.122595 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b02712-b427-464d-9fa5-1db1dd2b6bd4 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:15.156288 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01679677-f3eb-4081-ad39-7f52d995cac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:15.156956 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01679677-f3eb-4081-ad39-7f52d995cac6 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:15.157243 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01679677-f3eb-4081-ad39-7f52d995cac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:15.157519 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01679677-f3eb-4081-ad39-7f52d995cac6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:15.158310 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01679677-f3eb-4081-ad39-7f52d995cac6 None admin] RBAC: Adding query filter params (interface=public, service_id=5938e82780a14a179453b17409a64791, region_id=RegionOne) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:15.158623 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01679677-f3eb-4081-ad39-7f52d995cac6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:15.160045 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01679677-f3eb-4081-ad39-7f52d995cac6 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:15.170418 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 514/1026] 10.222.0.39 () {56 vars in 1251 bytes} [Wed Jun 8 11:54:15 2022] GET /identity/v3/endpoints?service_id=5938e82780a14a179453b17409a64791&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:15.171552 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e37f5a-7578-4a4a-a496-bb0e7075b83b None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:15.222946 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:15.275348 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e37f5a-7578-4a4a-a496-bb0e7075b83b None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:15.309661 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e242bb84-e4f7-4b30-8814-f753f5293b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:15.310339 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242bb84-e4f7-4b30-8814-f753f5293b20 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:15.310624 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242bb84-e4f7-4b30-8814-f753f5293b20 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:15.310901 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242bb84-e4f7-4b30-8814-f753f5293b20 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:15.311579 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e242bb84-e4f7-4b30-8814-f753f5293b20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:15.312972 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e242bb84-e4f7-4b30-8814-f753f5293b20 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:15.328200 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 513/1027] 10.222.0.39 () {56 vars in 1087 bytes} [Wed Jun 8 11:54:15 2022] GET /identity/v3/services => generated 1957 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 11:54:15.792958 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442817c-4b8d-4766-b67f-e14258214f44 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:15.793506 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442817c-4b8d-4766-b67f-e14258214f44 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:15.793506 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442817c-4b8d-4766-b67f-e14258214f44 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:15.795026 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 515/1028] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:54:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:54:15.800233 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136d059-3224-4801-a88a-823cbd066b97 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:15.800644 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136d059-3224-4801-a88a-823cbd066b97 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:15.800810 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136d059-3224-4801-a88a-823cbd066b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:15.818132 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-d136d059-3224-4801-a88a-823cbd066b97 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:54:15.819989 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-d136d059-3224-4801-a88a-823cbd066b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:54:15.888709 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 514/1029] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:54:15 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 11:54:15.901542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669801e-fa4e-44eb-a3e1-7023a11a744c None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:15.901830 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669801e-fa4e-44eb-a3e1-7023a11a744c None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:15.902104 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669801e-fa4e-44eb-a3e1-7023a11a744c None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:15.903582 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 516/1030] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:54:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:54:15.908748 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519163d-5b23-4645-a228-9272cbac941d None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:15.909040 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519163d-5b23-4645-a228-9272cbac941d None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:15.909314 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519163d-5b23-4645-a228-9272cbac941d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:15.913912 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669801e-fa4e-44eb-a3e1-7023a11a744c None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:15.926435 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-9519163d-5b23-4645-a228-9272cbac941d None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:54:15.927614 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-9519163d-5b23-4645-a228-9272cbac941d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:54:15.969714 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:16.000210 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 515/1031] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:54:15 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 11:54:16.022740 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9519163d-5b23-4645-a228-9272cbac941d None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:16.033388 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669801e-fa4e-44eb-a3e1-7023a11a744c None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:16.070466 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c10c92-2183-4b6b-b055-b98ae00423c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:16.071272 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c10c92-2183-4b6b-b055-b98ae00423c3 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:16.071547 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c10c92-2183-4b6b-b055-b98ae00423c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:16.071830 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c10c92-2183-4b6b-b055-b98ae00423c3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:16.073042 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c10c92-2183-4b6b-b055-b98ae00423c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:16.074519 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c10c92-2183-4b6b-b055-b98ae00423c3 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:16.076162 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 517/1032] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:54:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:54:16.081670 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c10c92-2183-4b6b-b055-b98ae00423c3 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:16.108266 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:16.133143 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9519163d-5b23-4645-a228-9272cbac941d None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:16.168488 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898258c7-0cb9-4402-b668-d49557c6631c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:16.169254 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898258c7-0cb9-4402-b668-d49557c6631c None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:16.169538 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898258c7-0cb9-4402-b668-d49557c6631c None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:16.169816 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898258c7-0cb9-4402-b668-d49557c6631c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:16.180110 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898258c7-0cb9-4402-b668-d49557c6631c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:54:16.188142 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-898258c7-0cb9-4402-b668-d49557c6631c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 08 11:54:16.188142 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:16.188142 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:54:16.188142 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:54:16.188142 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:54:16.188142 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:54:16.188142 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:54:16.188142 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:54:16.188142 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:54:16.188142 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:54:16.188142 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:54:16.188142 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:54:16.188142 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:54:16.188142 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:54:16.188142 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:54:16.188142 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:54:16.189357 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:54:16.189357 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:54:16.189357 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:54:16.189357 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:54:16.189357 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:54:16.189357 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:54:16.189357 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:54:16.189357 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:54:16.189357 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:54:16.189357 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:54:16.189357 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:54:16.189357 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:54:16.189357 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:54:16.189357 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:54:16.189357 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:54:16.189357 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:54:16.190234 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:54:16.190234 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:54:16.190234 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:54:16.190234 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:54:16.190234 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:54:16.190234 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:54:16.190234 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:54:16.190234 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:54:16.190234 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:54:16.190234 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:54:16.190234 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 08 11:54:16.190234 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:54:16.190234 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 516/1033] 10.222.0.39 () {56 vars in 1120 bytes} [Wed Jun 8 11:54:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 11:54:16.195740 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898258c7-0cb9-4402-b668-d49557c6631c None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:16.203709 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c10c92-2183-4b6b-b055-b98ae00423c3 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:16.231669 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:16.239458 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43407290-756a-40cb-921d-bd2e98094ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:16.240125 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43407290-756a-40cb-921d-bd2e98094ba6 None admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:16.240438 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43407290-756a-40cb-921d-bd2e98094ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:16.241269 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43407290-756a-40cb-921d-bd2e98094ba6 None admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:16.242063 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43407290-756a-40cb-921d-bd2e98094ba6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:16.243493 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43407290-756a-40cb-921d-bd2e98094ba6 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:16.264508 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 518/1034] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Jun 8 11:54:16 2022] POST /identity/v3/users => generated 285 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 11:54:16.306466 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898258c7-0cb9-4402-b668-d49557c6631c None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:16.343941 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6fcf81-4277-4455-bab5-7a16e2e375e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:16.344727 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6fcf81-4277-4455-bab5-7a16e2e375e9 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:16.345008 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6fcf81-4277-4455-bab5-7a16e2e375e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:16.345311 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6fcf81-4277-4455-bab5-7a16e2e375e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:16.346049 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6fcf81-4277-4455-bab5-7a16e2e375e9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:16.346413 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6fcf81-4277-4455-bab5-7a16e2e375e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:16.348072 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6fcf81-4277-4455-bab5-7a16e2e375e9 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:16.362615 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 517/1035] 10.222.0.39 () {56 vars in 1115 bytes} [Wed Jun 8 11:54:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:54:16.364379 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43407290-756a-40cb-921d-bd2e98094ba6 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:16.445680 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:16.478798 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43407290-756a-40cb-921d-bd2e98094ba6 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:16.516969 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c574a4f-5c41-49b9-9a45-25a07dc6deb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:16.517792 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c574a4f-5c41-49b9-9a45-25a07dc6deb1 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:16.518081 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c574a4f-5c41-49b9-9a45-25a07dc6deb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:16.518356 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c574a4f-5c41-49b9-9a45-25a07dc6deb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:16.530389 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c574a4f-5c41-49b9-9a45-25a07dc6deb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:16.531865 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c574a4f-5c41-49b9-9a45-25a07dc6deb1 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:16.550309 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-2c574a4f-5c41-49b9-9a45-25a07dc6deb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:54:16.550309 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:16.550309 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:54:16.550309 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:54:16.550309 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:54:16.550309 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:54:16.550309 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:54:16.550309 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:54:16.550309 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:54:16.550309 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:54:16.550309 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:54:16.550309 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:54:16.550309 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:54:16.550309 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:54:16.550309 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:54:16.551257 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:54:16.551257 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:54:16.551257 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:54:16.551257 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:54:16.551257 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:54:16.551257 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:54:16.551257 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:54:16.551257 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:54:16.551257 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:54:16.551257 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:54:16.551257 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:54:16.551257 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:54:16.551257 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:54:16.551257 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:54:16.551257 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:54:16.551257 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:54:16.551257 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:54:16.552837 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:54:16.552837 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:54:16.552837 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:54:16.552837 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:54:16.552837 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 519/1036] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:54:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:54:16.557364 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6fcf81-4277-4455-bab5-7a16e2e375e9 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:16.664591 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:16.671244 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6fcf81-4277-4455-bab5-7a16e2e375e9 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:16.706349 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547d1f2-1f0d-4f6e-90c6-5cee1fb043f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:16.706927 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547d1f2-1f0d-4f6e-90c6-5cee1fb043f3 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:16.707207 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547d1f2-1f0d-4f6e-90c6-5cee1fb043f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:16.707479 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547d1f2-1f0d-4f6e-90c6-5cee1fb043f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:16.708213 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d547d1f2-1f0d-4f6e-90c6-5cee1fb043f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:16.708519 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d547d1f2-1f0d-4f6e-90c6-5cee1fb043f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:16.710457 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d547d1f2-1f0d-4f6e-90c6-5cee1fb043f3 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:16.723105 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 518/1037] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:54:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:16.729239 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c574a4f-5c41-49b9-9a45-25a07dc6deb1 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:16.832970 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c574a4f-5c41-49b9-9a45-25a07dc6deb1 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:16.859347 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:16.868820 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e21f03-c9d3-42aa-b357-837326148f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:16.869622 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e21f03-c9d3-42aa-b357-837326148f9d None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:16.869912 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e21f03-c9d3-42aa-b357-837326148f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:16.870192 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e21f03-c9d3-42aa-b357-837326148f9d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:16.877768 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e21f03-c9d3-42aa-b357-837326148f9d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:16.879213 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e21f03-c9d3-42aa-b357-837326148f9d None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:16.893146 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-76e21f03-c9d3-42aa-b357-837326148f9d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 08 11:54:16.893146 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:16.893146 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:54:16.893146 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:54:16.893146 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:54:16.893146 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:54:16.893146 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:54:16.893146 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:54:16.893146 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:54:16.893146 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:54:16.893146 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:54:16.893146 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:54:16.893146 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 11:54:16.893146 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 11:54:16.893146 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 11:54:16.893146 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 11:54:16.894070 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:54:16.894070 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:54:16.894070 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 11:54:16.894070 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:54:16.894070 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 11:54:16.894070 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:54:16.894070 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:54:16.894070 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:54:16.894070 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:54:16.894070 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:54:16.894070 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:54:16.894070 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:54:16.894070 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:54:16.894070 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:54:16.894070 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:54:16.894070 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:54:16.894070 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:54:16.894070 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:54:16.895011 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:54:16.895011 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:54:16.895011 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 11:54:16.895011 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 11:54:16.895011 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 11:54:16.895011 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 11:54:16.895011 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 11:54:16.895011 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 11:54:16.895011 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 08 11:54:16.895011 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:54:16.900562 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 520/1038] 10.222.0.39 () {56 vars in 1093 bytes} [Wed Jun 8 11:54:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:54:16.901712 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547d1f2-1f0d-4f6e-90c6-5cee1fb043f3 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:17.002960 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547d1f2-1f0d-4f6e-90c6-5cee1fb043f3 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:17.038863 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600c7e0-b34f-4e55-8246-777f3237e7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:17.039545 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600c7e0-b34f-4e55-8246-777f3237e7ad None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:17.039827 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600c7e0-b34f-4e55-8246-777f3237e7ad None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:17.040098 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600c7e0-b34f-4e55-8246-777f3237e7ad None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:17.040951 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1600c7e0-b34f-4e55-8246-777f3237e7ad None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:17.041261 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1600c7e0-b34f-4e55-8246-777f3237e7ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:17.042670 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1600c7e0-b34f-4e55-8246-777f3237e7ad None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:17.060420 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 519/1039] 10.222.0.39 () {56 vars in 1133 bytes} [Wed Jun 8 11:54:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:17.065993 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e21f03-c9d3-42aa-b357-837326148f9d None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:17.179130 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e21f03-c9d3-42aa-b357-837326148f9d None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:17.212863 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca275d33-dd65-4eb0-8e60-08da65c338ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:17.213517 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca275d33-dd65-4eb0-8e60-08da65c338ec None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:17.213854 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca275d33-dd65-4eb0-8e60-08da65c338ec None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:17.214071 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca275d33-dd65-4eb0-8e60-08da65c338ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:17.268215 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:17.285950 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca275d33-dd65-4eb0-8e60-08da65c338ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:17.287955 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca275d33-dd65-4eb0-8e60-08da65c338ec None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:17.399050 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 521/1040] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:54:17 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 11:54:17.400569 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600c7e0-b34f-4e55-8246-777f3237e7ad None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:17.417171 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:17.506542 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600c7e0-b34f-4e55-8246-777f3237e7ad None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:17.543636 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3dca56-737c-434d-a463-2e8246d20c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:17.544372 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3dca56-737c-434d-a463-2e8246d20c1d None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:17.544654 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3dca56-737c-434d-a463-2e8246d20c1d None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:17.544926 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3dca56-737c-434d-a463-2e8246d20c1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:17.555257 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3dca56-737c-434d-a463-2e8246d20c1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:17.556727 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3dca56-737c-434d-a463-2e8246d20c1d None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:17.574022 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-8d3dca56-737c-434d-a463-2e8246d20c1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:54:17.574022 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:17.574022 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:54:17.574022 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:54:17.574022 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:54:17.574022 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:54:17.574022 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:54:17.574022 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:54:17.574022 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:54:17.574022 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:54:17.574022 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:54:17.574022 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:54:17.574022 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:54:17.574022 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:54:17.574022 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:54:17.574941 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:54:17.574941 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:54:17.574941 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:54:17.574941 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:54:17.574941 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:54:17.574941 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:54:17.574941 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:54:17.574941 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:54:17.574941 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:54:17.574941 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:54:17.574941 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:54:17.574941 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:54:17.574941 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:54:17.574941 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:54:17.574941 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:54:17.574941 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:54:17.574941 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:54:17.575869 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:54:17.575869 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:54:17.575869 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:54:17.575869 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:54:17.580197 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 520/1041] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:54:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:54:17.581188 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca275d33-dd65-4eb0-8e60-08da65c338ec None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:17.665299 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb39631-b3da-4ec0-9f97-69580ea78927 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:17.665589 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb39631-b3da-4ec0-9f97-69580ea78927 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:17.665871 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb39631-b3da-4ec0-9f97-69580ea78927 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:17.667244 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 521/1042] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:54:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:54:17.669633 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:17.672426 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f6250-bdf8-40bf-a0de-47fad15d88c8 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:17.672660 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f6250-bdf8-40bf-a0de-47fad15d88c8 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:17.672914 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f6250-bdf8-40bf-a0de-47fad15d88c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:17.685690 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca275d33-dd65-4eb0-8e60-08da65c338ec None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:17.692394 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-2c2f6250-bdf8-40bf-a0de-47fad15d88c8 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:54:17.694230 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-2c2f6250-bdf8-40bf-a0de-47fad15d88c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:54:17.721708 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8f662c-cc34-47e0-aaac-c5a8b9a34c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:17.722632 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f662c-cc34-47e0-aaac-c5a8b9a34c46 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:17.722914 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f662c-cc34-47e0-aaac-c5a8b9a34c46 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:17.723186 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f662c-cc34-47e0-aaac-c5a8b9a34c46 None admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:17.723900 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8f662c-cc34-47e0-aaac-c5a8b9a34c46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:17.724224 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8f662c-cc34-47e0-aaac-c5a8b9a34c46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:17.726392 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8f662c-cc34-47e0-aaac-c5a8b9a34c46 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:17.737570 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 522/1043] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:54:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:17.742955 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8f662c-cc34-47e0-aaac-c5a8b9a34c46 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:17.773504 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:17.783721 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 522/1044] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:54:17 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 11:54:17.806738 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f6250-bdf8-40bf-a0de-47fad15d88c8 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:17.853624 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8f662c-cc34-47e0-aaac-c5a8b9a34c46 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:17.889266 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c7f4a-4e4c-4588-8349-24f3e068b373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:17.890063 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c7f4a-4e4c-4588-8349-24f3e068b373 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:17.890345 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c7f4a-4e4c-4588-8349-24f3e068b373 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:17.890616 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c7f4a-4e4c-4588-8349-24f3e068b373 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:17.899784 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7c7f4a-4e4c-4588-8349-24f3e068b373 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:17.901260 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7c7f4a-4e4c-4588-8349-24f3e068b373 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:17.912470 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f6250-bdf8-40bf-a0de-47fad15d88c8 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:17.915825 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-1d7c7f4a-4e4c-4588-8349-24f3e068b373 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:54:17.915825 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:17.915825 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:54:17.915825 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:54:17.915825 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:54:17.915825 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:54:17.915825 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:54:17.915825 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:54:17.915825 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:54:17.915825 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:54:17.915825 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:54:17.915825 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:54:17.915825 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 11:54:17.915825 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 11:54:17.915825 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 11:54:17.916772 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 11:54:17.916772 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:54:17.916772 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:54:17.916772 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:54:17.916772 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:54:17.916772 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:54:17.916772 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:54:17.916772 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:54:17.916772 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:54:17.916772 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:54:17.916772 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:54:17.916772 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:54:17.916772 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:54:17.916772 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:54:17.916772 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:54:17.916772 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:54:17.916772 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:54:17.917799 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 11:54:17.917799 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 11:54:17.917799 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 11:54:17.917799 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 11:54:17.917799 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 11:54:17.917799 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 11:54:17.917799 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:54:17.917799 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:54:17.917799 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 523/1045] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Jun 8 11:54:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:54:17.922648 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c7f4a-4e4c-4588-8349-24f3e068b373 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:17.931494 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:17.954018 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9b9cb4-7690-4ce6-8521-eb7fa0e39291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:17.955394 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b9cb4-7690-4ce6-8521-eb7fa0e39291 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:17.955685 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b9cb4-7690-4ce6-8521-eb7fa0e39291 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:17.955963 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b9cb4-7690-4ce6-8521-eb7fa0e39291 None admin] PATH_INFO: `/v3/services/image` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:17.956819 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9b9cb4-7690-4ce6-8521-eb7fa0e39291 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:17.958785 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9b9cb4-7690-4ce6-8521-eb7fa0e39291 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:17.973668 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-da9b9cb4-7690-4ce6-8521-eb7fa0e39291 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 08 11:54:17.973668 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:17.973668 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 11:54:17.973668 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 11:54:17.973668 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 11:54:17.973668 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 11:54:17.973668 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 11:54:17.973668 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 11:54:17.973668 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 08 11:54:17.973668 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:54:17.973668 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 11:54:17.973668 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:54:17.973668 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:17.973668 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:54:17.973668 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:54:17.973668 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:54:17.973668 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:54:17.974672 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:54:17.974672 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:54:17.974672 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:54:17.974672 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:54:17.974672 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:54:17.974672 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:54:17.974672 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 11:54:17.974672 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 11:54:17.974672 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 11:54:17.974672 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 11:54:17.974672 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:54:17.974672 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:54:17.974672 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:54:17.974672 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:54:17.974672 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:54:17.974672 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:54:17.976794 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:54:17.976794 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:54:17.976794 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:54:17.976794 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:54:17.976794 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:54:17.976794 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:54:17.976794 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:54:17.976794 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:54:17.976794 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:54:17.976794 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:54:17.976794 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 11:54:17.976794 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 11:54:17.976794 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 08 11:54:17.976794 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:54:17.976794 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 523/1046] 10.222.0.39 () {56 vars in 1105 bytes} [Wed Jun 8 11:54:17 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 11:54:17.981737 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9b9cb4-7690-4ce6-8521-eb7fa0e39291 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:18.038561 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c7f4a-4e4c-4588-8349-24f3e068b373 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:18.049523 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:18.083996 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c47fb-47db-4db6-b572-02cad6ec0d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:18.085165 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c47fb-47db-4db6-b572-02cad6ec0d03 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:18.085485 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c47fb-47db-4db6-b572-02cad6ec0d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:18.085768 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c47fb-47db-4db6-b572-02cad6ec0d03 None admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:18.086570 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c47fb-47db-4db6-b572-02cad6ec0d03 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:18.086887 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c47fb-47db-4db6-b572-02cad6ec0d03 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:18.088358 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c47fb-47db-4db6-b572-02cad6ec0d03 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:18.099239 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9b9cb4-7690-4ce6-8521-eb7fa0e39291 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:18.107900 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 524/1047] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Jun 8 11:54:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:54:18.109186 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c47fb-47db-4db6-b572-02cad6ec0d03 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:18.135794 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb00c1f0-d286-4860-9c66-0d8c7bdd8b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:18.136609 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb00c1f0-d286-4860-9c66-0d8c7bdd8b8f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:18.136892 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb00c1f0-d286-4860-9c66-0d8c7bdd8b8f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:18.137166 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb00c1f0-d286-4860-9c66-0d8c7bdd8b8f None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:18.137869 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb00c1f0-d286-4860-9c66-0d8c7bdd8b8f None admin] RBAC: Adding query filter params (name=image) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:18.138174 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb00c1f0-d286-4860-9c66-0d8c7bdd8b8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:18.139553 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb00c1f0-d286-4860-9c66-0d8c7bdd8b8f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:18.144440 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 524/1048] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:54:17 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:54:18.150109 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb00c1f0-d286-4860-9c66-0d8c7bdd8b8f None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:18.189912 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:18.230687 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c47fb-47db-4db6-b572-02cad6ec0d03 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:18.267690 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb00c1f0-d286-4860-9c66-0d8c7bdd8b8f None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:18.267912 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3267bbb5-6c4f-420a-9a83-3b637b387900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:18.268530 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3267bbb5-6c4f-420a-9a83-3b637b387900 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:18.268883 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3267bbb5-6c4f-420a-9a83-3b637b387900 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:18.269229 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3267bbb5-6c4f-420a-9a83-3b637b387900 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:18.270157 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3267bbb5-6c4f-420a-9a83-3b637b387900 None admin] RBAC: Adding query filter params (role.id=c19874f86dad4aa1bfa44ebf9eaf6de4, scope.project.id=6a7fee684e8b43e199c95aeeb92640d4, user.id=7ef7edb5e9ce49e6b098f48bf060b228) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:18.270545 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3267bbb5-6c4f-420a-9a83-3b637b387900 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:18.272794 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3267bbb5-6c4f-420a-9a83-3b637b387900 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:18.288211 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 525/1049] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Jun 8 11:54:18 2022] GET /identity/v3/role_assignments?user.id=7ef7edb5e9ce49e6b098f48bf060b228&scope.project.id=6a7fee684e8b43e199c95aeeb92640d4&role.id=c19874f86dad4aa1bfa44ebf9eaf6de4 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:54:18.307784 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:18.323364 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19cdf67-9ff2-4bb9-a794-e1bdbed71d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:18.324061 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19cdf67-9ff2-4bb9-a794-e1bdbed71d5d None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:18.324372 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19cdf67-9ff2-4bb9-a794-e1bdbed71d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:18.324649 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19cdf67-9ff2-4bb9-a794-e1bdbed71d5d None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:18.325387 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19cdf67-9ff2-4bb9-a794-e1bdbed71d5d None admin] RBAC: Adding query filter params (type=image) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:18.325703 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19cdf67-9ff2-4bb9-a794-e1bdbed71d5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:18.327155 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19cdf67-9ff2-4bb9-a794-e1bdbed71d5d None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:18.334877 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 525/1050] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:54:18 2022] GET /identity/v3/services?type=image => generated 350 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:54:18.341262 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3267bbb5-6c4f-420a-9a83-3b637b387900 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:18.479945 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3267bbb5-6c4f-420a-9a83-3b637b387900 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:18.516511 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:18.524384 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b623c53-800a-4789-95c2-1083e55170ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:18.525271 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b623c53-800a-4789-95c2-1083e55170ee None admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:18.525758 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b623c53-800a-4789-95c2-1083e55170ee None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:18.526241 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b623c53-800a-4789-95c2-1083e55170ee None admin] PATH_INFO: `/v3/endpoints` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:18.527304 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b623c53-800a-4789-95c2-1083e55170ee None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:18.529345 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b623c53-800a-4789-95c2-1083e55170ee None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:18.554853 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 526/1051] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Jun 8 11:54:18 2022] POST /identity/v3/endpoints => generated 327 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 11:54:18.682219 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6926e-cfea-4235-b430-8191d0f93533 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:18.682602 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6926e-cfea-4235-b430-8191d0f93533 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:18.682944 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6926e-cfea-4235-b430-8191d0f93533 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:18.685426 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 526/1052] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:54:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:54:18.691096 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a7939-9680-4384-a77a-6cc288f90436 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:18.692744 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a7939-9680-4384-a77a-6cc288f90436 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:18.693034 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a7939-9680-4384-a77a-6cc288f90436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:18.720942 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-3a1a7939-9680-4384-a77a-6cc288f90436 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:54:18.722435 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-3a1a7939-9680-4384-a77a-6cc288f90436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:54:18.840307 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 527/1053] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:54:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 11:54:18.873504 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a6926e-cfea-4235-b430-8191d0f93533 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:19.002911 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a6926e-cfea-4235-b430-8191d0f93533 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:19.043045 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6a90c-c1f5-4497-9928-ccd2a1bb46e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:19.043854 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6a90c-c1f5-4497-9928-ccd2a1bb46e3 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:19.044140 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6a90c-c1f5-4497-9928-ccd2a1bb46e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:19.044448 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6a90c-c1f5-4497-9928-ccd2a1bb46e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:19.056259 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db6a90c-c1f5-4497-9928-ccd2a1bb46e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:54:19.064538 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-8db6a90c-c1f5-4497-9928-ccd2a1bb46e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:54:19.064538 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:19.064538 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:54:19.064538 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:54:19.064538 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:54:19.064538 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:54:19.064538 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:54:19.064538 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:54:19.064538 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:54:19.064538 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:54:19.064538 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:54:19.064538 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:54:19.064538 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:54:19.064538 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:54:19.064538 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:54:19.064538 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:54:19.065587 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:54:19.065587 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:54:19.065587 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:54:19.065587 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:54:19.065587 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:54:19.065587 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:54:19.065587 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:54:19.065587 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:54:19.065587 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:54:19.065587 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:54:19.065587 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:54:19.065587 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:54:19.065587 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:54:19.065587 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:54:19.065587 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:54:19.065587 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:54:19.066517 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:54:19.066517 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:54:19.066517 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:54:19.066517 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:54:19.066517 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:54:19.066517 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:54:19.066517 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:54:19.066517 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:54:19.066517 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:54:19.066517 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:54:19.066517 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:54:19.066517 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:54:19.071463 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 527/1054] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Jun 8 11:54:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:54:19.072545 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a7939-9680-4384-a77a-6cc288f90436 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:19.183872 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a7939-9680-4384-a77a-6cc288f90436 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:19.198101 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:19.221383 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b6ab5e-0877-484e-a978-1a7cb2079a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:19.222313 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6ab5e-0877-484e-a978-1a7cb2079a65 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:19.222606 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6ab5e-0877-484e-a978-1a7cb2079a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:19.222887 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6ab5e-0877-484e-a978-1a7cb2079a65 None admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:19.223639 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b6ab5e-0877-484e-a978-1a7cb2079a65 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:19.223951 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b6ab5e-0877-484e-a978-1a7cb2079a65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:19.225972 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b6ab5e-0877-484e-a978-1a7cb2079a65 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:19.238674 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 528/1055] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:54:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:19.239917 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6a90c-c1f5-4497-9928-ccd2a1bb46e3 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:19.293116 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:19.347601 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6a90c-c1f5-4497-9928-ccd2a1bb46e3 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:19.383563 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d086e-34a0-451c-8287-cd4c9e43e0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:19.384481 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d086e-34a0-451c-8287-cd4c9e43e0d5 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:19.384770 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d086e-34a0-451c-8287-cd4c9e43e0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:19.385047 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d086e-34a0-451c-8287-cd4c9e43e0d5 None admin] PATH_INFO: `/v3/users/271f11bf7f434868b8e5f88a3e93bf70` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:19.398895 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d086e-34a0-451c-8287-cd4c9e43e0d5 None admin] RBAC: Authorizing `identity:get_user(user_id=271f11bf7f434868b8e5f88a3e93bf70)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:19.400591 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d086e-34a0-451c-8287-cd4c9e43e0d5 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:19.406822 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 528/1056] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Jun 8 11:54:19 2022] GET /identity/v3/users/271f11bf7f434868b8e5f88a3e93bf70 => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:19.407960 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b6ab5e-0877-484e-a978-1a7cb2079a65 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:19.511205 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b6ab5e-0877-484e-a978-1a7cb2079a65 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:19.546101 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d0a4c-9b9c-409d-9125-b47482077350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:19.546755 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d0a4c-9b9c-409d-9125-b47482077350 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:19.547069 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d0a4c-9b9c-409d-9125-b47482077350 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:19.547304 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d0a4c-9b9c-409d-9125-b47482077350 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:19.595321 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:19.622638 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d0a4c-9b9c-409d-9125-b47482077350 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:19.624088 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d0a4c-9b9c-409d-9125-b47482077350 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:19.723930 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 529/1057] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:54:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 11:54:19.729643 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d086e-34a0-451c-8287-cd4c9e43e0d5 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:19.835090 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d086e-34a0-451c-8287-cd4c9e43e0d5 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:19.843711 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:19.873451 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee7117-c6dc-4aab-ada6-181d0419e327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:19.874321 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee7117-c6dc-4aab-ada6-181d0419e327 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:19.874608 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee7117-c6dc-4aab-ada6-181d0419e327 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:19.874885 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee7117-c6dc-4aab-ada6-181d0419e327 None admin] PATH_INFO: `/v3/projects/7f742ce9dcdf473f86b770a0cd7ade90` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:19.876057 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ee7117-c6dc-4aab-ada6-181d0419e327 None admin] RBAC: Authorizing `identity:get_project(project_id=7f742ce9dcdf473f86b770a0cd7ade90)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:19.877532 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ee7117-c6dc-4aab-ada6-181d0419e327 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:19.884470 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 529/1058] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Jun 8 11:54:19 2022] GET /identity/v3/projects/7f742ce9dcdf473f86b770a0cd7ade90 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:19.885700 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d0a4c-9b9c-409d-9125-b47482077350 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:19.962937 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:19.990545 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d0a4c-9b9c-409d-9125-b47482077350 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:20.025027 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463b9b0-078e-4056-8573-e24a47e9add6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:20.025686 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463b9b0-078e-4056-8573-e24a47e9add6 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:20.025964 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463b9b0-078e-4056-8573-e24a47e9add6 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:20.026232 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463b9b0-078e-4056-8573-e24a47e9add6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:20.027057 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4463b9b0-078e-4056-8573-e24a47e9add6 None admin] RBAC: Adding query filter params (role.id=028d4429a4554bbb88b3aec9f6a9d937, scope.project.id=7f742ce9dcdf473f86b770a0cd7ade90, user.id=271f11bf7f434868b8e5f88a3e93bf70) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:20.027368 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4463b9b0-078e-4056-8573-e24a47e9add6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:20.028813 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4463b9b0-078e-4056-8573-e24a47e9add6 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:20.040203 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 530/1059] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Jun 8 11:54:19 2022] GET /identity/v3/role_assignments?user.id=271f11bf7f434868b8e5f88a3e93bf70&scope.project.id=7f742ce9dcdf473f86b770a0cd7ade90&role.id=028d4429a4554bbb88b3aec9f6a9d937 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:54:20.626921 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5dd455-91ad-4823-8486-687ed086bebb None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:20.627492 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5dd455-91ad-4823-8486-687ed086bebb None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:20.627492 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5dd455-91ad-4823-8486-687ed086bebb None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:20.629122 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 530/1060] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:54:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:54:20.635114 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a424a-e5b7-4635-aeee-46f0843dda6a None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:20.635662 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a424a-e5b7-4635-aeee-46f0843dda6a None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:20.635662 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a424a-e5b7-4635-aeee-46f0843dda6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:20.654322 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-905a424a-e5b7-4635-aeee-46f0843dda6a None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:54:20.655546 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-905a424a-e5b7-4635-aeee-46f0843dda6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:54:20.728872 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 531/1061] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:54:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 11:54:20.751999 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5dd455-91ad-4823-8486-687ed086bebb None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:20.858067 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5dd455-91ad-4823-8486-687ed086bebb None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:20.894584 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e23a8f-5aa4-441a-924e-5e494694ee12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:20.895397 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e23a8f-5aa4-441a-924e-5e494694ee12 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:20.895680 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e23a8f-5aa4-441a-924e-5e494694ee12 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:20.895955 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e23a8f-5aa4-441a-924e-5e494694ee12 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:20.906524 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e23a8f-5aa4-441a-924e-5e494694ee12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:54:20.915362 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-73e23a8f-5aa4-441a-924e-5e494694ee12 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 08 11:54:20.915362 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:20.915362 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:54:20.915362 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:54:20.915362 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:54:20.915362 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:54:20.915362 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:54:20.915362 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:54:20.915362 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:54:20.915362 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:54:20.915362 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:54:20.915362 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:54:20.915362 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:54:20.915362 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:54:20.915362 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:54:20.915362 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:54:20.916536 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:54:20.916536 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:54:20.916536 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:54:20.916536 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:54:20.916536 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:54:20.916536 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:54:20.916536 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:54:20.916536 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:54:20.916536 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:54:20.916536 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:54:20.916536 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:54:20.916536 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:54:20.916536 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:54:20.916536 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:54:20.916536 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:54:20.916536 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:54:20.917406 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:54:20.917406 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:54:20.917406 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:54:20.917406 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:54:20.917406 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:54:20.917406 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:54:20.917406 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:54:20.917406 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:54:20.917406 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:54:20.917406 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:54:20.917406 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 08 11:54:20.917406 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:54:20.920243 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 531/1062] 10.222.0.39 () {56 vars in 1120 bytes} [Wed Jun 8 11:54:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:54:20.922921 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a424a-e5b7-4635-aeee-46f0843dda6a None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:20.965081 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea85027-b148-41dc-a023-60dd94afd93e None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:20.965396 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea85027-b148-41dc-a023-60dd94afd93e None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:20.965644 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea85027-b148-41dc-a023-60dd94afd93e None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:20.967164 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 532/1063] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:54:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:54:20.971775 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1e578-0abb-4718-ab7a-01420ae22b31 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:20.972353 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1e578-0abb-4718-ab7a-01420ae22b31 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:20.972613 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1e578-0abb-4718-ab7a-01420ae22b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:20.989592 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-98c1e578-0abb-4718-ab7a-01420ae22b31 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:54:20.991531 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-98c1e578-0abb-4718-ab7a-01420ae22b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:54:20.993692 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:21.018967 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:21.031577 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a424a-e5b7-4635-aeee-46f0843dda6a None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:21.063283 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 533/1064] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:54:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 11:54:21.068974 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b399a28-31cf-456c-adf1-9a56e60302b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:21.069740 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b399a28-31cf-456c-adf1-9a56e60302b3 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:21.070090 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b399a28-31cf-456c-adf1-9a56e60302b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:21.070430 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b399a28-31cf-456c-adf1-9a56e60302b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:21.071242 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b399a28-31cf-456c-adf1-9a56e60302b3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:21.071612 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b399a28-31cf-456c-adf1-9a56e60302b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:21.073089 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b399a28-31cf-456c-adf1-9a56e60302b3 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:21.081520 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 532/1065] 10.222.0.39 () {56 vars in 1115 bytes} [Wed Jun 8 11:54:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:54:21.085852 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c1e578-0abb-4718-ab7a-01420ae22b31 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:21.087138 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b399a28-31cf-456c-adf1-9a56e60302b3 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:21.193635 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b399a28-31cf-456c-adf1-9a56e60302b3 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:21.193824 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c1e578-0abb-4718-ab7a-01420ae22b31 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:21.225379 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:21.231709 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd1ef22-f242-42ad-9a82-cc4a56fc125a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:21.232714 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15525a-4bd7-4e07-a0ed-2bc954990c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:21.232936 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1ef22-f242-42ad-9a82-cc4a56fc125a None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:21.233373 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1ef22-f242-42ad-9a82-cc4a56fc125a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:21.233552 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15525a-4bd7-4e07-a0ed-2bc954990c54 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:21.233701 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1ef22-f242-42ad-9a82-cc4a56fc125a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:21.233855 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15525a-4bd7-4e07-a0ed-2bc954990c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:21.234081 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15525a-4bd7-4e07-a0ed-2bc954990c54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:21.248276 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f15525a-4bd7-4e07-a0ed-2bc954990c54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:21.250043 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f15525a-4bd7-4e07-a0ed-2bc954990c54 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:21.268302 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-0f15525a-4bd7-4e07-a0ed-2bc954990c54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:54:21.268302 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:21.268302 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:54:21.268302 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:54:21.268302 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:54:21.268302 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:54:21.268302 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:54:21.268302 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:54:21.268302 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:54:21.268302 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:54:21.268302 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:54:21.268302 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:54:21.268302 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:54:21.268302 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:54:21.268302 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:54:21.269262 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:54:21.269262 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:54:21.269262 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:54:21.269262 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:54:21.269262 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:54:21.269262 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:54:21.269262 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:54:21.269262 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:54:21.269262 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:54:21.269262 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:54:21.269262 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:54:21.269262 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:54:21.269262 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:54:21.269262 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:54:21.269262 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:54:21.269262 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:54:21.269262 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:54:21.270168 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:54:21.270168 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:54:21.270168 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:54:21.270168 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:54:21.271915 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:21.274828 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 533/1066] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:54:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 11:54:21.275712 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15525a-4bd7-4e07-a0ed-2bc954990c54 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:21.312561 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd1ef22-f242-42ad-9a82-cc4a56fc125a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:21.314061 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd1ef22-f242-42ad-9a82-cc4a56fc125a None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:21.393147 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15525a-4bd7-4e07-a0ed-2bc954990c54 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:21.419151 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 534/1067] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:54:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 11:54:21.424706 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd1ef22-f242-42ad-9a82-cc4a56fc125a None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:21.431534 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f55a62-d1af-48f9-af15-1bebb268490f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:21.432236 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f55a62-d1af-48f9-af15-1bebb268490f None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:21.432529 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f55a62-d1af-48f9-af15-1bebb268490f None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:21.432809 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f55a62-d1af-48f9-af15-1bebb268490f None admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:21.433546 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f55a62-d1af-48f9-af15-1bebb268490f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:21.433856 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f55a62-d1af-48f9-af15-1bebb268490f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:21.435232 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f55a62-d1af-48f9-af15-1bebb268490f None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:21.448102 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 534/1068] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:54:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:21.453508 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f55a62-d1af-48f9-af15-1bebb268490f None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:21.492986 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:21.503179 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:21.538020 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd1ef22-f242-42ad-9a82-cc4a56fc125a None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:21.567721 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f55a62-d1af-48f9-af15-1bebb268490f None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:21.573593 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717adbd-e477-4975-aa0b-704bea32e3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:21.574393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717adbd-e477-4975-aa0b-704bea32e3f8 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:21.574676 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717adbd-e477-4975-aa0b-704bea32e3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:21.574982 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717adbd-e477-4975-aa0b-704bea32e3f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:21.592665 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6717adbd-e477-4975-aa0b-704bea32e3f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:21.594566 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6717adbd-e477-4975-aa0b-704bea32e3f8 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:21.612086 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea599a-de3a-4f7c-a99e-e98b0cfe1df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:21.613048 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea599a-de3a-4f7c-a99e-e98b0cfe1df2 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:21.613333 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea599a-de3a-4f7c-a99e-e98b0cfe1df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:21.613607 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea599a-de3a-4f7c-a99e-e98b0cfe1df2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:21.616532 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-6717adbd-e477-4975-aa0b-704bea32e3f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:54:21.616532 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:21.616532 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:54:21.616532 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:54:21.616532 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:54:21.616532 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:54:21.616532 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:54:21.616532 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:54:21.616532 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:54:21.616532 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:54:21.616532 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:54:21.616532 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:54:21.616532 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:54:21.616532 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:54:21.616532 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:54:21.617416 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:54:21.617416 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:54:21.617416 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:54:21.617416 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:54:21.617416 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:54:21.617416 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:54:21.617416 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:54:21.617416 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:54:21.617416 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:54:21.617416 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:54:21.617416 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:54:21.617416 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:54:21.617416 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:54:21.617416 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:54:21.617416 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:54:21.617416 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:54:21.617416 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:54:21.618327 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:54:21.618327 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:54:21.618327 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:54:21.618327 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:54:21.618327 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 535/1069] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:54:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:54:21.623623 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717adbd-e477-4975-aa0b-704bea32e3f8 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:21.624952 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adea599a-de3a-4f7c-a99e-e98b0cfe1df2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:21.626420 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adea599a-de3a-4f7c-a99e-e98b0cfe1df2 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:21.641910 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-adea599a-de3a-4f7c-a99e-e98b0cfe1df2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 08 11:54:21.641910 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:21.641910 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:54:21.641910 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:54:21.641910 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:54:21.641910 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:54:21.641910 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:54:21.641910 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:54:21.641910 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:54:21.641910 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:54:21.641910 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:54:21.641910 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:54:21.641910 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 11:54:21.641910 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 11:54:21.641910 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 11:54:21.641910 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 11:54:21.643485 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:54:21.643485 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:54:21.643485 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 11:54:21.643485 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:54:21.643485 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 11:54:21.643485 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:54:21.643485 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:54:21.643485 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:54:21.643485 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:54:21.643485 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:54:21.643485 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:54:21.643485 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:54:21.643485 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:54:21.643485 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:54:21.643485 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:54:21.643485 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:54:21.643485 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:54:21.643485 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:54:21.644593 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:54:21.644593 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:54:21.644593 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 11:54:21.644593 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 11:54:21.644593 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 11:54:21.644593 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 11:54:21.644593 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 11:54:21.644593 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 11:54:21.644593 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 08 11:54:21.644593 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:54:21.644593 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 535/1070] 10.222.0.39 () {56 vars in 1093 bytes} [Wed Jun 8 11:54:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 11:54:21.650835 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea599a-de3a-4f7c-a99e-e98b0cfe1df2 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:21.731593 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717adbd-e477-4975-aa0b-704bea32e3f8 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:21.748664 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:21.762852 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea599a-de3a-4f7c-a99e-e98b0cfe1df2 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:21.764846 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:21.769213 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75417ec1-048c-4a4a-8a4d-59fc79b86411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:21.769887 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75417ec1-048c-4a4a-8a4d-59fc79b86411 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:21.770170 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75417ec1-048c-4a4a-8a4d-59fc79b86411 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:21.770446 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75417ec1-048c-4a4a-8a4d-59fc79b86411 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:21.771176 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75417ec1-048c-4a4a-8a4d-59fc79b86411 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:21.771480 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75417ec1-048c-4a4a-8a4d-59fc79b86411 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:21.773026 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75417ec1-048c-4a4a-8a4d-59fc79b86411 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:21.785256 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 536/1071] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:54:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:54:21.817113 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43213c9a-5690-4aa5-b317-a0fc567b717b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:21.817856 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43213c9a-5690-4aa5-b317-a0fc567b717b None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:21.818141 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43213c9a-5690-4aa5-b317-a0fc567b717b None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:21.818454 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43213c9a-5690-4aa5-b317-a0fc567b717b None admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:21.819340 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43213c9a-5690-4aa5-b317-a0fc567b717b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:21.819652 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43213c9a-5690-4aa5-b317-a0fc567b717b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:21.821214 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43213c9a-5690-4aa5-b317-a0fc567b717b None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:21.841357 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 536/1072] 10.222.0.39 () {56 vars in 1133 bytes} [Wed Jun 8 11:54:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:21.847114 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75417ec1-048c-4a4a-8a4d-59fc79b86411 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:21.964218 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75417ec1-048c-4a4a-8a4d-59fc79b86411 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:22.006571 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c27fd-a475-47db-a9bb-474b53a850e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:22.007172 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c27fd-a475-47db-a9bb-474b53a850e5 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:22.007454 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c27fd-a475-47db-a9bb-474b53a850e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:22.007722 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c27fd-a475-47db-a9bb-474b53a850e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:22.019573 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73c27fd-a475-47db-a9bb-474b53a850e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:22.021067 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73c27fd-a475-47db-a9bb-474b53a850e5 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:22.039795 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-e73c27fd-a475-47db-a9bb-474b53a850e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:54:22.039795 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:22.039795 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:54:22.039795 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:54:22.039795 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:54:22.039795 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:54:22.039795 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:54:22.039795 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:54:22.039795 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:54:22.039795 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:54:22.039795 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:54:22.039795 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:54:22.039795 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:54:22.039795 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:54:22.039795 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:54:22.040846 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:54:22.040846 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:54:22.040846 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:54:22.040846 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:54:22.040846 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:54:22.040846 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:54:22.040846 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:54:22.040846 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:54:22.040846 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:54:22.040846 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:54:22.040846 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:54:22.040846 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:54:22.040846 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:54:22.040846 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:54:22.040846 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:54:22.040846 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:54:22.040846 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:54:22.041751 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:54:22.041751 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:54:22.041751 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:54:22.041751 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:54:22.044256 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 537/1073] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:54:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:54:22.046994 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43213c9a-5690-4aa5-b317-a0fc567b717b None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:22.155940 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43213c9a-5690-4aa5-b317-a0fc567b717b None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:22.189517 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d5656c-cb07-4914-94b0-4c962b836a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:22.190182 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5656c-cb07-4914-94b0-4c962b836a8d None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:22.190487 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5656c-cb07-4914-94b0-4c962b836a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:22.190746 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5656c-cb07-4914-94b0-4c962b836a8d None admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:22.191464 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d5656c-cb07-4914-94b0-4c962b836a8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:22.191768 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d5656c-cb07-4914-94b0-4c962b836a8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:22.193167 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d5656c-cb07-4914-94b0-4c962b836a8d None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:22.205065 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 537/1074] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:54:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:22.210948 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c27fd-a475-47db-a9bb-474b53a850e5 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:22.238972 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:22.303328 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5d700-78a6-4c94-865d-d8c19352a2c5 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:22.303571 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5d700-78a6-4c94-865d-d8c19352a2c5 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:22.303802 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5d700-78a6-4c94-865d-d8c19352a2c5 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:22.305362 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 538/1075] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:54:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:54:22.309973 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5668178f-df83-4091-8070-bd7697b8d324 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:22.310268 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5668178f-df83-4091-8070-bd7697b8d324 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:22.310552 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5668178f-df83-4091-8070-bd7697b8d324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:22.312224 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c27fd-a475-47db-a9bb-474b53a850e5 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:22.327242 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-5668178f-df83-4091-8070-bd7697b8d324 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:54:22.328463 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-5668178f-df83-4091-8070-bd7697b8d324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:54:22.342952 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:22.348336 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa2906-2849-45d3-ad0d-1a355e67baf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:22.349136 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa2906-2849-45d3-ad0d-1a355e67baf1 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:22.349420 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa2906-2849-45d3-ad0d-1a355e67baf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:22.349751 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa2906-2849-45d3-ad0d-1a355e67baf1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:22.356542 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfa2906-2849-45d3-ad0d-1a355e67baf1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:22.357975 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfa2906-2849-45d3-ad0d-1a355e67baf1 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:22.371899 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-edfa2906-2849-45d3-ad0d-1a355e67baf1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:54:22.371899 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:22.371899 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:54:22.371899 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:54:22.371899 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:54:22.371899 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:54:22.371899 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:54:22.371899 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:54:22.371899 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:54:22.371899 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:54:22.371899 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:54:22.371899 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:54:22.371899 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 11:54:22.371899 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 11:54:22.371899 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 11:54:22.372834 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 11:54:22.372834 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:54:22.372834 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:54:22.372834 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:54:22.372834 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:54:22.372834 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:54:22.372834 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:54:22.372834 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:54:22.372834 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:54:22.372834 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:54:22.372834 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:54:22.372834 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:54:22.372834 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:54:22.372834 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:54:22.372834 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:54:22.372834 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:54:22.372834 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:54:22.373977 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 11:54:22.373977 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 11:54:22.373977 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 11:54:22.373977 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 11:54:22.373977 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 11:54:22.373977 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 11:54:22.373977 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:54:22.373977 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:54:22.373977 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 538/1076] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Jun 8 11:54:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:54:22.378824 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa2906-2849-45d3-ad0d-1a355e67baf1 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:22.398614 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 539/1077] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:54:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 11:54:22.421937 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5668178f-df83-4091-8070-bd7697b8d324 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:22.465531 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:22.478926 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa2906-2849-45d3-ad0d-1a355e67baf1 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:22.513576 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a8982c-9d65-4e17-9b44-5b9c92e875f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:22.514317 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a8982c-9d65-4e17-9b44-5b9c92e875f2 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:22.514676 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a8982c-9d65-4e17-9b44-5b9c92e875f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:22.514877 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a8982c-9d65-4e17-9b44-5b9c92e875f2 None admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:22.515660 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a8982c-9d65-4e17-9b44-5b9c92e875f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:22.515971 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a8982c-9d65-4e17-9b44-5b9c92e875f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:22.517448 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a8982c-9d65-4e17-9b44-5b9c92e875f2 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:22.519350 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5668178f-df83-4091-8070-bd7697b8d324 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:22.528976 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 539/1078] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Jun 8 11:54:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:54:22.534938 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a8982c-9d65-4e17-9b44-5b9c92e875f2 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:22.553551 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24987d69-8ce7-4a90-9e41-b2c0aafe4335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:22.554271 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24987d69-8ce7-4a90-9e41-b2c0aafe4335 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:22.554555 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24987d69-8ce7-4a90-9e41-b2c0aafe4335 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:22.554829 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24987d69-8ce7-4a90-9e41-b2c0aafe4335 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:22.565048 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24987d69-8ce7-4a90-9e41-b2c0aafe4335 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:54:22.573542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-24987d69-8ce7-4a90-9e41-b2c0aafe4335 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:54:22.573542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:22.573542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:54:22.573542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:54:22.573542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:54:22.573542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:54:22.573542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:54:22.573542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:54:22.573542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:54:22.573542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:54:22.573542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:54:22.573542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:54:22.573542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:54:22.573542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:54:22.573542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:54:22.573542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:54:22.574702 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:54:22.574702 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:54:22.574702 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:54:22.574702 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:54:22.574702 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:54:22.574702 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:54:22.574702 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:54:22.574702 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:54:22.574702 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:54:22.574702 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:54:22.574702 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:54:22.574702 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:54:22.574702 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:54:22.574702 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:54:22.574702 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:54:22.574702 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:54:22.575658 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:54:22.575658 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:54:22.575658 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:54:22.575658 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:54:22.575658 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:54:22.575658 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:54:22.575658 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:54:22.575658 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:54:22.575658 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:54:22.575658 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:54:22.575658 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:54:22.575658 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:54:22.575658 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 540/1079] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Jun 8 11:54:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 11:54:22.580642 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24987d69-8ce7-4a90-9e41-b2c0aafe4335 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:22.593479 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:22.642094 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a8982c-9d65-4e17-9b44-5b9c92e875f2 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:22.675027 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbae373-d4cd-4a1d-a852-8975a9c9d936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:22.675907 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbae373-d4cd-4a1d-a852-8975a9c9d936 None admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:22.676205 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbae373-d4cd-4a1d-a852-8975a9c9d936 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:22.676479 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbae373-d4cd-4a1d-a852-8975a9c9d936 None admin] PATH_INFO: `/v3/projects/6a7fee684e8b43e199c95aeeb92640d4/users/7ef7edb5e9ce49e6b098f48bf060b228/roles/c19874f86dad4aa1bfa44ebf9eaf6de4` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:22.679552 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbae373-d4cd-4a1d-a852-8975a9c9d936 None admin] RBAC: Authorizing `identity:create_grant(project_id=6a7fee684e8b43e199c95aeeb92640d4, user_id=7ef7edb5e9ce49e6b098f48bf060b228, role_id=c19874f86dad4aa1bfa44ebf9eaf6de4)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:22.679720 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24987d69-8ce7-4a90-9e41-b2c0aafe4335 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:22.681017 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbae373-d4cd-4a1d-a852-8975a9c9d936 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:22.693948 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 540/1080] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Jun 8 11:54:22 2022] PUT /identity/v3/projects/6a7fee684e8b43e199c95aeeb92640d4/users/7ef7edb5e9ce49e6b098f48bf060b228/roles/c19874f86dad4aa1bfa44ebf9eaf6de4 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 11:54:22.715594 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e50837-b8d6-447c-98b0-cd96904493b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:22.716342 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e50837-b8d6-447c-98b0-cd96904493b7 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:22.716631 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e50837-b8d6-447c-98b0-cd96904493b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:22.716910 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e50837-b8d6-447c-98b0-cd96904493b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:22.717681 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e50837-b8d6-447c-98b0-cd96904493b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:22.717993 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e50837-b8d6-447c-98b0-cd96904493b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:22.719414 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e50837-b8d6-447c-98b0-cd96904493b7 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:22.730698 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 541/1081] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:54:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:54:22.736805 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbae373-d4cd-4a1d-a852-8975a9c9d936 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:22.749621 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:22.847930 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbae373-d4cd-4a1d-a852-8975a9c9d936 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:22.885735 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e42011-2bd9-4eb2-8118-b8b55a33f2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:22.885735 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e42011-2bd9-4eb2-8118-b8b55a33f2d5 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:22.886037 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e42011-2bd9-4eb2-8118-b8b55a33f2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:22.886270 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e42011-2bd9-4eb2-8118-b8b55a33f2d5 None admin] PATH_INFO: `/v3/users/271f11bf7f434868b8e5f88a3e93bf70` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:22.888012 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e42011-2bd9-4eb2-8118-b8b55a33f2d5 None admin] RBAC: Authorizing `identity:get_user(user_id=271f11bf7f434868b8e5f88a3e93bf70)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:22.889510 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e42011-2bd9-4eb2-8118-b8b55a33f2d5 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:22.891305 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 541/1082] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Jun 8 11:54:22 2022] GET /identity/v3/users/271f11bf7f434868b8e5f88a3e93bf70 => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:22.897573 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e50837-b8d6-447c-98b0-cd96904493b7 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:22.968906 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:22.999373 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e50837-b8d6-447c-98b0-cd96904493b7 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:23.032626 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d44996-420a-45b9-8646-8d666df6aae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:23.033492 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d44996-420a-45b9-8646-8d666df6aae0 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:23.033771 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d44996-420a-45b9-8646-8d666df6aae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:23.034043 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d44996-420a-45b9-8646-8d666df6aae0 None admin] PATH_INFO: `/v3/projects/7f742ce9dcdf473f86b770a0cd7ade90` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:23.035195 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d44996-420a-45b9-8646-8d666df6aae0 None admin] RBAC: Authorizing `identity:get_project(project_id=7f742ce9dcdf473f86b770a0cd7ade90)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:23.036664 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d44996-420a-45b9-8646-8d666df6aae0 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:23.044761 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 542/1083] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Jun 8 11:54:22 2022] GET /identity/v3/projects/7f742ce9dcdf473f86b770a0cd7ade90 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:23.046190 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e42011-2bd9-4eb2-8118-b8b55a33f2d5 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:23.121563 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:23.144489 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e42011-2bd9-4eb2-8118-b8b55a33f2d5 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:23.177574 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29781577-5b1d-40e2-aa98-d094b3871f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:23.178694 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29781577-5b1d-40e2-aa98-d094b3871f52 None admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:23.178976 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29781577-5b1d-40e2-aa98-d094b3871f52 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:23.179248 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29781577-5b1d-40e2-aa98-d094b3871f52 None admin] PATH_INFO: `/v3/projects/7f742ce9dcdf473f86b770a0cd7ade90/users/271f11bf7f434868b8e5f88a3e93bf70/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:23.181208 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29781577-5b1d-40e2-aa98-d094b3871f52 None admin] RBAC: Authorizing `identity:create_grant(project_id=7f742ce9dcdf473f86b770a0cd7ade90, user_id=271f11bf7f434868b8e5f88a3e93bf70, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:23.182625 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29781577-5b1d-40e2-aa98-d094b3871f52 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:23.196876 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 542/1084] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Jun 8 11:54:23 2022] PUT /identity/v3/projects/7f742ce9dcdf473f86b770a0cd7ade90/users/271f11bf7f434868b8e5f88a3e93bf70/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 11:54:24.928231 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3904aba-1dda-4f50-bda5-11339afdd8bb None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:24.928808 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3904aba-1dda-4f50-bda5-11339afdd8bb None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:24.928808 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3904aba-1dda-4f50-bda5-11339afdd8bb None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:24.930138 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 543/1085] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:54:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:54:24.935474 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aefd1b-4dc8-400b-af5a-c5c634f87d85 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:24.935950 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aefd1b-4dc8-400b-af5a-c5c634f87d85 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:24.936182 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aefd1b-4dc8-400b-af5a-c5c634f87d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:24.952850 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-20aefd1b-4dc8-400b-af5a-c5c634f87d85 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:54:24.954052 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-20aefd1b-4dc8-400b-af5a-c5c634f87d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:54:25.021051 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 543/1086] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:54:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 11:54:25.045320 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3904aba-1dda-4f50-bda5-11339afdd8bb None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:25.150734 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3904aba-1dda-4f50-bda5-11339afdd8bb None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:25.184280 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a4c01-1c38-4fc1-a1a5-e3ab48b1f7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:25.185026 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a4c01-1c38-4fc1-a1a5-e3ab48b1f7b6 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:25.185315 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a4c01-1c38-4fc1-a1a5-e3ab48b1f7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:25.185595 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a4c01-1c38-4fc1-a1a5-e3ab48b1f7b6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:25.193080 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:25.196487 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209a4c01-1c38-4fc1-a1a5-e3ab48b1f7b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:54:25.204768 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-209a4c01-1c38-4fc1-a1a5-e3ab48b1f7b6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 08 11:54:25.204768 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:25.204768 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:54:25.204768 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:54:25.204768 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:54:25.204768 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:54:25.204768 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:54:25.204768 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:54:25.204768 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:54:25.204768 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:54:25.204768 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:54:25.204768 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:54:25.204768 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:54:25.204768 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:54:25.204768 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:54:25.204768 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:54:25.205769 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:54:25.205769 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:54:25.205769 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:54:25.205769 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:54:25.205769 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:54:25.205769 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:54:25.205769 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:54:25.205769 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:54:25.205769 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:54:25.205769 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:54:25.205769 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:54:25.205769 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:54:25.205769 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:54:25.205769 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:54:25.205769 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:54:25.205769 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:54:25.206612 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:54:25.206612 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:54:25.206612 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:54:25.206612 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:54:25.206612 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:54:25.206612 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:54:25.206612 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:54:25.206612 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:54:25.206612 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:54:25.206612 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:54:25.206612 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 08 11:54:25.206612 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:54:25.206612 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 544/1087] 10.222.0.39 () {56 vars in 1120 bytes} [Wed Jun 8 11:54:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:54:25.212589 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aefd1b-4dc8-400b-af5a-c5c634f87d85 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:25.275415 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:25.310737 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aefd1b-4dc8-400b-af5a-c5c634f87d85 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:25.345199 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a820ad-b767-48f7-ab3a-00c1071845d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:25.346025 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a820ad-b767-48f7-ab3a-00c1071845d2 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:25.346434 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a820ad-b767-48f7-ab3a-00c1071845d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:25.346994 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a820ad-b767-48f7-ab3a-00c1071845d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:25.348084 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a820ad-b767-48f7-ab3a-00c1071845d2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:25.348786 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a820ad-b767-48f7-ab3a-00c1071845d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:25.351223 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a820ad-b767-48f7-ab3a-00c1071845d2 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:25.361256 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 544/1088] 10.222.0.39 () {56 vars in 1115 bytes} [Wed Jun 8 11:54:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:25.368103 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a4c01-1c38-4fc1-a1a5-e3ab48b1f7b6 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:25.432770 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1e20e-8cb3-420f-91c2-80ee75e16a95 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:25.433074 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1e20e-8cb3-420f-91c2-80ee75e16a95 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:25.433346 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1e20e-8cb3-420f-91c2-80ee75e16a95 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:25.434774 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 545/1089] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:54:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:54:25.439660 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249c226-fc4c-42b9-8568-5b1a5cb1ac15 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:25.439942 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249c226-fc4c-42b9-8568-5b1a5cb1ac15 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:25.440246 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249c226-fc4c-42b9-8568-5b1a5cb1ac15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:25.456418 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-d249c226-fc4c-42b9-8568-5b1a5cb1ac15 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:54:25.457603 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-d249c226-fc4c-42b9-8568-5b1a5cb1ac15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:54:25.468651 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a4c01-1c38-4fc1-a1a5-e3ab48b1f7b6 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:25.503568 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495dc2c0-d2a3-49be-88b4-75febd3209d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:25.504393 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495dc2c0-d2a3-49be-88b4-75febd3209d1 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:25.504669 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495dc2c0-d2a3-49be-88b4-75febd3209d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:25.504950 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495dc2c0-d2a3-49be-88b4-75febd3209d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:25.515195 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495dc2c0-d2a3-49be-88b4-75febd3209d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:25.516671 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495dc2c0-d2a3-49be-88b4-75febd3209d1 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:25.523711 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 546/1090] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:54:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 11:54:25.533376 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-495dc2c0-d2a3-49be-88b4-75febd3209d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:54:25.533376 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:25.533376 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:54:25.533376 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:54:25.533376 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:54:25.533376 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:54:25.533376 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:54:25.533376 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:54:25.533376 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:54:25.533376 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:54:25.533376 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:54:25.533376 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:54:25.533376 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:54:25.533376 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:54:25.533376 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:54:25.534456 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:54:25.534456 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:54:25.534456 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:54:25.534456 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:54:25.534456 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:54:25.534456 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:54:25.534456 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:54:25.534456 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:54:25.534456 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:54:25.534456 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:54:25.534456 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:54:25.534456 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:54:25.534456 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:54:25.534456 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:54:25.534456 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:54:25.534456 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:54:25.534456 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:54:25.535383 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:54:25.535383 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:54:25.535383 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:54:25.535383 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:54:25.535383 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 545/1091] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:54:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:54:25.541032 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d249c226-fc4c-42b9-8568-5b1a5cb1ac15 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:25.547527 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495dc2c0-d2a3-49be-88b4-75febd3209d1 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:25.608315 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:25.614546 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:25.655756 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d249c226-fc4c-42b9-8568-5b1a5cb1ac15 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:25.665345 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495dc2c0-d2a3-49be-88b4-75febd3209d1 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:25.690142 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb4b5b-0e3f-4168-869a-37546bcf7112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:25.690735 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb4b5b-0e3f-4168-869a-37546bcf7112 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:25.691023 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb4b5b-0e3f-4168-869a-37546bcf7112 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:25.691301 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb4b5b-0e3f-4168-869a-37546bcf7112 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:25.692049 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeb4b5b-0e3f-4168-869a-37546bcf7112 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:25.692390 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeb4b5b-0e3f-4168-869a-37546bcf7112 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:25.693768 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeb4b5b-0e3f-4168-869a-37546bcf7112 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:25.698637 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656854ba-af8c-41b5-a6e7-fa1f4dfbce52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:25.699431 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656854ba-af8c-41b5-a6e7-fa1f4dfbce52 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:25.699719 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656854ba-af8c-41b5-a6e7-fa1f4dfbce52 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:25.700001 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656854ba-af8c-41b5-a6e7-fa1f4dfbce52 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:25.704923 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 547/1092] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:54:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:25.711047 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb4b5b-0e3f-4168-869a-37546bcf7112 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:25.711187 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656854ba-af8c-41b5-a6e7-fa1f4dfbce52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:54:25.718686 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-656854ba-af8c-41b5-a6e7-fa1f4dfbce52 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:54:25.718686 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:25.718686 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:54:25.718686 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:54:25.718686 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:54:25.718686 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:54:25.718686 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:54:25.718686 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:54:25.718686 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:54:25.718686 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:54:25.718686 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:54:25.718686 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:54:25.718686 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:54:25.718686 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:54:25.718686 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:54:25.718686 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:54:25.719838 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:54:25.719838 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:54:25.719838 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:54:25.719838 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:54:25.719838 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:54:25.719838 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:54:25.719838 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:54:25.719838 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:54:25.719838 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:54:25.719838 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:54:25.719838 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:54:25.719838 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:54:25.719838 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:54:25.719838 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:54:25.719838 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:54:25.719838 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:54:25.720829 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:54:25.720829 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:54:25.720829 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:54:25.720829 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:54:25.720829 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:54:25.720829 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:54:25.720829 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:54:25.720829 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:54:25.720829 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:54:25.720829 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:54:25.720829 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:54:25.720829 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:54:25.720829 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 546/1093] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Jun 8 11:54:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 11:54:25.726577 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656854ba-af8c-41b5-a6e7-fa1f4dfbce52 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:25.811337 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb4b5b-0e3f-4168-869a-37546bcf7112 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:25.824350 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656854ba-af8c-41b5-a6e7-fa1f4dfbce52 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:25.828257 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:25.837821 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:25.846526 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98730fa1-9a60-458c-bb3f-ba73740e87e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:25.847574 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98730fa1-9a60-458c-bb3f-ba73740e87e7 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:25.847858 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98730fa1-9a60-458c-bb3f-ba73740e87e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:25.848133 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98730fa1-9a60-458c-bb3f-ba73740e87e7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:25.855736 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98730fa1-9a60-458c-bb3f-ba73740e87e7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:25.857257 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98730fa1-9a60-458c-bb3f-ba73740e87e7 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:25.858898 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee90f9-9397-49d2-8836-8a47e7a7c844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:25.859567 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee90f9-9397-49d2-8836-8a47e7a7c844 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:25.859852 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee90f9-9397-49d2-8836-8a47e7a7c844 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:25.860124 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee90f9-9397-49d2-8836-8a47e7a7c844 None admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:25.860897 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ee90f9-9397-49d2-8836-8a47e7a7c844 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:25.861200 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ee90f9-9397-49d2-8836-8a47e7a7c844 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:25.862548 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ee90f9-9397-49d2-8836-8a47e7a7c844 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:25.871431 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 547/1094] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:54:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:54:25.871731 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-98730fa1-9a60-458c-bb3f-ba73740e87e7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 08 11:54:25.871731 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:25.871731 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:54:25.871731 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:54:25.871731 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:54:25.871731 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:54:25.871731 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:54:25.871731 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:54:25.871731 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:54:25.871731 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:54:25.871731 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:54:25.871731 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:54:25.871731 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 11:54:25.871731 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 11:54:25.871731 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 11:54:25.871731 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 11:54:25.872868 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:54:25.872868 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:54:25.872868 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 11:54:25.872868 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:54:25.872868 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 11:54:25.872868 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:54:25.872868 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:54:25.872868 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:54:25.872868 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:54:25.872868 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:54:25.872868 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:54:25.872868 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:54:25.872868 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:54:25.872868 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:54:25.872868 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:54:25.872868 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:54:25.872868 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:54:25.872868 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:54:25.873863 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:54:25.873863 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:54:25.873863 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 11:54:25.873863 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 11:54:25.873863 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 11:54:25.873863 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 11:54:25.873863 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 11:54:25.873863 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 11:54:25.873863 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 08 11:54:25.873863 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:54:25.873863 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 548/1095] 10.222.0.39 () {56 vars in 1093 bytes} [Wed Jun 8 11:54:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 11:54:25.877080 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee90f9-9397-49d2-8836-8a47e7a7c844 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:25.878688 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98730fa1-9a60-458c-bb3f-ba73740e87e7 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:25.982204 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee90f9-9397-49d2-8836-8a47e7a7c844 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:25.985692 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98730fa1-9a60-458c-bb3f-ba73740e87e7 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:26.015473 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a4b25-c7bc-44e1-a3aa-e85f94f082fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:26.016369 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a4b25-c7bc-44e1-a3aa-e85f94f082fe None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:26.016651 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a4b25-c7bc-44e1-a3aa-e85f94f082fe None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:26.016920 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a4b25-c7bc-44e1-a3aa-e85f94f082fe None admin] PATH_INFO: `/v3/users/271f11bf7f434868b8e5f88a3e93bf70` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:26.018079 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a4b25-c7bc-44e1-a3aa-e85f94f082fe None admin] RBAC: Authorizing `identity:get_user(user_id=271f11bf7f434868b8e5f88a3e93bf70)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:26.019509 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a4b25-c7bc-44e1-a3aa-e85f94f082fe None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:26.020382 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d842e1-6097-4d04-8618-80ab17f1d345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:26.021057 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d842e1-6097-4d04-8618-80ab17f1d345 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:26.021170 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 548/1096] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Jun 8 11:54:25 2022] GET /identity/v3/users/271f11bf7f434868b8e5f88a3e93bf70 => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:54:26.021939 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d842e1-6097-4d04-8618-80ab17f1d345 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:26.021939 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d842e1-6097-4d04-8618-80ab17f1d345 None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:26.023219 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d842e1-6097-4d04-8618-80ab17f1d345 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:26.023539 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d842e1-6097-4d04-8618-80ab17f1d345 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:26.025021 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d842e1-6097-4d04-8618-80ab17f1d345 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:26.027502 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a4b25-c7bc-44e1-a3aa-e85f94f082fe None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:26.043159 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 549/1097] 10.222.0.39 () {56 vars in 1133 bytes} [Wed Jun 8 11:54:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:54:26.048779 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d842e1-6097-4d04-8618-80ab17f1d345 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:26.071115 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:26.083411 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:26.127744 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a4b25-c7bc-44e1-a3aa-e85f94f082fe None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:26.149136 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d842e1-6097-4d04-8618-80ab17f1d345 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:26.162196 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d1def4-a786-4df0-8570-df4e2d96a772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:26.162950 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1def4-a786-4df0-8570-df4e2d96a772 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:26.163249 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1def4-a786-4df0-8570-df4e2d96a772 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:26.163517 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1def4-a786-4df0-8570-df4e2d96a772 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:26.181935 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb84a7-8b70-438f-99e5-cd7ca5700440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:26.182590 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb84a7-8b70-438f-99e5-cd7ca5700440 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:26.182878 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb84a7-8b70-438f-99e5-cd7ca5700440 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:26.183158 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb84a7-8b70-438f-99e5-cd7ca5700440 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:26.232625 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d1def4-a786-4df0-8570-df4e2d96a772 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:26.234581 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d1def4-a786-4df0-8570-df4e2d96a772 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:26.256272 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cb84a7-8b70-438f-99e5-cd7ca5700440 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:26.257723 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cb84a7-8b70-438f-99e5-cd7ca5700440 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:26.276518 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:26.293088 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:26.333049 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 549/1098] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:54:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 11:54:26.339413 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d1def4-a786-4df0-8570-df4e2d96a772 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:26.363217 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 550/1099] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:54:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 08 11:54:26.364395 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb84a7-8b70-438f-99e5-cd7ca5700440 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:26.438125 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d1def4-a786-4df0-8570-df4e2d96a772 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:26.460488 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb84a7-8b70-438f-99e5-cd7ca5700440 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:26.472283 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecbf5b6-65e5-4839-be6c-3c5d85d050a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:26.473151 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecbf5b6-65e5-4839-be6c-3c5d85d050a4 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:26.473436 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecbf5b6-65e5-4839-be6c-3c5d85d050a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:26.473712 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecbf5b6-65e5-4839-be6c-3c5d85d050a4 None admin] PATH_INFO: `/v3/projects/7f742ce9dcdf473f86b770a0cd7ade90` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:26.475412 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecbf5b6-65e5-4839-be6c-3c5d85d050a4 None admin] RBAC: Authorizing `identity:get_project(project_id=7f742ce9dcdf473f86b770a0cd7ade90)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:26.476905 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecbf5b6-65e5-4839-be6c-3c5d85d050a4 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:26.478609 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 550/1100] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Jun 8 11:54:26 2022] GET /identity/v3/projects/7f742ce9dcdf473f86b770a0cd7ade90 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:26.484523 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecbf5b6-65e5-4839-be6c-3c5d85d050a4 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:26.495370 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b6800-3d3e-4c18-b6fb-8186f546331c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:26.496161 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b6800-3d3e-4c18-b6fb-8186f546331c None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:26.496471 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b6800-3d3e-4c18-b6fb-8186f546331c None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:26.496747 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b6800-3d3e-4c18-b6fb-8186f546331c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:26.496879 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:26.499572 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:26.507620 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8b6800-3d3e-4c18-b6fb-8186f546331c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:26.509113 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8b6800-3d3e-4c18-b6fb-8186f546331c None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:26.531261 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-cc8b6800-3d3e-4c18-b6fb-8186f546331c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:54:26.531261 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:26.531261 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:54:26.531261 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:54:26.531261 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:54:26.531261 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:54:26.531261 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:54:26.531261 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:54:26.531261 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:54:26.531261 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:54:26.531261 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:54:26.531261 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:54:26.531261 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:54:26.531261 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:54:26.531261 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:54:26.532393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:54:26.532393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:54:26.532393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:54:26.532393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:54:26.532393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:54:26.532393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:54:26.532393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:54:26.532393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:54:26.532393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:54:26.532393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:54:26.532393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:54:26.532393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:54:26.532393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:54:26.532393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:54:26.532393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:54:26.532393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:54:26.532393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:54:26.533313 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:54:26.533313 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:54:26.533313 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:54:26.533313 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:54:26.533313 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 551/1101] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:54:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:54:26.539279 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b6800-3d3e-4c18-b6fb-8186f546331c None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:26.590605 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecbf5b6-65e5-4839-be6c-3c5d85d050a4 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:26.624626 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1c98ba-7a7d-4a46-9da6-9e7d0c5d6146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:26.625291 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c98ba-7a7d-4a46-9da6-9e7d0c5d6146 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:26.625577 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c98ba-7a7d-4a46-9da6-9e7d0c5d6146 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:26.625851 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c98ba-7a7d-4a46-9da6-9e7d0c5d6146 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:26.626684 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1c98ba-7a7d-4a46-9da6-9e7d0c5d6146 None admin] RBAC: Adding query filter params (role.id=028d4429a4554bbb88b3aec9f6a9d937, scope.project.id=7f742ce9dcdf473f86b770a0cd7ade90, user.id=271f11bf7f434868b8e5f88a3e93bf70) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:26.626996 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1c98ba-7a7d-4a46-9da6-9e7d0c5d6146 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:26.628450 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1c98ba-7a7d-4a46-9da6-9e7d0c5d6146 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:26.634305 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 551/1102] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Jun 8 11:54:26 2022] GET /identity/v3/role_assignments?user.id=271f11bf7f434868b8e5f88a3e93bf70&scope.project.id=7f742ce9dcdf473f86b770a0cd7ade90&role.id=028d4429a4554bbb88b3aec9f6a9d937 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:54:26.646830 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b6800-3d3e-4c18-b6fb-8186f546331c None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:26.685437 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09da18e-f4b4-4de0-bb22-b4df0c0180c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:26.686109 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09da18e-f4b4-4de0-bb22-b4df0c0180c6 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:26.686390 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09da18e-f4b4-4de0-bb22-b4df0c0180c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:26.686662 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09da18e-f4b4-4de0-bb22-b4df0c0180c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:26.687392 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09da18e-f4b4-4de0-bb22-b4df0c0180c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:26.687695 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09da18e-f4b4-4de0-bb22-b4df0c0180c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:26.689104 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09da18e-f4b4-4de0-bb22-b4df0c0180c6 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:26.702408 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 552/1103] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:54:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:54:26.708048 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1c98ba-7a7d-4a46-9da6-9e7d0c5d6146 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:26.790659 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:26.823226 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1c98ba-7a7d-4a46-9da6-9e7d0c5d6146 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:26.867078 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce56683c-bf86-4d6e-9b09-e2dc13a09d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:26.867873 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56683c-bf86-4d6e-9b09-e2dc13a09d8d None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:26.868152 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56683c-bf86-4d6e-9b09-e2dc13a09d8d None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:26.868472 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56683c-bf86-4d6e-9b09-e2dc13a09d8d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:26.875095 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce56683c-bf86-4d6e-9b09-e2dc13a09d8d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:26.876572 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce56683c-bf86-4d6e-9b09-e2dc13a09d8d None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:26.891448 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-ce56683c-bf86-4d6e-9b09-e2dc13a09d8d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:54:26.891448 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:26.891448 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:54:26.891448 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:54:26.891448 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:54:26.891448 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:54:26.891448 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:54:26.891448 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:54:26.891448 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:54:26.891448 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:54:26.891448 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:54:26.891448 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:54:26.891448 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 11:54:26.891448 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 11:54:26.891448 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 11:54:26.892623 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 11:54:26.892623 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:54:26.892623 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:54:26.892623 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:54:26.892623 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:54:26.892623 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:54:26.892623 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:54:26.892623 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:54:26.892623 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:54:26.892623 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:54:26.892623 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:54:26.892623 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:54:26.892623 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:54:26.892623 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:54:26.892623 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:54:26.892623 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:54:26.892623 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:54:26.893551 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 11:54:26.893551 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 11:54:26.893551 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 11:54:26.893551 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 11:54:26.893551 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 11:54:26.893551 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 11:54:26.893551 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:54:26.893551 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:54:26.893551 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 552/1104] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Jun 8 11:54:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:54:26.899428 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09da18e-f4b4-4de0-bb22-b4df0c0180c6 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:26.947819 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:26.999431 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09da18e-f4b4-4de0-bb22-b4df0c0180c6 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:27.033352 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff8b866-a3cc-4c8f-8515-3904d646318f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:27.034012 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8b866-a3cc-4c8f-8515-3904d646318f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:27.034295 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8b866-a3cc-4c8f-8515-3904d646318f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:27.034567 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8b866-a3cc-4c8f-8515-3904d646318f None admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:27.035349 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff8b866-a3cc-4c8f-8515-3904d646318f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:27.035658 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff8b866-a3cc-4c8f-8515-3904d646318f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:27.037214 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff8b866-a3cc-4c8f-8515-3904d646318f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:27.049271 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 553/1105] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Jun 8 11:54:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:27.055167 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce56683c-bf86-4d6e-9b09-e2dc13a09d8d None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:27.159625 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce56683c-bf86-4d6e-9b09-e2dc13a09d8d None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:27.194176 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60978ce-6291-41ad-9db2-1fcd28de4af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:27.194836 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60978ce-6291-41ad-9db2-1fcd28de4af0 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:27.195123 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60978ce-6291-41ad-9db2-1fcd28de4af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:27.195402 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60978ce-6291-41ad-9db2-1fcd28de4af0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:27.196262 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60978ce-6291-41ad-9db2-1fcd28de4af0 None admin] RBAC: Adding query filter params (role.id=c19874f86dad4aa1bfa44ebf9eaf6de4, scope.project.id=6a7fee684e8b43e199c95aeeb92640d4, user.id=7ef7edb5e9ce49e6b098f48bf060b228) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:27.196637 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60978ce-6291-41ad-9db2-1fcd28de4af0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:27.198014 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60978ce-6291-41ad-9db2-1fcd28de4af0 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:27.199865 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:27.204896 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 553/1106] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Jun 8 11:54:27 2022] GET /identity/v3/role_assignments?user.id=7ef7edb5e9ce49e6b098f48bf060b228&scope.project.id=6a7fee684e8b43e199c95aeeb92640d4&role.id=c19874f86dad4aa1bfa44ebf9eaf6de4 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:28.909978 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac48311-1aa9-46b0-95f2-eff0072f98b2 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:28.910485 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac48311-1aa9-46b0-95f2-eff0072f98b2 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:28.910485 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac48311-1aa9-46b0-95f2-eff0072f98b2 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:28.911818 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 554/1107] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:54:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:54:28.917725 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a3f84-f762-4357-b39b-c6cc83fa1e3a None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:28.918138 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a3f84-f762-4357-b39b-c6cc83fa1e3a None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:28.918281 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a3f84-f762-4357-b39b-c6cc83fa1e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:28.934579 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-bf3a3f84-f762-4357-b39b-c6cc83fa1e3a None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:54:28.935769 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-bf3a3f84-f762-4357-b39b-c6cc83fa1e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:54:29.000662 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 554/1108] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:54:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 11:54:29.026174 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac48311-1aa9-46b0-95f2-eff0072f98b2 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:29.124397 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac48311-1aa9-46b0-95f2-eff0072f98b2 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:29.133931 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:29.158510 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e27e320-cb37-40a6-a2a1-bac00256a426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:29.159286 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27e320-cb37-40a6-a2a1-bac00256a426 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:29.159564 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27e320-cb37-40a6-a2a1-bac00256a426 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:29.159835 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27e320-cb37-40a6-a2a1-bac00256a426 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:29.161048 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e27e320-cb37-40a6-a2a1-bac00256a426 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:29.162582 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e27e320-cb37-40a6-a2a1-bac00256a426 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:29.164227 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 555/1109] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:54:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:29.169893 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a3f84-f762-4357-b39b-c6cc83fa1e3a None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:29.265509 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a3f84-f762-4357-b39b-c6cc83fa1e3a None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:29.291157 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:29.298853 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e439df-959f-4b6d-aa8e-edb9ea69b735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:29.299514 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e439df-959f-4b6d-aa8e-edb9ea69b735 None admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:29.299797 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e439df-959f-4b6d-aa8e-edb9ea69b735 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:29.300070 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e439df-959f-4b6d-aa8e-edb9ea69b735 None admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:29.300804 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e439df-959f-4b6d-aa8e-edb9ea69b735 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:29.302229 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e439df-959f-4b6d-aa8e-edb9ea69b735 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:29.322027 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 555/1110] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Jun 8 11:54:29 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 11:54:31.620333 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589d9b0-e13c-419c-8b98-07cbb1f294e0 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:31.620846 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589d9b0-e13c-419c-8b98-07cbb1f294e0 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:31.620940 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589d9b0-e13c-419c-8b98-07cbb1f294e0 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:31.622260 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 556/1111] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:54:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:54:31.627501 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cea7f9-30f3-4e7f-ac48-dc6b25d02228 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:31.627910 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cea7f9-30f3-4e7f-ac48-dc6b25d02228 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:31.628068 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cea7f9-30f3-4e7f-ac48-dc6b25d02228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:31.644546 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-a0cea7f9-30f3-4e7f-ac48-dc6b25d02228 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:54:31.645725 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-a0cea7f9-30f3-4e7f-ac48-dc6b25d02228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:54:31.709950 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 556/1112] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:54:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 11:54:31.734154 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d589d9b0-e13c-419c-8b98-07cbb1f294e0 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:31.832279 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d589d9b0-e13c-419c-8b98-07cbb1f294e0 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:31.867011 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766fdb56-039a-440b-b9cc-1cf248326ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:31.867801 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766fdb56-039a-440b-b9cc-1cf248326ecc None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:31.868090 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766fdb56-039a-440b-b9cc-1cf248326ecc None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:31.868397 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766fdb56-039a-440b-b9cc-1cf248326ecc None admin] PATH_INFO: `/v3/roles/b3d7a91b614d49a3bc751e1d330a67cf` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:31.869861 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766fdb56-039a-440b-b9cc-1cf248326ecc None admin] RBAC: Authorizing `identity:get_role(role_id=b3d7a91b614d49a3bc751e1d330a67cf)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:31.871223 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766fdb56-039a-440b-b9cc-1cf248326ecc None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:31.872608 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 557/1113] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Jun 8 11:54:31 2022] GET /identity/v3/roles/b3d7a91b614d49a3bc751e1d330a67cf => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:31.878359 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cea7f9-30f3-4e7f-ac48-dc6b25d02228 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:31.973180 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cea7f9-30f3-4e7f-ac48-dc6b25d02228 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:31.987209 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:32.008017 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83361848-c182-4ba1-9290-827469ddd23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:32.008930 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83361848-c182-4ba1-9290-827469ddd23a None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:32.009213 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83361848-c182-4ba1-9290-827469ddd23a None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:32.009487 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83361848-c182-4ba1-9290-827469ddd23a None admin] PATH_INFO: `/v3/users/897d97a5b7cc4ea1aa21fcf23bdd140a` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:32.023679 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83361848-c182-4ba1-9290-827469ddd23a None admin] RBAC: Authorizing `identity:get_user(user_id=897d97a5b7cc4ea1aa21fcf23bdd140a)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:32.025164 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83361848-c182-4ba1-9290-827469ddd23a None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:32.026815 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 557/1114] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Jun 8 11:54:31 2022] GET /identity/v3/users/897d97a5b7cc4ea1aa21fcf23bdd140a => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:32.032561 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766fdb56-039a-440b-b9cc-1cf248326ecc None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:32.077123 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:32.130155 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766fdb56-039a-440b-b9cc-1cf248326ecc None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:32.164425 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf78ec-c7e9-42ef-90b1-53691164e21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:32.165069 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf78ec-c7e9-42ef-90b1-53691164e21c None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:32.165352 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf78ec-c7e9-42ef-90b1-53691164e21c None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:32.165626 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf78ec-c7e9-42ef-90b1-53691164e21c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:32.230382 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf78ec-c7e9-42ef-90b1-53691164e21c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:32.231836 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf78ec-c7e9-42ef-90b1-53691164e21c None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:32.273990 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:32.328021 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 558/1115] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:54:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 11:54:32.336755 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83361848-c182-4ba1-9290-827469ddd23a None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:32.432641 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83361848-c182-4ba1-9290-827469ddd23a None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:32.464929 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0d85b-5d3e-468a-9abd-fc9ae43d3ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:32.465774 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0d85b-5d3e-468a-9abd-fc9ae43d3ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:32.466053 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0d85b-5d3e-468a-9abd-fc9ae43d3ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:32.466322 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0d85b-5d3e-468a-9abd-fc9ae43d3ab7 None admin] PATH_INFO: `/v3/projects/7f742ce9dcdf473f86b770a0cd7ade90` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:32.467476 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c0d85b-5d3e-468a-9abd-fc9ae43d3ab7 None admin] RBAC: Authorizing `identity:get_project(project_id=7f742ce9dcdf473f86b770a0cd7ade90)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:32.468926 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c0d85b-5d3e-468a-9abd-fc9ae43d3ab7 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:32.470588 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 558/1116] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Jun 8 11:54:32 2022] GET /identity/v3/projects/7f742ce9dcdf473f86b770a0cd7ade90 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:32.477873 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf78ec-c7e9-42ef-90b1-53691164e21c None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:32.576625 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf78ec-c7e9-42ef-90b1-53691164e21c None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:32.611049 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1b7fb-f02c-4348-8532-6368ca015b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:32.611705 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1b7fb-f02c-4348-8532-6368ca015b5a None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:32.611991 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1b7fb-f02c-4348-8532-6368ca015b5a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:32.612297 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1b7fb-f02c-4348-8532-6368ca015b5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:32.613126 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f1b7fb-f02c-4348-8532-6368ca015b5a None admin] RBAC: Adding query filter params (role.id=b3d7a91b614d49a3bc751e1d330a67cf, scope.project.id=7f742ce9dcdf473f86b770a0cd7ade90, user.id=897d97a5b7cc4ea1aa21fcf23bdd140a) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:32.613442 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f1b7fb-f02c-4348-8532-6368ca015b5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:32.614937 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f1b7fb-f02c-4348-8532-6368ca015b5a None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:32.620308 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 559/1117] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Jun 8 11:54:32 2022] GET /identity/v3/role_assignments?user.id=897d97a5b7cc4ea1aa21fcf23bdd140a&scope.project.id=7f742ce9dcdf473f86b770a0cd7ade90&role.id=b3d7a91b614d49a3bc751e1d330a67cf => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:34.843281 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d4599-f6d4-4f7c-9205-b794928873b2 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:34.843803 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d4599-f6d4-4f7c-9205-b794928873b2 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:34.843803 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d4599-f6d4-4f7c-9205-b794928873b2 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:34.845162 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 559/1118] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:54:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:54:34.851396 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c940462-7337-49a9-bc03-3250eae63606 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:34.851803 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c940462-7337-49a9-bc03-3250eae63606 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:34.851981 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c940462-7337-49a9-bc03-3250eae63606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:34.868678 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-5c940462-7337-49a9-bc03-3250eae63606 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:54:34.869867 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-5c940462-7337-49a9-bc03-3250eae63606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:54:34.871770 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:34.935860 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 560/1119] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:54:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 11:54:34.957883 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d4599-f6d4-4f7c-9205-b794928873b2 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:35.000885 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:35.061749 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d4599-f6d4-4f7c-9205-b794928873b2 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:35.095208 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62d013-9e99-4998-b17b-cc7c73331840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:35.095990 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62d013-9e99-4998-b17b-cc7c73331840 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:35.096304 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62d013-9e99-4998-b17b-cc7c73331840 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:35.096835 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62d013-9e99-4998-b17b-cc7c73331840 None admin] PATH_INFO: `/v3/roles/b3d7a91b614d49a3bc751e1d330a67cf` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:35.098303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be62d013-9e99-4998-b17b-cc7c73331840 None admin] RBAC: Authorizing `identity:get_role(role_id=b3d7a91b614d49a3bc751e1d330a67cf)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:35.099814 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be62d013-9e99-4998-b17b-cc7c73331840 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:35.101217 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 560/1120] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Jun 8 11:54:34 2022] GET /identity/v3/roles/b3d7a91b614d49a3bc751e1d330a67cf => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:35.106999 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c940462-7337-49a9-bc03-3250eae63606 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:35.202081 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c940462-7337-49a9-bc03-3250eae63606 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:35.235246 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ee3f1-fafe-4da8-8b1f-ba281c7bc846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:35.236106 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ee3f1-fafe-4da8-8b1f-ba281c7bc846 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:35.236584 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ee3f1-fafe-4da8-8b1f-ba281c7bc846 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:35.236867 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ee3f1-fafe-4da8-8b1f-ba281c7bc846 None admin] PATH_INFO: `/v3/users/897d97a5b7cc4ea1aa21fcf23bdd140a` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:35.238041 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00ee3f1-fafe-4da8-8b1f-ba281c7bc846 None admin] RBAC: Authorizing `identity:get_user(user_id=897d97a5b7cc4ea1aa21fcf23bdd140a)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:35.239496 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00ee3f1-fafe-4da8-8b1f-ba281c7bc846 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:35.241130 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 561/1121] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Jun 8 11:54:35 2022] GET /identity/v3/users/897d97a5b7cc4ea1aa21fcf23bdd140a => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:35.246679 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62d013-9e99-4998-b17b-cc7c73331840 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:35.342374 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62d013-9e99-4998-b17b-cc7c73331840 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:35.351726 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:35.375701 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d669eb-c23f-454a-958c-599c17709b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:35.376588 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d669eb-c23f-454a-958c-599c17709b2c None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:35.376871 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d669eb-c23f-454a-958c-599c17709b2c None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:35.377142 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d669eb-c23f-454a-958c-599c17709b2c None admin] PATH_INFO: `/v3/projects/7f742ce9dcdf473f86b770a0cd7ade90` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:35.378292 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d669eb-c23f-454a-958c-599c17709b2c None admin] RBAC: Authorizing `identity:get_project(project_id=7f742ce9dcdf473f86b770a0cd7ade90)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:35.379746 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d669eb-c23f-454a-958c-599c17709b2c None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:35.381948 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 561/1122] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Jun 8 11:54:35 2022] GET /identity/v3/projects/7f742ce9dcdf473f86b770a0cd7ade90 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:35.387708 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ee3f1-fafe-4da8-8b1f-ba281c7bc846 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:35.397039 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:35.485717 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ee3f1-fafe-4da8-8b1f-ba281c7bc846 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:35.519179 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725faba5-e696-4e33-85e9-7f6f7412c2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:35.520060 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725faba5-e696-4e33-85e9-7f6f7412c2e9 None admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:35.520371 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725faba5-e696-4e33-85e9-7f6f7412c2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:35.520670 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725faba5-e696-4e33-85e9-7f6f7412c2e9 None admin] PATH_INFO: `/v3/projects/7f742ce9dcdf473f86b770a0cd7ade90/users/897d97a5b7cc4ea1aa21fcf23bdd140a/roles/b3d7a91b614d49a3bc751e1d330a67cf` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:35.522872 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725faba5-e696-4e33-85e9-7f6f7412c2e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=7f742ce9dcdf473f86b770a0cd7ade90, user_id=897d97a5b7cc4ea1aa21fcf23bdd140a, role_id=b3d7a91b614d49a3bc751e1d330a67cf)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:35.524307 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725faba5-e696-4e33-85e9-7f6f7412c2e9 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:35.536854 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 562/1123] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Jun 8 11:54:35 2022] PUT /identity/v3/projects/7f742ce9dcdf473f86b770a0cd7ade90/users/897d97a5b7cc4ea1aa21fcf23bdd140a/roles/b3d7a91b614d49a3bc751e1d330a67cf => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 11:54:37.747405 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c2f47-c98d-425f-9269-3057c28d48b8 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:37.747928 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c2f47-c98d-425f-9269-3057c28d48b8 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:37.748021 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c2f47-c98d-425f-9269-3057c28d48b8 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:37.749366 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 562/1124] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:54:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:54:37.754504 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd851f-52ea-4028-905c-9e85deeb670b None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:37.754907 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd851f-52ea-4028-905c-9e85deeb670b None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:37.755640 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd851f-52ea-4028-905c-9e85deeb670b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:37.772577 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-d8dd851f-52ea-4028-905c-9e85deeb670b None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:54:37.773757 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-d8dd851f-52ea-4028-905c-9e85deeb670b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:54:37.831530 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:37.839666 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 563/1125] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:54:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 11:54:37.863190 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c2f47-c98d-425f-9269-3057c28d48b8 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:37.961326 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c2f47-c98d-425f-9269-3057c28d48b8 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:37.994114 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6376aba5-405a-4d4f-a82e-620ae02e7a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:37.994954 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376aba5-405a-4d4f-a82e-620ae02e7a7c None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:37.995235 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376aba5-405a-4d4f-a82e-620ae02e7a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:37.995507 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376aba5-405a-4d4f-a82e-620ae02e7a7c None admin] PATH_INFO: `/v3/roles/b3d7a91b614d49a3bc751e1d330a67cf` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:37.996974 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6376aba5-405a-4d4f-a82e-620ae02e7a7c None admin] RBAC: Authorizing `identity:get_role(role_id=b3d7a91b614d49a3bc751e1d330a67cf)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:37.998331 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6376aba5-405a-4d4f-a82e-620ae02e7a7c None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:37.999667 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 563/1126] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Jun 8 11:54:37 2022] GET /identity/v3/roles/b3d7a91b614d49a3bc751e1d330a67cf => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:38.005905 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd851f-52ea-4028-905c-9e85deeb670b None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:38.101405 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd851f-52ea-4028-905c-9e85deeb670b None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:38.134061 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaffaa3-c4b3-416e-a572-4c793eca2060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:38.134867 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaffaa3-c4b3-416e-a572-4c793eca2060 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:38.135147 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaffaa3-c4b3-416e-a572-4c793eca2060 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:38.135423 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaffaa3-c4b3-416e-a572-4c793eca2060 None admin] PATH_INFO: `/v3/users/897d97a5b7cc4ea1aa21fcf23bdd140a` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:38.136613 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaffaa3-c4b3-416e-a572-4c793eca2060 None admin] RBAC: Authorizing `identity:get_user(user_id=897d97a5b7cc4ea1aa21fcf23bdd140a)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:38.138045 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaffaa3-c4b3-416e-a572-4c793eca2060 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:38.139657 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 564/1127] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Jun 8 11:54:38 2022] GET /identity/v3/users/897d97a5b7cc4ea1aa21fcf23bdd140a => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:38.145398 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6376aba5-405a-4d4f-a82e-620ae02e7a7c None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:38.190790 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:38.242792 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6376aba5-405a-4d4f-a82e-620ae02e7a7c None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:38.274811 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d3915-5c9c-4550-9b79-50620369960e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:38.275454 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d3915-5c9c-4550-9b79-50620369960e None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:38.275738 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d3915-5c9c-4550-9b79-50620369960e None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:38.276016 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d3915-5c9c-4550-9b79-50620369960e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:38.342185 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369d3915-5c9c-4550-9b79-50620369960e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:38.343682 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369d3915-5c9c-4550-9b79-50620369960e None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:38.386834 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:38.439150 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 564/1128] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:54:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 11:54:38.445285 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaffaa3-c4b3-416e-a572-4c793eca2060 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:38.505751 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:38.543171 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaffaa3-c4b3-416e-a572-4c793eca2060 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:38.576287 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8129ee06-8753-4757-8f17-1b2829f8d15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:38.577154 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129ee06-8753-4757-8f17-1b2829f8d15f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:38.577474 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129ee06-8753-4757-8f17-1b2829f8d15f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:38.577746 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129ee06-8753-4757-8f17-1b2829f8d15f None admin] PATH_INFO: `/v3/projects/7f742ce9dcdf473f86b770a0cd7ade90` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:38.578858 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8129ee06-8753-4757-8f17-1b2829f8d15f None admin] RBAC: Authorizing `identity:get_project(project_id=7f742ce9dcdf473f86b770a0cd7ade90)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:38.580342 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8129ee06-8753-4757-8f17-1b2829f8d15f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:38.582029 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 565/1129] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Jun 8 11:54:38 2022] GET /identity/v3/projects/7f742ce9dcdf473f86b770a0cd7ade90 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:38.589367 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d3915-5c9c-4550-9b79-50620369960e None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:38.685589 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d3915-5c9c-4550-9b79-50620369960e None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:38.718585 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9b323-f27e-4450-9de7-975818fb60a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:38.719240 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9b323-f27e-4450-9de7-975818fb60a0 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:38.719528 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9b323-f27e-4450-9de7-975818fb60a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:38.719807 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9b323-f27e-4450-9de7-975818fb60a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:38.720673 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c9b323-f27e-4450-9de7-975818fb60a0 None admin] RBAC: Adding query filter params (role.id=b3d7a91b614d49a3bc751e1d330a67cf, scope.project.id=7f742ce9dcdf473f86b770a0cd7ade90, user.id=897d97a5b7cc4ea1aa21fcf23bdd140a) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:38.720986 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c9b323-f27e-4450-9de7-975818fb60a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:38.722663 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c9b323-f27e-4450-9de7-975818fb60a0 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:38.729078 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 565/1130] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Jun 8 11:54:38 2022] GET /identity/v3/role_assignments?user.id=897d97a5b7cc4ea1aa21fcf23bdd140a&scope.project.id=7f742ce9dcdf473f86b770a0cd7ade90&role.id=b3d7a91b614d49a3bc751e1d330a67cf => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:40.985585 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721e94d-c523-485d-8ee0-0c56812275c3 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:40.986096 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721e94d-c523-485d-8ee0-0c56812275c3 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:40.986096 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721e94d-c523-485d-8ee0-0c56812275c3 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:40.987404 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 566/1131] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:54:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:54:40.993404 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fcc8c9-c20a-4f99-bd79-f7badf681825 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:40.993779 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fcc8c9-c20a-4f99-bd79-f7badf681825 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:40.993956 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fcc8c9-c20a-4f99-bd79-f7badf681825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:41.012026 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-81fcc8c9-c20a-4f99-bd79-f7badf681825 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:54:41.013231 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-81fcc8c9-c20a-4f99-bd79-f7badf681825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:54:41.015162 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:41.080517 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 566/1132] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:54:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 11:54:41.105211 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721e94d-c523-485d-8ee0-0c56812275c3 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:41.232263 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721e94d-c523-485d-8ee0-0c56812275c3 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:41.265014 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:41.270402 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4acf624-087d-4415-a810-111aaf30b4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:41.271290 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4acf624-087d-4415-a810-111aaf30b4b5 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:41.271570 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4acf624-087d-4415-a810-111aaf30b4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:41.271839 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4acf624-087d-4415-a810-111aaf30b4b5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:41.273190 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4acf624-087d-4415-a810-111aaf30b4b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:41.274904 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4acf624-087d-4415-a810-111aaf30b4b5 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:41.276562 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 567/1133] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:54:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:41.282709 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fcc8c9-c20a-4f99-bd79-f7badf681825 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:41.420544 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fcc8c9-c20a-4f99-bd79-f7badf681825 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:41.458446 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be825f-4e6d-4f40-8eca-7b887e08d634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:41.459138 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be825f-4e6d-4f40-8eca-7b887e08d634 None admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:41.459437 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be825f-4e6d-4f40-8eca-7b887e08d634 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:41.459718 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be825f-4e6d-4f40-8eca-7b887e08d634 None admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:41.460463 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7be825f-4e6d-4f40-8eca-7b887e08d634 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:41.461901 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7be825f-4e6d-4f40-8eca-7b887e08d634 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:41.475404 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:41.493046 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 567/1134] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Jun 8 11:54:41 2022] POST /identity/v3/projects => generated 311 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 11:54:43.817418 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ef99c-4d88-45f4-b684-84c17ab76b94 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:43.818036 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ef99c-4d88-45f4-b684-84c17ab76b94 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:43.818036 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ef99c-4d88-45f4-b684-84c17ab76b94 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:43.819328 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 568/1135] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:54:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:54:43.824731 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29e215-1b2d-436d-b18a-5b7a51b8b00e None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:43.825151 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29e215-1b2d-436d-b18a-5b7a51b8b00e None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:43.825283 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29e215-1b2d-436d-b18a-5b7a51b8b00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:43.842905 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-7c29e215-1b2d-436d-b18a-5b7a51b8b00e None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:54:43.844018 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-7c29e215-1b2d-436d-b18a-5b7a51b8b00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:54:43.909586 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 568/1136] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:54:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 11:54:43.935074 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ef99c-4d88-45f4-b684-84c17ab76b94 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:44.040412 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ef99c-4d88-45f4-b684-84c17ab76b94 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:44.074242 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d774fda-4044-4a00-af08-be44c632a71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:44.075023 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d774fda-4044-4a00-af08-be44c632a71e None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:44.075309 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d774fda-4044-4a00-af08-be44c632a71e None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:44.075584 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d774fda-4044-4a00-af08-be44c632a71e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:44.076765 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d774fda-4044-4a00-af08-be44c632a71e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:44.078195 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d774fda-4044-4a00-af08-be44c632a71e None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:44.079800 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 569/1137] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:54:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:44.086179 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c29e215-1b2d-436d-b18a-5b7a51b8b00e None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:44.181254 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c29e215-1b2d-436d-b18a-5b7a51b8b00e None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:44.200916 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:44.216004 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e27c008-e2a9-4546-bd73-e0a7917be0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:44.216694 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27c008-e2a9-4546-bd73-e0a7917be0d8 None admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:44.216979 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27c008-e2a9-4546-bd73-e0a7917be0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:44.217254 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27c008-e2a9-4546-bd73-e0a7917be0d8 None admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:44.217952 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e27c008-e2a9-4546-bd73-e0a7917be0d8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:44.219394 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e27c008-e2a9-4546-bd73-e0a7917be0d8 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:44.238174 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 569/1138] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Jun 8 11:54:44 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 11:54:46.526945 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726244fb-b0f8-41b2-b1c9-e3b6499e0496 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:46.527484 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726244fb-b0f8-41b2-b1c9-e3b6499e0496 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:46.527484 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726244fb-b0f8-41b2-b1c9-e3b6499e0496 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:46.528897 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 570/1139] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:54:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:54:46.534046 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bce06c-33ca-4709-bc45-6bcd935e18b4 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:46.534421 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bce06c-33ca-4709-bc45-6bcd935e18b4 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:46.534607 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bce06c-33ca-4709-bc45-6bcd935e18b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:46.552970 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-f8bce06c-33ca-4709-bc45-6bcd935e18b4 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:54:46.554178 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-f8bce06c-33ca-4709-bc45-6bcd935e18b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:54:46.619207 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 570/1140] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:54:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 11:54:46.642754 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726244fb-b0f8-41b2-b1c9-e3b6499e0496 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:46.714146 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:46.748072 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726244fb-b0f8-41b2-b1c9-e3b6499e0496 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:46.781187 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd0a358-d1a6-4d1f-bc18-29e07f3a4092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:46.781916 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0a358-d1a6-4d1f-bc18-29e07f3a4092 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:46.782200 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0a358-d1a6-4d1f-bc18-29e07f3a4092 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:46.782474 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0a358-d1a6-4d1f-bc18-29e07f3a4092 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:46.792911 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd0a358-d1a6-4d1f-bc18-29e07f3a4092 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:54:46.800422 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-2dd0a358-d1a6-4d1f-bc18-29e07f3a4092 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:54:46.800422 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:46.800422 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:54:46.800422 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:54:46.800422 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:54:46.800422 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:54:46.800422 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:54:46.800422 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:54:46.800422 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:54:46.800422 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:54:46.800422 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:54:46.800422 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:54:46.800422 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:54:46.800422 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:54:46.800422 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:54:46.800422 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:54:46.801708 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:54:46.801708 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:54:46.801708 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:54:46.801708 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:54:46.801708 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:54:46.801708 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:54:46.801708 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:54:46.801708 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:54:46.801708 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:54:46.801708 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:54:46.801708 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:54:46.801708 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:54:46.801708 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:54:46.801708 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:54:46.801708 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:54:46.801708 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:54:46.802848 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:54:46.802848 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:54:46.802848 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:54:46.802848 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:54:46.802848 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:54:46.802848 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:54:46.802848 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:54:46.802848 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:54:46.802848 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:54:46.802848 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:54:46.802848 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:54:46.802848 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:54:46.802848 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 571/1141] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Jun 8 11:54:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:54:46.807869 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bce06c-33ca-4709-bc45-6bcd935e18b4 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:46.903104 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bce06c-33ca-4709-bc45-6bcd935e18b4 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:46.910206 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:46.937971 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db741fff-9a43-4b96-b3f0-1caf2964bee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:46.938630 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db741fff-9a43-4b96-b3f0-1caf2964bee9 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:46.938911 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db741fff-9a43-4b96-b3f0-1caf2964bee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:46.939182 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db741fff-9a43-4b96-b3f0-1caf2964bee9 None admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:46.939917 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db741fff-9a43-4b96-b3f0-1caf2964bee9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:46.940246 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db741fff-9a43-4b96-b3f0-1caf2964bee9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:46.941609 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db741fff-9a43-4b96-b3f0-1caf2964bee9 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:46.949665 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 571/1142] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:54:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:46.955417 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd0a358-d1a6-4d1f-bc18-29e07f3a4092 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:47.056438 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd0a358-d1a6-4d1f-bc18-29e07f3a4092 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:47.083623 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:47.091729 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ccd9e-9879-447a-9913-340ddd83060b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:47.092630 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ccd9e-9879-447a-9913-340ddd83060b None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:47.092918 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ccd9e-9879-447a-9913-340ddd83060b None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:47.093194 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ccd9e-9879-447a-9913-340ddd83060b None admin] PATH_INFO: `/v3/users/2ba336bb110442a6963d34da89c7340e` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:47.106179 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ccd9e-9879-447a-9913-340ddd83060b None admin] RBAC: Authorizing `identity:get_user(user_id=2ba336bb110442a6963d34da89c7340e)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:47.107620 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ccd9e-9879-447a-9913-340ddd83060b None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:47.109288 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 572/1143] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Jun 8 11:54:46 2022] GET /identity/v3/users/2ba336bb110442a6963d34da89c7340e => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:47.115183 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db741fff-9a43-4b96-b3f0-1caf2964bee9 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:47.211502 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db741fff-9a43-4b96-b3f0-1caf2964bee9 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:47.243717 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd80173-3e0e-40b3-adf3-5ac3b605632a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:47.244386 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd80173-3e0e-40b3-adf3-5ac3b605632a None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:47.244675 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd80173-3e0e-40b3-adf3-5ac3b605632a None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:47.244954 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd80173-3e0e-40b3-adf3-5ac3b605632a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:47.278239 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:47.311184 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd80173-3e0e-40b3-adf3-5ac3b605632a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:47.312600 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd80173-3e0e-40b3-adf3-5ac3b605632a None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:47.407902 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 572/1144] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:54:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 11:54:47.413858 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ccd9e-9879-447a-9913-340ddd83060b None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:47.510747 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ccd9e-9879-447a-9913-340ddd83060b None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:47.542623 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fc98ef-14f6-4b50-aa26-e41c708523b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:47.543474 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc98ef-14f6-4b50-aa26-e41c708523b4 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:47.543757 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc98ef-14f6-4b50-aa26-e41c708523b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:47.544036 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc98ef-14f6-4b50-aa26-e41c708523b4 None admin] PATH_INFO: `/v3/projects/487cc8af4c544bc79f9a22d7d63d1d90` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:47.545215 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fc98ef-14f6-4b50-aa26-e41c708523b4 None admin] RBAC: Authorizing `identity:get_project(project_id=487cc8af4c544bc79f9a22d7d63d1d90)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:47.546643 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fc98ef-14f6-4b50-aa26-e41c708523b4 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:47.548339 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 573/1145] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Jun 8 11:54:47 2022] GET /identity/v3/projects/487cc8af4c544bc79f9a22d7d63d1d90 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:47.555328 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd80173-3e0e-40b3-adf3-5ac3b605632a None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:47.619572 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:47.652061 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd80173-3e0e-40b3-adf3-5ac3b605632a None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:47.687241 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd585d43-927e-4e03-b4d1-57bb14abd839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:47.687899 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd585d43-927e-4e03-b4d1-57bb14abd839 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:47.688218 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd585d43-927e-4e03-b4d1-57bb14abd839 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:47.688494 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd585d43-927e-4e03-b4d1-57bb14abd839 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:47.689333 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd585d43-927e-4e03-b4d1-57bb14abd839 None admin] RBAC: Adding query filter params (role.id=028d4429a4554bbb88b3aec9f6a9d937, scope.project.id=487cc8af4c544bc79f9a22d7d63d1d90, user.id=2ba336bb110442a6963d34da89c7340e) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:47.689641 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd585d43-927e-4e03-b4d1-57bb14abd839 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:47.691070 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd585d43-927e-4e03-b4d1-57bb14abd839 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:47.698791 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 573/1146] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Jun 8 11:54:47 2022] GET /identity/v3/role_assignments?user.id=2ba336bb110442a6963d34da89c7340e&scope.project.id=487cc8af4c544bc79f9a22d7d63d1d90&role.id=028d4429a4554bbb88b3aec9f6a9d937 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:49.932046 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2321676-ad95-44f7-9052-facf3f77ac3a None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:49.932631 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2321676-ad95-44f7-9052-facf3f77ac3a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:49.932631 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2321676-ad95-44f7-9052-facf3f77ac3a None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:49.933905 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 574/1147] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:54:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:54:49.939129 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4404cb-04ee-49f2-bd5b-762130b45f40 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:49.939585 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4404cb-04ee-49f2-bd5b-762130b45f40 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:49.939684 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4404cb-04ee-49f2-bd5b-762130b45f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:49.956979 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-9c4404cb-04ee-49f2-bd5b-762130b45f40 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:54:49.958446 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-9c4404cb-04ee-49f2-bd5b-762130b45f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:54:50.023704 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 574/1148] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:54:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 11:54:50.046465 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2321676-ad95-44f7-9052-facf3f77ac3a None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:50.101863 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:50.145864 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2321676-ad95-44f7-9052-facf3f77ac3a None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:50.179455 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3220eb6-844a-4717-a1ed-f667db1d623f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:50.180259 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3220eb6-844a-4717-a1ed-f667db1d623f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:50.180548 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3220eb6-844a-4717-a1ed-f667db1d623f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:50.180824 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3220eb6-844a-4717-a1ed-f667db1d623f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:50.190651 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3220eb6-844a-4717-a1ed-f667db1d623f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:54:50.198241 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-d3220eb6-844a-4717-a1ed-f667db1d623f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:54:50.198241 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:50.198241 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:54:50.198241 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:54:50.198241 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:54:50.198241 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:54:50.198241 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:54:50.198241 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:54:50.198241 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:54:50.198241 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:54:50.198241 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:54:50.198241 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:54:50.198241 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:54:50.198241 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:54:50.198241 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:54:50.198241 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:54:50.199451 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:54:50.199451 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:54:50.199451 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:54:50.199451 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:54:50.199451 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:54:50.199451 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:54:50.199451 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:54:50.199451 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:54:50.199451 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:54:50.199451 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:54:50.199451 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:54:50.199451 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:54:50.199451 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:54:50.199451 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:54:50.199451 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:54:50.199451 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:54:50.200650 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:54:50.200650 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:54:50.200650 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:54:50.200650 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:54:50.200650 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:54:50.200650 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:54:50.200650 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:54:50.200650 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:54:50.200650 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:54:50.200650 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:54:50.200650 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:54:50.200650 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:54:50.200650 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 575/1149] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Jun 8 11:54:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:54:50.205455 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4404cb-04ee-49f2-bd5b-762130b45f40 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:50.264680 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:50.302527 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4404cb-04ee-49f2-bd5b-762130b45f40 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:50.334339 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ec492-01a9-4ac2-a126-50dfbf99efbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:50.334995 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ec492-01a9-4ac2-a126-50dfbf99efbe None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:50.335274 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ec492-01a9-4ac2-a126-50dfbf99efbe None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:50.335547 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ec492-01a9-4ac2-a126-50dfbf99efbe None admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:50.336316 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ec492-01a9-4ac2-a126-50dfbf99efbe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:50.336621 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ec492-01a9-4ac2-a126-50dfbf99efbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:50.337993 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ec492-01a9-4ac2-a126-50dfbf99efbe None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:50.345678 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 575/1150] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:54:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:50.352354 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3220eb6-844a-4717-a1ed-f667db1d623f None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:50.449343 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3220eb6-844a-4717-a1ed-f667db1d623f None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:50.462674 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:50.483140 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d4bac-85ba-4e05-8523-f553ccbb50fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:50.483999 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d4bac-85ba-4e05-8523-f553ccbb50fb None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:50.484309 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d4bac-85ba-4e05-8523-f553ccbb50fb None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:50.484582 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d4bac-85ba-4e05-8523-f553ccbb50fb None admin] PATH_INFO: `/v3/users/2ba336bb110442a6963d34da89c7340e` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:50.485745 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d4bac-85ba-4e05-8523-f553ccbb50fb None admin] RBAC: Authorizing `identity:get_user(user_id=2ba336bb110442a6963d34da89c7340e)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:50.487171 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d4bac-85ba-4e05-8523-f553ccbb50fb None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:50.489074 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 576/1151] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Jun 8 11:54:50 2022] GET /identity/v3/users/2ba336bb110442a6963d34da89c7340e => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:50.494729 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ec492-01a9-4ac2-a126-50dfbf99efbe None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:50.590814 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ec492-01a9-4ac2-a126-50dfbf99efbe None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:50.614153 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:50.624877 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdf2b2a-e032-45eb-be1a-2b4e74a99b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:50.625747 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf2b2a-e032-45eb-be1a-2b4e74a99b0c None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:50.626028 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf2b2a-e032-45eb-be1a-2b4e74a99b0c None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:50.626302 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf2b2a-e032-45eb-be1a-2b4e74a99b0c None admin] PATH_INFO: `/v3/projects/487cc8af4c544bc79f9a22d7d63d1d90` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:50.627451 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdf2b2a-e032-45eb-be1a-2b4e74a99b0c None admin] RBAC: Authorizing `identity:get_project(project_id=487cc8af4c544bc79f9a22d7d63d1d90)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:50.628907 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdf2b2a-e032-45eb-be1a-2b4e74a99b0c None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:50.630693 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 576/1152] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Jun 8 11:54:50 2022] GET /identity/v3/projects/487cc8af4c544bc79f9a22d7d63d1d90 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:50.636746 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d4bac-85ba-4e05-8523-f553ccbb50fb None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:50.733875 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d4bac-85ba-4e05-8523-f553ccbb50fb None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:50.765708 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f993a-26b9-4779-996c-933e964685ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:50.766586 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f993a-26b9-4779-996c-933e964685ab None admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:50.766873 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f993a-26b9-4779-996c-933e964685ab None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:50.767151 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f993a-26b9-4779-996c-933e964685ab None admin] PATH_INFO: `/v3/projects/487cc8af4c544bc79f9a22d7d63d1d90/users/2ba336bb110442a6963d34da89c7340e/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:50.769137 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908f993a-26b9-4779-996c-933e964685ab None admin] RBAC: Authorizing `identity:create_grant(project_id=487cc8af4c544bc79f9a22d7d63d1d90, user_id=2ba336bb110442a6963d34da89c7340e, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:50.771313 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908f993a-26b9-4779-996c-933e964685ab None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:50.784753 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 577/1153] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Jun 8 11:54:50 2022] PUT /identity/v3/projects/487cc8af4c544bc79f9a22d7d63d1d90/users/2ba336bb110442a6963d34da89c7340e/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 11:54:53.009482 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a3db6-7a55-474a-a06b-c9d83fa70589 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:53.010017 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a3db6-7a55-474a-a06b-c9d83fa70589 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:53.010017 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a3db6-7a55-474a-a06b-c9d83fa70589 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:53.011319 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 577/1154] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:54:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:54:53.016583 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc93bd-0045-4f80-9036-98d1162f9031 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:53.017006 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc93bd-0045-4f80-9036-98d1162f9031 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:53.017138 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc93bd-0045-4f80-9036-98d1162f9031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:53.034039 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-8dbc93bd-0045-4f80-9036-98d1162f9031 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:54:53.035318 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-8dbc93bd-0045-4f80-9036-98d1162f9031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:54:53.070735 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:53.105151 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 578/1155] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:54:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 11:54:53.129538 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a3db6-7a55-474a-a06b-c9d83fa70589 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:53.228943 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a3db6-7a55-474a-a06b-c9d83fa70589 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:53.261663 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80bfb31-fc52-4e76-a53d-5cca840f88c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:53.262384 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80bfb31-fc52-4e76-a53d-5cca840f88c7 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:53.262672 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80bfb31-fc52-4e76-a53d-5cca840f88c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:53.262952 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80bfb31-fc52-4e76-a53d-5cca840f88c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:53.273537 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80bfb31-fc52-4e76-a53d-5cca840f88c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:54:53.281099 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-e80bfb31-fc52-4e76-a53d-5cca840f88c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:54:53.281099 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:53.281099 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:54:53.281099 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:54:53.281099 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:54:53.281099 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:54:53.281099 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:54:53.281099 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:54:53.281099 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:54:53.281099 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:54:53.281099 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:54:53.281099 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:54:53.281099 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:54:53.281099 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:54:53.281099 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:54:53.281099 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:54:53.282169 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:54:53.282169 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:54:53.282169 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:54:53.282169 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:54:53.282169 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:54:53.282169 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:54:53.282169 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:54:53.282169 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:54:53.282169 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:54:53.282169 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:54:53.282169 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:54:53.282169 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:54:53.282169 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:54:53.282169 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:54:53.282169 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:54:53.282169 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:54:53.283198 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:54:53.283198 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:54:53.283198 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:54:53.283198 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:54:53.283198 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:54:53.283198 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:54:53.283198 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:54:53.283198 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:54:53.283198 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:54:53.283198 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:54:53.283198 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:54:53.283198 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:54:53.283198 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 578/1156] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Jun 8 11:54:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:54:53.289061 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc93bd-0045-4f80-9036-98d1162f9031 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:53.387367 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc93bd-0045-4f80-9036-98d1162f9031 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:53.419746 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367b2fba-3c8b-401b-90db-cc153e226973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:53.420437 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b2fba-3c8b-401b-90db-cc153e226973 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:53.420718 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b2fba-3c8b-401b-90db-cc153e226973 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:53.420991 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b2fba-3c8b-401b-90db-cc153e226973 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:53.421732 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367b2fba-3c8b-401b-90db-cc153e226973 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:53.422038 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367b2fba-3c8b-401b-90db-cc153e226973 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:53.423412 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367b2fba-3c8b-401b-90db-cc153e226973 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:53.431872 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 579/1157] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:54:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:53.437541 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80bfb31-fc52-4e76-a53d-5cca840f88c7 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:53.489459 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:53.534972 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80bfb31-fc52-4e76-a53d-5cca840f88c7 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:53.567966 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b2f79-5db8-4e28-88cb-038aa423a54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:53.568859 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b2f79-5db8-4e28-88cb-038aa423a54a None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:53.569150 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b2f79-5db8-4e28-88cb-038aa423a54a None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:53.569429 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b2f79-5db8-4e28-88cb-038aa423a54a None admin] PATH_INFO: `/v3/users/2ba336bb110442a6963d34da89c7340e` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:53.570608 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66b2f79-5db8-4e28-88cb-038aa423a54a None admin] RBAC: Authorizing `identity:get_user(user_id=2ba336bb110442a6963d34da89c7340e)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:53.572030 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66b2f79-5db8-4e28-88cb-038aa423a54a None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:53.573656 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 579/1158] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Jun 8 11:54:53 2022] GET /identity/v3/users/2ba336bb110442a6963d34da89c7340e => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:53.579314 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367b2fba-3c8b-401b-90db-cc153e226973 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:53.614383 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:53.677806 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367b2fba-3c8b-401b-90db-cc153e226973 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:53.710489 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30516686-4c49-41fb-a28e-e39677899e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:53.711127 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30516686-4c49-41fb-a28e-e39677899e99 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:53.711406 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30516686-4c49-41fb-a28e-e39677899e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:53.711678 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30516686-4c49-41fb-a28e-e39677899e99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:53.775820 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30516686-4c49-41fb-a28e-e39677899e99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:53.777449 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30516686-4c49-41fb-a28e-e39677899e99 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:53.809042 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:53.873728 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 580/1159] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:54:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 11:54:53.880503 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b2f79-5db8-4e28-88cb-038aa423a54a None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:53.981388 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b2f79-5db8-4e28-88cb-038aa423a54a None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:54.001142 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:54.015108 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa4d68-40eb-47c8-bc18-7708f5241b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:54.015958 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa4d68-40eb-47c8-bc18-7708f5241b4d None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:54.016265 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa4d68-40eb-47c8-bc18-7708f5241b4d None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:54.016542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa4d68-40eb-47c8-bc18-7708f5241b4d None admin] PATH_INFO: `/v3/projects/487cc8af4c544bc79f9a22d7d63d1d90` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:54.017690 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa4d68-40eb-47c8-bc18-7708f5241b4d None admin] RBAC: Authorizing `identity:get_project(project_id=487cc8af4c544bc79f9a22d7d63d1d90)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:54.019113 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa4d68-40eb-47c8-bc18-7708f5241b4d None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:54.021403 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 580/1160] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Jun 8 11:54:53 2022] GET /identity/v3/projects/487cc8af4c544bc79f9a22d7d63d1d90 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:54.027490 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30516686-4c49-41fb-a28e-e39677899e99 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:54.123733 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30516686-4c49-41fb-a28e-e39677899e99 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:54.155741 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8be96f0-7403-445b-91d2-3eaa477768a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:54.156407 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be96f0-7403-445b-91d2-3eaa477768a1 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:54.156687 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be96f0-7403-445b-91d2-3eaa477768a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:54.156959 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be96f0-7403-445b-91d2-3eaa477768a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:54.157798 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8be96f0-7403-445b-91d2-3eaa477768a1 None admin] RBAC: Adding query filter params (role.id=028d4429a4554bbb88b3aec9f6a9d937, scope.project.id=487cc8af4c544bc79f9a22d7d63d1d90, user.id=2ba336bb110442a6963d34da89c7340e) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:54.158106 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8be96f0-7403-445b-91d2-3eaa477768a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:54.159548 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8be96f0-7403-445b-91d2-3eaa477768a1 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:54.162343 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:54.167075 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 581/1161] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Jun 8 11:54:54 2022] GET /identity/v3/role_assignments?user.id=2ba336bb110442a6963d34da89c7340e&scope.project.id=487cc8af4c544bc79f9a22d7d63d1d90&role.id=028d4429a4554bbb88b3aec9f6a9d937 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:56.437343 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b5d4f-592f-4723-aee8-4a16ed0de987 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:56.437882 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b5d4f-592f-4723-aee8-4a16ed0de987 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:56.437882 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b5d4f-592f-4723-aee8-4a16ed0de987 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:56.439240 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 581/1162] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:54:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:54:56.444993 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7499249-e78b-4f81-b889-c3c75a810154 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:56.445403 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7499249-e78b-4f81-b889-c3c75a810154 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:56.445563 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7499249-e78b-4f81-b889-c3c75a810154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:56.462401 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-e7499249-e78b-4f81-b889-c3c75a810154 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:54:56.463592 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-e7499249-e78b-4f81-b889-c3c75a810154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:54:56.528343 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 582/1163] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:54:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 11:54:56.551649 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b5d4f-592f-4723-aee8-4a16ed0de987 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:56.652224 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b5d4f-592f-4723-aee8-4a16ed0de987 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:56.685241 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0dc72-a22f-46ac-a6db-4b9b7aa16d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:56.685883 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0dc72-a22f-46ac-a6db-4b9b7aa16d43 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:56.686168 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0dc72-a22f-46ac-a6db-4b9b7aa16d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:56.686444 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0dc72-a22f-46ac-a6db-4b9b7aa16d43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:56.739924 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:56.752364 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c0dc72-a22f-46ac-a6db-4b9b7aa16d43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:56.754390 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c0dc72-a22f-46ac-a6db-4b9b7aa16d43 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:56.849159 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 582/1164] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:54:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 11:54:56.855210 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7499249-e78b-4f81-b889-c3c75a810154 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:56.950694 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7499249-e78b-4f81-b889-c3c75a810154 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:56.976387 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:56.984372 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde30b5a-04bc-4cdb-ae78-caa84296678e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:56.985166 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde30b5a-04bc-4cdb-ae78-caa84296678e None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:56.985448 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde30b5a-04bc-4cdb-ae78-caa84296678e None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:56.985721 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde30b5a-04bc-4cdb-ae78-caa84296678e None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:56.993037 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde30b5a-04bc-4cdb-ae78-caa84296678e None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:56.994521 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde30b5a-04bc-4cdb-ae78-caa84296678e None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:57.008456 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-cde30b5a-04bc-4cdb-ae78-caa84296678e None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 08 11:54:57.008456 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:57.008456 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 08 11:54:57.008456 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 08 11:54:57.008456 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 11:54:57.008456 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 11:54:57.008456 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 11:54:57.008456 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 11:54:57.008456 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 08 11:54:57.008456 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:54:57.008456 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 11:54:57.008456 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:54:57.008456 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:54:57.008456 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:54:57.008456 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:54:57.008456 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:54:57.008456 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:54:57.009661 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:54:57.009661 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:54:57.009661 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:54:57.009661 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:54:57.009661 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:54:57.009661 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:54:57.009661 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:54:57.009661 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:54:57.009661 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:54:57.009661 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:54:57.009661 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:54:57.009661 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:54:57.009661 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:54:57.009661 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:54:57.009661 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:54:57.009661 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:54:57.010513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:54:57.010513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:54:57.010513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:54:57.010513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:54:57.010513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:54:57.010513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:54:57.010513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:54:57.010513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:54:57.010513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:54:57.010513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:54:57.010513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 08 11:54:57.010513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:54:57.010513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 08 11:54:57.010513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:54:57.010513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 583/1165] 10.222.0.39 () {56 vars in 1117 bytes} [Wed Jun 8 11:54:56 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:54:57.015633 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0dc72-a22f-46ac-a6db-4b9b7aa16d43 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:57.101382 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:54:57.116252 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0dc72-a22f-46ac-a6db-4b9b7aa16d43 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:57.148811 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfed163-8bc3-49f5-9d6f-814a28d38d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:57.149473 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfed163-8bc3-49f5-9d6f-814a28d38d73 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:57.149759 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfed163-8bc3-49f5-9d6f-814a28d38d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:57.150039 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfed163-8bc3-49f5-9d6f-814a28d38d73 None admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:57.150762 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfed163-8bc3-49f5-9d6f-814a28d38d73 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:54:57.151071 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfed163-8bc3-49f5-9d6f-814a28d38d73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:57.152468 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfed163-8bc3-49f5-9d6f-814a28d38d73 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:57.159422 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 583/1166] 10.222.0.39 () {56 vars in 1115 bytes} [Wed Jun 8 11:54:57 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:54:59.363945 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d4b43-35e9-43d5-9b0b-e35c5a5b4057 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:59.364538 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d4b43-35e9-43d5-9b0b-e35c5a5b4057 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:59.364970 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d4b43-35e9-43d5-9b0b-e35c5a5b4057 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:59.366866 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 584/1167] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:54:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:54:59.372333 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df76e0-0b14-4c86-be04-2dad074b3dad None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:59.372756 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df76e0-0b14-4c86-be04-2dad074b3dad None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:59.372903 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df76e0-0b14-4c86-be04-2dad074b3dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:59.391921 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-51df76e0-0b14-4c86-be04-2dad074b3dad None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:54:59.393174 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-51df76e0-0b14-4c86-be04-2dad074b3dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:54:59.457763 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 584/1168] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:54:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 11:54:59.481798 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d4b43-35e9-43d5-9b0b-e35c5a5b4057 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:54:59.582199 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d4b43-35e9-43d5-9b0b-e35c5a5b4057 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:54:59.615626 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f05c93-1c20-490b-8f00-5000a361b25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:54:59.616256 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f05c93-1c20-490b-8f00-5000a361b25d None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:54:59.616541 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f05c93-1c20-490b-8f00-5000a361b25d None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:54:59.616814 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f05c93-1c20-490b-8f00-5000a361b25d None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:54:59.617555 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f05c93-1c20-490b-8f00-5000a361b25d None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:54:59.618913 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f05c93-1c20-490b-8f00-5000a361b25d None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:54:59.633414 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 585/1169] 10.222.0.39 () {60 vars in 1138 bytes} [Wed Jun 8 11:54:59 2022] POST /identity/v3/domains => generated 267 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 11:55:01.933169 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8df54e-cf5d-47f5-9ec4-3c691b4e97b8 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:55:01.933692 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8df54e-cf5d-47f5-9ec4-3c691b4e97b8 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:55:01.933692 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8df54e-cf5d-47f5-9ec4-3c691b4e97b8 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:55:01.935013 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 585/1170] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:55:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:55:01.940159 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3631f-0356-478f-94ae-fd914fba6112 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:55:01.940574 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3631f-0356-478f-94ae-fd914fba6112 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:55:01.940761 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3631f-0356-478f-94ae-fd914fba6112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:55:01.958280 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-32f3631f-0356-478f-94ae-fd914fba6112 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:55:01.959474 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-32f3631f-0356-478f-94ae-fd914fba6112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:55:02.004435 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:55:02.029004 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 586/1171] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:55:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 11:55:02.054265 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8df54e-cf5d-47f5-9ec4-3c691b4e97b8 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:55:02.134143 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:55:02.152668 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8df54e-cf5d-47f5-9ec4-3c691b4e97b8 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:55:02.185811 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c8c29d-6e2b-4733-adee-272edc0db3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:55:02.186606 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8c29d-6e2b-4733-adee-272edc0db3ac None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:55:02.186907 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8c29d-6e2b-4733-adee-272edc0db3ac None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:55:02.187165 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8c29d-6e2b-4733-adee-272edc0db3ac None admin] PATH_INFO: `/v3/domains/68cab0f4137e4d75bc6d35fa21f04c8d` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:55:02.197370 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c8c29d-6e2b-4733-adee-272edc0db3ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=68cab0f4137e4d75bc6d35fa21f04c8d)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:55:02.198813 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c8c29d-6e2b-4733-adee-272edc0db3ac None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:55:02.200452 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 586/1172] 10.222.0.39 () {56 vars in 1183 bytes} [Wed Jun 8 11:55:02 2022] GET /identity/v3/domains/68cab0f4137e4d75bc6d35fa21f04c8d => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:55:02.206243 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3631f-0356-478f-94ae-fd914fba6112 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:55:02.307307 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3631f-0356-478f-94ae-fd914fba6112 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:55:02.339327 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6148126-d037-4c16-9b57-630587db0763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:55:02.339973 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6148126-d037-4c16-9b57-630587db0763 None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:55:02.340290 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6148126-d037-4c16-9b57-630587db0763 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:55:02.340570 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6148126-d037-4c16-9b57-630587db0763 None admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:55:02.341277 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6148126-d037-4c16-9b57-630587db0763 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:55:02.342699 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6148126-d037-4c16-9b57-630587db0763 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:55:02.368287 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 587/1173] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Jun 8 11:55:02 2022] POST /identity/v3/projects => generated 361 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 11:55:04.622675 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd76351-2d18-4c8b-932f-bab245a0ef1a None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:55:04.623124 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd76351-2d18-4c8b-932f-bab245a0ef1a None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:55:04.623217 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd76351-2d18-4c8b-932f-bab245a0ef1a None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:55:04.624615 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 587/1174] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:55:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:55:04.630388 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3baa3d1-ed9c-4dbd-a4de-28dd4818da9e None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:55:04.630881 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3baa3d1-ed9c-4dbd-a4de-28dd4818da9e None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:55:04.630993 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3baa3d1-ed9c-4dbd-a4de-28dd4818da9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:55:04.647306 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-b3baa3d1-ed9c-4dbd-a4de-28dd4818da9e None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:55:04.648520 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b3baa3d1-ed9c-4dbd-a4de-28dd4818da9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:55:04.679198 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:55:04.727574 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 588/1175] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:55:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 11:55:04.751959 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd76351-2d18-4c8b-932f-bab245a0ef1a None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:55:04.853186 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd76351-2d18-4c8b-932f-bab245a0ef1a None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:55:04.885002 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee959a-889d-4bb8-86dd-317797175568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:55:04.885855 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee959a-889d-4bb8-86dd-317797175568 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:55:04.886142 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee959a-889d-4bb8-86dd-317797175568 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:55:04.886419 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee959a-889d-4bb8-86dd-317797175568 None admin] PATH_INFO: `/v3/domains/68cab0f4137e4d75bc6d35fa21f04c8d` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:55:04.887584 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee959a-889d-4bb8-86dd-317797175568 None admin] RBAC: Authorizing `identity:get_domain(domain_id=68cab0f4137e4d75bc6d35fa21f04c8d)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:55:04.889051 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee959a-889d-4bb8-86dd-317797175568 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:55:04.890641 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 588/1176] 10.222.0.39 () {56 vars in 1183 bytes} [Wed Jun 8 11:55:04 2022] GET /identity/v3/domains/68cab0f4137e4d75bc6d35fa21f04c8d => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:55:04.896990 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3baa3d1-ed9c-4dbd-a4de-28dd4818da9e None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:55:04.991157 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3baa3d1-ed9c-4dbd-a4de-28dd4818da9e None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:55:05.027597 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6bc605-eb38-4198-9d78-6de4873e8b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:55:05.028298 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6bc605-eb38-4198-9d78-6de4873e8b98 None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:55:05.028580 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6bc605-eb38-4198-9d78-6de4873e8b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:55:05.028851 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6bc605-eb38-4198-9d78-6de4873e8b98 None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:55:05.029568 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6bc605-eb38-4198-9d78-6de4873e8b98 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:55:05.030990 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6bc605-eb38-4198-9d78-6de4873e8b98 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:55:05.050279 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 589/1177] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Jun 8 11:55:04 2022] POST /identity/v3/users => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 11:55:07.334540 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860fd89-4f2e-4423-aa0c-98139520e7af None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:55:07.335096 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860fd89-4f2e-4423-aa0c-98139520e7af None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:55:07.335096 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860fd89-4f2e-4423-aa0c-98139520e7af None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:55:07.336505 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 589/1178] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:55:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:55:07.342952 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34905da-69a7-4c3f-afa2-53153033c2ab None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:55:07.343414 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34905da-69a7-4c3f-afa2-53153033c2ab None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:55:07.343508 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34905da-69a7-4c3f-afa2-53153033c2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:55:07.361548 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-b34905da-69a7-4c3f-afa2-53153033c2ab None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:55:07.363670 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b34905da-69a7-4c3f-afa2-53153033c2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:55:07.374090 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:55:07.429410 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 590/1179] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:55:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 11:55:07.452422 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1860fd89-4f2e-4423-aa0c-98139520e7af None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:55:07.465300 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:55:07.553638 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1860fd89-4f2e-4423-aa0c-98139520e7af None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:55:07.585681 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d4315-ed71-44f4-883e-8fd96de69b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:55:07.586408 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d4315-ed71-44f4-883e-8fd96de69b08 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:55:07.586690 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d4315-ed71-44f4-883e-8fd96de69b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:55:07.586961 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d4315-ed71-44f4-883e-8fd96de69b08 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:55:07.598260 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4d4315-ed71-44f4-883e-8fd96de69b08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:55:07.605951 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-bf4d4315-ed71-44f4-883e-8fd96de69b08 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:55:07.605951 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:55:07.605951 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:55:07.605951 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:55:07.605951 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:55:07.605951 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:55:07.605951 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:55:07.605951 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:55:07.605951 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:55:07.605951 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:55:07.605951 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:55:07.605951 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:55:07.605951 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:55:07.605951 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:55:07.605951 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:55:07.605951 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:55:07.607045 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:55:07.607045 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:55:07.607045 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:55:07.607045 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:55:07.607045 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:55:07.607045 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:55:07.607045 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:55:07.607045 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:55:07.607045 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:55:07.607045 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:55:07.607045 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:55:07.607045 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:55:07.607045 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:55:07.607045 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:55:07.607045 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:55:07.607045 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:55:07.608287 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:55:07.608287 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:55:07.608287 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:55:07.608287 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:55:07.608287 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:55:07.608287 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:55:07.608287 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:55:07.608287 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:55:07.608287 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:55:07.608287 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:55:07.608287 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:55:07.608287 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:55:07.608287 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 590/1180] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Jun 8 11:55:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:55:07.613984 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34905da-69a7-4c3f-afa2-53153033c2ab None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:55:07.709566 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34905da-69a7-4c3f-afa2-53153033c2ab None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:55:07.743081 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e33a7b-5286-44bc-a518-44a0ca04471e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:55:07.743739 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e33a7b-5286-44bc-a518-44a0ca04471e None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:55:07.744019 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e33a7b-5286-44bc-a518-44a0ca04471e None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:55:07.744325 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e33a7b-5286-44bc-a518-44a0ca04471e None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:55:07.745066 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e33a7b-5286-44bc-a518-44a0ca04471e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:55:07.745373 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e33a7b-5286-44bc-a518-44a0ca04471e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:55:07.746734 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e33a7b-5286-44bc-a518-44a0ca04471e None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:55:07.754632 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 591/1181] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:55:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:55:07.760338 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d4315-ed71-44f4-883e-8fd96de69b08 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:55:07.827230 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:55:07.858345 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d4315-ed71-44f4-883e-8fd96de69b08 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:55:07.890228 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba59660-fbdf-4647-831d-c8ea790870d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:55:07.891084 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba59660-fbdf-4647-831d-c8ea790870d1 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:55:07.891367 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba59660-fbdf-4647-831d-c8ea790870d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:55:07.891644 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba59660-fbdf-4647-831d-c8ea790870d1 None admin] PATH_INFO: `/v3/users/934207b719a34af0adea72ae061b28fd` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:55:07.904739 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba59660-fbdf-4647-831d-c8ea790870d1 None admin] RBAC: Authorizing `identity:get_user(user_id=934207b719a34af0adea72ae061b28fd)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:55:07.906180 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba59660-fbdf-4647-831d-c8ea790870d1 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:55:07.907806 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 591/1182] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Jun 8 11:55:07 2022] GET /identity/v3/users/934207b719a34af0adea72ae061b28fd => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:55:07.914241 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e33a7b-5286-44bc-a518-44a0ca04471e None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:55:07.925271 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:55:08.010601 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e33a7b-5286-44bc-a518-44a0ca04471e None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:55:08.043384 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec304f9c-9dda-4d6a-90ab-a3ead17ca8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:55:08.044020 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec304f9c-9dda-4d6a-90ab-a3ead17ca8e2 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:55:08.044342 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec304f9c-9dda-4d6a-90ab-a3ead17ca8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:55:08.044619 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec304f9c-9dda-4d6a-90ab-a3ead17ca8e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:55:08.108767 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec304f9c-9dda-4d6a-90ab-a3ead17ca8e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:55:08.110130 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec304f9c-9dda-4d6a-90ab-a3ead17ca8e2 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:55:08.119240 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:55:08.204803 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 592/1183] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:55:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 11:55:08.210798 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba59660-fbdf-4647-831d-c8ea790870d1 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:55:08.308343 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba59660-fbdf-4647-831d-c8ea790870d1 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:55:08.333530 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:55:08.341573 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa45ce0c-6423-4c3e-8adc-bd6aafa3fa3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:55:08.342426 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45ce0c-6423-4c3e-8adc-bd6aafa3fa3d None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:55:08.342710 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45ce0c-6423-4c3e-8adc-bd6aafa3fa3d None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:55:08.342987 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45ce0c-6423-4c3e-8adc-bd6aafa3fa3d None admin] PATH_INFO: `/v3/projects/90e21da066b840e7b239d99e23c467d6` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:55:08.344157 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa45ce0c-6423-4c3e-8adc-bd6aafa3fa3d None admin] RBAC: Authorizing `identity:get_project(project_id=90e21da066b840e7b239d99e23c467d6)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:55:08.345623 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa45ce0c-6423-4c3e-8adc-bd6aafa3fa3d None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:55:08.348115 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 592/1184] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Jun 8 11:55:08 2022] GET /identity/v3/projects/90e21da066b840e7b239d99e23c467d6 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:55:08.354147 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec304f9c-9dda-4d6a-90ab-a3ead17ca8e2 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:55:08.448959 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec304f9c-9dda-4d6a-90ab-a3ead17ca8e2 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:55:08.458300 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:55:08.483538 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc353650-6a9c-4c0b-a533-ec0bafc04b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:55:08.484209 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc353650-6a9c-4c0b-a533-ec0bafc04b26 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:55:08.484496 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc353650-6a9c-4c0b-a533-ec0bafc04b26 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:55:08.484770 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc353650-6a9c-4c0b-a533-ec0bafc04b26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:55:08.485593 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc353650-6a9c-4c0b-a533-ec0bafc04b26 None admin] RBAC: Adding query filter params (role.id=028d4429a4554bbb88b3aec9f6a9d937, scope.project.id=90e21da066b840e7b239d99e23c467d6, user.id=934207b719a34af0adea72ae061b28fd) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:55:08.485903 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc353650-6a9c-4c0b-a533-ec0bafc04b26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:55:08.487321 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc353650-6a9c-4c0b-a533-ec0bafc04b26 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:55:08.492918 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 593/1185] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Jun 8 11:55:08 2022] GET /identity/v3/role_assignments?user.id=934207b719a34af0adea72ae061b28fd&scope.project.id=90e21da066b840e7b239d99e23c467d6&role.id=028d4429a4554bbb88b3aec9f6a9d937 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:55:10.709209 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d8149-03e8-428e-9fdc-5f9c09654722 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:55:10.709722 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d8149-03e8-428e-9fdc-5f9c09654722 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:55:10.709832 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d8149-03e8-428e-9fdc-5f9c09654722 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:55:10.711137 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 593/1186] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:55:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:55:10.716432 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e078bbb8-4edb-46f7-a5e2-0582e739c0fc None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:55:10.716831 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e078bbb8-4edb-46f7-a5e2-0582e739c0fc None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:55:10.716983 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e078bbb8-4edb-46f7-a5e2-0582e739c0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:55:10.733631 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-e078bbb8-4edb-46f7-a5e2-0582e739c0fc None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:55:10.734811 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-e078bbb8-4edb-46f7-a5e2-0582e739c0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:55:10.799532 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 594/1187] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:55:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 11:55:10.822964 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146d8149-03e8-428e-9fdc-5f9c09654722 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:55:10.921256 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146d8149-03e8-428e-9fdc-5f9c09654722 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:55:10.954890 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48aaed9-03f8-40bb-b76b-2849ac6d339d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:55:10.955668 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48aaed9-03f8-40bb-b76b-2849ac6d339d None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:55:10.955948 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48aaed9-03f8-40bb-b76b-2849ac6d339d None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:55:10.956370 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48aaed9-03f8-40bb-b76b-2849ac6d339d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:55:10.966183 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48aaed9-03f8-40bb-b76b-2849ac6d339d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:55:10.974341 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-b48aaed9-03f8-40bb-b76b-2849ac6d339d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:55:10.974341 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:55:10.974341 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:55:10.974341 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:55:10.974341 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:55:10.974341 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:55:10.974341 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:55:10.974341 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:55:10.974341 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:55:10.974341 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:55:10.974341 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:55:10.974341 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:55:10.974341 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:55:10.974341 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:55:10.974341 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:55:10.974341 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:55:10.975475 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:55:10.975475 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:55:10.975475 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:55:10.975475 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:55:10.975475 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:55:10.975475 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:55:10.975475 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:55:10.975475 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:55:10.975475 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:55:10.975475 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:55:10.975475 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:55:10.975475 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:55:10.975475 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:55:10.975475 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:55:10.975475 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:55:10.975475 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:55:10.976477 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:55:10.976477 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:55:10.976477 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:55:10.976477 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:55:10.976477 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:55:10.976477 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:55:10.976477 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:55:10.976477 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:55:10.976477 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:55:10.976477 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:55:10.976477 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:55:10.976477 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:55:10.976477 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 594/1188] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Jun 8 11:55:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:55:10.981435 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e078bbb8-4edb-46f7-a5e2-0582e739c0fc None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:55:11.077444 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e078bbb8-4edb-46f7-a5e2-0582e739c0fc None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:55:11.078927 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:55:11.111882 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67811da-1329-44b5-bea4-91fbbf33ee2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:55:11.113146 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67811da-1329-44b5-bea4-91fbbf33ee2a None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:55:11.113428 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67811da-1329-44b5-bea4-91fbbf33ee2a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:55:11.113704 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67811da-1329-44b5-bea4-91fbbf33ee2a None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:55:11.114442 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67811da-1329-44b5-bea4-91fbbf33ee2a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:55:11.114746 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67811da-1329-44b5-bea4-91fbbf33ee2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:55:11.116110 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67811da-1329-44b5-bea4-91fbbf33ee2a None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:55:11.123924 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 595/1189] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:55:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:55:11.129964 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48aaed9-03f8-40bb-b76b-2849ac6d339d None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:55:11.192772 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:55:11.238129 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48aaed9-03f8-40bb-b76b-2849ac6d339d None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:55:11.269655 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829abc46-128e-440a-a608-e24866e5db53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:55:11.270511 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829abc46-128e-440a-a608-e24866e5db53 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:55:11.270790 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829abc46-128e-440a-a608-e24866e5db53 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:55:11.271062 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829abc46-128e-440a-a608-e24866e5db53 None admin] PATH_INFO: `/v3/users/934207b719a34af0adea72ae061b28fd` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:55:11.272245 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829abc46-128e-440a-a608-e24866e5db53 None admin] RBAC: Authorizing `identity:get_user(user_id=934207b719a34af0adea72ae061b28fd)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:55:11.273671 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829abc46-128e-440a-a608-e24866e5db53 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:55:11.275249 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 595/1190] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Jun 8 11:55:11 2022] GET /identity/v3/users/934207b719a34af0adea72ae061b28fd => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:55:11.281154 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67811da-1329-44b5-bea4-91fbbf33ee2a None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:55:11.378693 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67811da-1329-44b5-bea4-91fbbf33ee2a None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:55:11.410980 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8246cf-10db-4bd5-a906-d7ec49820a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:55:11.411831 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8246cf-10db-4bd5-a906-d7ec49820a53 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:55:11.412115 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8246cf-10db-4bd5-a906-d7ec49820a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:55:11.412410 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8246cf-10db-4bd5-a906-d7ec49820a53 None admin] PATH_INFO: `/v3/projects/90e21da066b840e7b239d99e23c467d6` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:55:11.413568 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8246cf-10db-4bd5-a906-d7ec49820a53 None admin] RBAC: Authorizing `identity:get_project(project_id=90e21da066b840e7b239d99e23c467d6)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:55:11.414992 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8246cf-10db-4bd5-a906-d7ec49820a53 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:55:11.416692 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 596/1191] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Jun 8 11:55:11 2022] GET /identity/v3/projects/90e21da066b840e7b239d99e23c467d6 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:55:11.422641 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829abc46-128e-440a-a608-e24866e5db53 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:55:11.519084 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829abc46-128e-440a-a608-e24866e5db53 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:55:11.541209 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:55:11.552424 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110e13a-deb5-4cfd-901a-ee13168a861d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:55:11.553303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110e13a-deb5-4cfd-901a-ee13168a861d None admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:55:11.553580 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110e13a-deb5-4cfd-901a-ee13168a861d None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:55:11.553850 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110e13a-deb5-4cfd-901a-ee13168a861d None admin] PATH_INFO: `/v3/projects/90e21da066b840e7b239d99e23c467d6/users/934207b719a34af0adea72ae061b28fd/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:55:11.555751 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d110e13a-deb5-4cfd-901a-ee13168a861d None admin] RBAC: Authorizing `identity:create_grant(project_id=90e21da066b840e7b239d99e23c467d6, user_id=934207b719a34af0adea72ae061b28fd, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:55:11.557203 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d110e13a-deb5-4cfd-901a-ee13168a861d None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:55:11.569964 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 596/1192] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Jun 8 11:55:11 2022] PUT /identity/v3/projects/90e21da066b840e7b239d99e23c467d6/users/934207b719a34af0adea72ae061b28fd/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 11:55:13.768699 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25429d-aaba-48ed-bcd2-0d5d6706f445 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:55:13.769259 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25429d-aaba-48ed-bcd2-0d5d6706f445 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:55:13.769259 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25429d-aaba-48ed-bcd2-0d5d6706f445 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:55:13.770626 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 597/1193] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:55:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:55:13.775944 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf0a7f-9d77-4f4a-8770-8b2a6a67010f None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:55:13.776380 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf0a7f-9d77-4f4a-8770-8b2a6a67010f None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:55:13.776554 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf0a7f-9d77-4f4a-8770-8b2a6a67010f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:55:13.793074 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-aeaf0a7f-9d77-4f4a-8770-8b2a6a67010f None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:55:13.794254 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-aeaf0a7f-9d77-4f4a-8770-8b2a6a67010f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:55:13.858665 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 597/1194] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:55:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 11:55:13.883571 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25429d-aaba-48ed-bcd2-0d5d6706f445 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:55:13.914715 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:55:13.983946 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25429d-aaba-48ed-bcd2-0d5d6706f445 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:55:14.019671 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f32d67d-2267-4c19-be36-b614617366b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:55:14.020574 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32d67d-2267-4c19-be36-b614617366b5 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:55:14.020858 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32d67d-2267-4c19-be36-b614617366b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:55:14.021136 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32d67d-2267-4c19-be36-b614617366b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:55:14.031400 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f32d67d-2267-4c19-be36-b614617366b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:55:14.039477 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-6f32d67d-2267-4c19-be36-b614617366b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:55:14.039477 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:55:14.039477 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:55:14.039477 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:55:14.039477 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:55:14.039477 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:55:14.039477 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:55:14.039477 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:55:14.039477 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:55:14.039477 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:55:14.039477 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:55:14.039477 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:55:14.039477 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:55:14.039477 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:55:14.039477 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:55:14.039477 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:55:14.040590 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:55:14.040590 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:55:14.040590 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:55:14.040590 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:55:14.040590 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:55:14.040590 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:55:14.040590 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:55:14.040590 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:55:14.040590 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:55:14.040590 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:55:14.040590 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:55:14.040590 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:55:14.040590 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:55:14.040590 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:55:14.040590 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:55:14.040590 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:55:14.041459 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:55:14.041459 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:55:14.041459 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:55:14.041459 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:55:14.041459 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:55:14.041459 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:55:14.041459 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:55:14.041459 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:55:14.041459 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:55:14.041459 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:55:14.041459 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:55:14.041459 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:55:14.041459 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 598/1195] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Jun 8 11:55:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:55:14.046670 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf0a7f-9d77-4f4a-8770-8b2a6a67010f None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:55:14.152741 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf0a7f-9d77-4f4a-8770-8b2a6a67010f None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:55:14.166680 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:55:14.188121 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77316834-db36-4458-ae65-518f7177869b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:55:14.188811 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77316834-db36-4458-ae65-518f7177869b None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:55:14.189102 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77316834-db36-4458-ae65-518f7177869b None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:55:14.189382 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77316834-db36-4458-ae65-518f7177869b None admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:55:14.190129 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77316834-db36-4458-ae65-518f7177869b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:55:14.190658 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77316834-db36-4458-ae65-518f7177869b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:55:14.192025 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77316834-db36-4458-ae65-518f7177869b None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:55:14.199844 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 598/1196] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:55:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:55:14.205594 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f32d67d-2267-4c19-be36-b614617366b5 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:55:14.294814 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:55:14.304673 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f32d67d-2267-4c19-be36-b614617366b5 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:55:14.337276 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db0c69-ac25-40dd-abe4-dd335b791e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:55:14.338139 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db0c69-ac25-40dd-abe4-dd335b791e93 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:55:14.338426 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db0c69-ac25-40dd-abe4-dd335b791e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:55:14.338701 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db0c69-ac25-40dd-abe4-dd335b791e93 None admin] PATH_INFO: `/v3/users/934207b719a34af0adea72ae061b28fd` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:55:14.339858 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3db0c69-ac25-40dd-abe4-dd335b791e93 None admin] RBAC: Authorizing `identity:get_user(user_id=934207b719a34af0adea72ae061b28fd)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:55:14.341321 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3db0c69-ac25-40dd-abe4-dd335b791e93 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:55:14.342921 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 599/1197] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Jun 8 11:55:14 2022] GET /identity/v3/users/934207b719a34af0adea72ae061b28fd => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:55:14.349780 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77316834-db36-4458-ae65-518f7177869b None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:55:14.448347 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77316834-db36-4458-ae65-518f7177869b None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:55:14.481567 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a580fb8-da9d-42b6-9e1a-5d722c81712b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:55:14.482206 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a580fb8-da9d-42b6-9e1a-5d722c81712b None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:55:14.482488 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a580fb8-da9d-42b6-9e1a-5d722c81712b None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:55:14.482760 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a580fb8-da9d-42b6-9e1a-5d722c81712b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:55:14.524937 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:55:14.547084 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a580fb8-da9d-42b6-9e1a-5d722c81712b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:55:14.548547 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a580fb8-da9d-42b6-9e1a-5d722c81712b None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:55:14.643044 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 599/1198] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:55:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 11:55:14.649735 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db0c69-ac25-40dd-abe4-dd335b791e93 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:55:14.749550 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db0c69-ac25-40dd-abe4-dd335b791e93 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:55:14.782504 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b366bd3-41cd-466f-a836-8470a234e16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:55:14.783356 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b366bd3-41cd-466f-a836-8470a234e16e None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:55:14.783635 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b366bd3-41cd-466f-a836-8470a234e16e None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:55:14.783911 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b366bd3-41cd-466f-a836-8470a234e16e None admin] PATH_INFO: `/v3/projects/90e21da066b840e7b239d99e23c467d6` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:55:14.785833 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b366bd3-41cd-466f-a836-8470a234e16e None admin] RBAC: Authorizing `identity:get_project(project_id=90e21da066b840e7b239d99e23c467d6)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:55:14.787258 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b366bd3-41cd-466f-a836-8470a234e16e None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:55:14.788980 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 600/1199] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Jun 8 11:55:14 2022] GET /identity/v3/projects/90e21da066b840e7b239d99e23c467d6 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:55:14.795033 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a580fb8-da9d-42b6-9e1a-5d722c81712b None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:55:14.869592 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:55:14.892548 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a580fb8-da9d-42b6-9e1a-5d722c81712b None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:55:14.925316 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a5e0dc-02b4-4c4b-a8a3-c33bcb93bc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:55:14.925955 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5e0dc-02b4-4c4b-a8a3-c33bcb93bc44 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:55:14.926236 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5e0dc-02b4-4c4b-a8a3-c33bcb93bc44 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:55:14.926512 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5e0dc-02b4-4c4b-a8a3-c33bcb93bc44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:55:14.927336 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a5e0dc-02b4-4c4b-a8a3-c33bcb93bc44 None admin] RBAC: Adding query filter params (role.id=028d4429a4554bbb88b3aec9f6a9d937, scope.project.id=90e21da066b840e7b239d99e23c467d6, user.id=934207b719a34af0adea72ae061b28fd) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:55:14.927645 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a5e0dc-02b4-4c4b-a8a3-c33bcb93bc44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:55:14.929106 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a5e0dc-02b4-4c4b-a8a3-c33bcb93bc44 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:55:14.934754 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 600/1200] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Jun 8 11:55:14 2022] GET /identity/v3/role_assignments?user.id=934207b719a34af0adea72ae061b28fd&scope.project.id=90e21da066b840e7b239d99e23c467d6&role.id=028d4429a4554bbb88b3aec9f6a9d937 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:55:24.778788 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=86 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:55:24.932649 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=30 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:16.169097 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a76e84-c8c2-4299-bc82-9c208119e3a0 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:16.169724 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a76e84-c8c2-4299-bc82-9c208119e3a0 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:16.169724 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a76e84-c8c2-4299-bc82-9c208119e3a0 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:16.171252 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 601/1201] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:56:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 11:56:16.176486 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec94c8a-cf08-42da-94d9-ce5f8f6bd7b0 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:16.176947 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec94c8a-cf08-42da-94d9-ce5f8f6bd7b0 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:16.177033 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec94c8a-cf08-42da-94d9-ce5f8f6bd7b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:16.199698 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-7ec94c8a-cf08-42da-94d9-ce5f8f6bd7b0 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:56:16.201150 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-7ec94c8a-cf08-42da-94d9-ce5f8f6bd7b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:56:16.293664 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 601/1202] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:56:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 11:56:16.320127 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a76e84-c8c2-4299-bc82-9c208119e3a0 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:16.471076 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a76e84-c8c2-4299-bc82-9c208119e3a0 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:16.522702 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ede8d1-1cd1-46cf-932f-a00a14428604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:16.523626 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ede8d1-1cd1-46cf-932f-a00a14428604 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:16.524101 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ede8d1-1cd1-46cf-932f-a00a14428604 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:16.524331 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ede8d1-1cd1-46cf-932f-a00a14428604 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:16.536965 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ede8d1-1cd1-46cf-932f-a00a14428604 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:16.538659 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ede8d1-1cd1-46cf-932f-a00a14428604 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:16.560097 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-f9ede8d1-1cd1-46cf-932f-a00a14428604 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:56:16.560097 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:56:16.560097 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:56:16.560097 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:56:16.560097 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:56:16.560097 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:56:16.560097 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:56:16.560097 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:56:16.560097 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:56:16.560097 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:56:16.560097 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:56:16.560097 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:56:16.560097 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:56:16.560097 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:56:16.560097 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:56:16.561527 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:56:16.561527 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:56:16.561527 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:56:16.561527 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:56:16.561527 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:56:16.561527 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:56:16.561527 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:56:16.561527 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:56:16.561527 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:56:16.561527 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:56:16.561527 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:56:16.561527 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:56:16.561527 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:56:16.561527 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:56:16.561527 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:56:16.561527 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:56:16.561527 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:56:16.563550 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:56:16.563550 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:56:16.563550 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:56:16.563550 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:56:16.563550 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 602/1203] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:56:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:56:16.569069 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec94c8a-cf08-42da-94d9-ce5f8f6bd7b0 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:16.721558 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec94c8a-cf08-42da-94d9-ce5f8f6bd7b0 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:16.757769 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:16.766463 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7d640-5f2b-4d93-9d0f-c291a7d2141f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:16.767935 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7d640-5f2b-4d93-9d0f-c291a7d2141f None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:16.768593 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7d640-5f2b-4d93-9d0f-c291a7d2141f None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:16.768915 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7d640-5f2b-4d93-9d0f-c291a7d2141f None admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:16.769646 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d7d640-5f2b-4d93-9d0f-c291a7d2141f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:56:16.769954 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d7d640-5f2b-4d93-9d0f-c291a7d2141f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:16.771628 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d7d640-5f2b-4d93-9d0f-c291a7d2141f None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:16.787671 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 602/1204] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:56:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:56:16.795544 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ede8d1-1cd1-46cf-932f-a00a14428604 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:16.875966 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:16.930326 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ede8d1-1cd1-46cf-932f-a00a14428604 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:16.972321 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e3f78d-3b33-4692-99c3-e01ad75836de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:16.973086 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3f78d-3b33-4692-99c3-e01ad75836de None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:16.973484 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3f78d-3b33-4692-99c3-e01ad75836de None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:16.973853 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3f78d-3b33-4692-99c3-e01ad75836de None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:16.974688 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e3f78d-3b33-4692-99c3-e01ad75836de None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:16.976214 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e3f78d-3b33-4692-99c3-e01ad75836de None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:17.003277 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 603/1205] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Jun 8 11:56:16 2022] POST /identity/v3/users => generated 251 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 11:56:19.469531 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d6458-98a8-4755-8c5e-10c11f8fc26c None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:19.470144 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d6458-98a8-4755-8c5e-10c11f8fc26c None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:19.471276 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d6458-98a8-4755-8c5e-10c11f8fc26c None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:19.471749 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 603/1206] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:56:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:56:19.478437 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08ac6c-9a93-43a5-aeca-38a081f6ce1d None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:19.479007 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08ac6c-9a93-43a5-aeca-38a081f6ce1d None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:19.479007 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08ac6c-9a93-43a5-aeca-38a081f6ce1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:19.500910 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-5b08ac6c-9a93-43a5-aeca-38a081f6ce1d None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:56:19.502444 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-5b08ac6c-9a93-43a5-aeca-38a081f6ce1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:56:19.583932 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 604/1207] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:56:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 11:56:19.607364 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0d6458-98a8-4755-8c5e-10c11f8fc26c None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:19.727677 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0d6458-98a8-4755-8c5e-10c11f8fc26c None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:19.767918 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47965747-4767-4bee-a501-25af749a5141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:19.768929 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47965747-4767-4bee-a501-25af749a5141 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:19.769299 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47965747-4767-4bee-a501-25af749a5141 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:19.769682 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47965747-4767-4bee-a501-25af749a5141 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:19.781931 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47965747-4767-4bee-a501-25af749a5141 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:56:19.790104 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-47965747-4767-4bee-a501-25af749a5141 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 11:56:19.790104 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:56:19.790104 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:56:19.790104 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:56:19.790104 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:56:19.790104 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:56:19.790104 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:56:19.790104 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:56:19.790104 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:56:19.790104 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:56:19.790104 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:56:19.790104 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:56:19.790104 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:56:19.790104 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:56:19.790104 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:56:19.790104 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:56:19.791322 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:56:19.791322 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:56:19.791322 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:56:19.791322 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:56:19.791322 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:56:19.791322 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:56:19.791322 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:56:19.791322 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:56:19.791322 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:56:19.791322 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:56:19.791322 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:56:19.791322 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:56:19.791322 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:56:19.791322 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:56:19.791322 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:56:19.791322 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:56:19.792238 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:56:19.792238 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:56:19.792238 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:56:19.792238 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:56:19.792238 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:56:19.792238 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:56:19.792238 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:56:19.792238 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:56:19.792238 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:56:19.792238 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:56:19.792238 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 11:56:19.792238 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:56:19.792238 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 604/1208] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Jun 8 11:56:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 11:56:19.797611 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b08ac6c-9a93-43a5-aeca-38a081f6ce1d None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:19.846169 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:19.913654 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b08ac6c-9a93-43a5-aeca-38a081f6ce1d None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:19.950794 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771f10c-9133-4876-adc5-5cee08fbb2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:19.951897 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771f10c-9133-4876-adc5-5cee08fbb2c3 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:19.952712 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771f10c-9133-4876-adc5-5cee08fbb2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:19.953189 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771f10c-9133-4876-adc5-5cee08fbb2c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:19.953935 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7771f10c-9133-4876-adc5-5cee08fbb2c3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:56:19.954247 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7771f10c-9133-4876-adc5-5cee08fbb2c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:19.955617 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7771f10c-9133-4876-adc5-5cee08fbb2c3 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:19.965871 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 605/1209] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Jun 8 11:56:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:56:19.971859 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47965747-4767-4bee-a501-25af749a5141 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:20.027931 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:20.091545 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47965747-4767-4bee-a501-25af749a5141 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:20.132845 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89a5a4-d0ff-4f6a-aaa2-ec465fd0b027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:20.133718 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89a5a4-d0ff-4f6a-aaa2-ec465fd0b027 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:20.135138 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89a5a4-d0ff-4f6a-aaa2-ec465fd0b027 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:20.135138 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89a5a4-d0ff-4f6a-aaa2-ec465fd0b027 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:20.145673 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa89a5a4-d0ff-4f6a-aaa2-ec465fd0b027 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:20.147567 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa89a5a4-d0ff-4f6a-aaa2-ec465fd0b027 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:20.170992 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-fa89a5a4-d0ff-4f6a-aaa2-ec465fd0b027 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:56:20.170992 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:56:20.170992 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:56:20.170992 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:56:20.170992 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:56:20.170992 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:56:20.170992 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:56:20.170992 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:56:20.170992 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:56:20.170992 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:56:20.170992 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:56:20.170992 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:56:20.170992 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:56:20.170992 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:56:20.170992 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:56:20.172697 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:56:20.172697 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:56:20.172697 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:56:20.172697 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:56:20.172697 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:56:20.172697 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:56:20.172697 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:56:20.172697 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:56:20.172697 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:56:20.172697 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:56:20.172697 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:56:20.172697 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:56:20.172697 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:56:20.172697 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:56:20.172697 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:56:20.172697 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:56:20.172697 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:56:20.173607 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:56:20.173607 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:56:20.173607 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:56:20.173607 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:56:20.180196 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 605/1210] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:56:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 11:56:20.181764 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771f10c-9133-4876-adc5-5cee08fbb2c3 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:20.303970 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:20.307357 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771f10c-9133-4876-adc5-5cee08fbb2c3 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:20.348004 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93afeb52-2a10-4a2a-b9d9-1aa26f30d265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:20.348852 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afeb52-2a10-4a2a-b9d9-1aa26f30d265 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:20.349138 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afeb52-2a10-4a2a-b9d9-1aa26f30d265 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:20.349417 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afeb52-2a10-4a2a-b9d9-1aa26f30d265 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:20.350142 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93afeb52-2a10-4a2a-b9d9-1aa26f30d265 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:56:20.350463 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93afeb52-2a10-4a2a-b9d9-1aa26f30d265 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:20.351852 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93afeb52-2a10-4a2a-b9d9-1aa26f30d265 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:20.367518 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 606/1211] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:56:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:56:20.373546 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89a5a4-d0ff-4f6a-aaa2-ec465fd0b027 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:20.488723 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89a5a4-d0ff-4f6a-aaa2-ec465fd0b027 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:20.493744 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:20.529379 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a814a10-1146-49e1-b619-3dbfa496eaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:20.530875 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a814a10-1146-49e1-b619-3dbfa496eaeb None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:20.531375 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a814a10-1146-49e1-b619-3dbfa496eaeb None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:20.531693 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a814a10-1146-49e1-b619-3dbfa496eaeb None admin] PATH_INFO: `/v3/users/placement` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:20.539842 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a814a10-1146-49e1-b619-3dbfa496eaeb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:20.541340 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a814a10-1146-49e1-b619-3dbfa496eaeb None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:20.557363 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-6a814a10-1146-49e1-b619-3dbfa496eaeb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 08 11:56:20.557363 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:56:20.557363 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:56:20.557363 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:56:20.557363 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:56:20.557363 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:56:20.557363 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:56:20.557363 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:56:20.557363 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:56:20.557363 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:56:20.557363 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:56:20.557363 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:56:20.557363 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 11:56:20.557363 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 11:56:20.557363 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 11:56:20.557363 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 11:56:20.558374 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:56:20.558374 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:56:20.558374 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 11:56:20.558374 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:56:20.558374 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 11:56:20.558374 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:56:20.558374 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:56:20.558374 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:56:20.558374 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:56:20.558374 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:56:20.558374 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:56:20.558374 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:56:20.558374 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:56:20.558374 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:56:20.558374 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:56:20.558374 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:56:20.558374 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:56:20.558374 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:56:20.559348 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:56:20.559348 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:56:20.559348 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 11:56:20.559348 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 11:56:20.559348 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 11:56:20.559348 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 11:56:20.559348 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 11:56:20.559348 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 11:56:20.559348 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 08 11:56:20.559348 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:56:20.559348 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 606/1212] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:56:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:56:20.564580 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93afeb52-2a10-4a2a-b9d9-1aa26f30d265 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:20.680195 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93afeb52-2a10-4a2a-b9d9-1aa26f30d265 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:20.721097 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a42f7-965d-4ef6-a598-22f1ac29ccd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:20.721843 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a42f7-965d-4ef6-a598-22f1ac29ccd4 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:20.722126 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a42f7-965d-4ef6-a598-22f1ac29ccd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:20.722455 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a42f7-965d-4ef6-a598-22f1ac29ccd4 None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:20.723375 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a42f7-965d-4ef6-a598-22f1ac29ccd4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:56:20.723681 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a42f7-965d-4ef6-a598-22f1ac29ccd4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:20.725659 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a42f7-965d-4ef6-a598-22f1ac29ccd4 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:20.751550 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 607/1213] 10.222.0.39 () {56 vars in 1143 bytes} [Wed Jun 8 11:56:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:56:20.752059 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a814a10-1146-49e1-b619-3dbfa496eaeb None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:20.873451 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a814a10-1146-49e1-b619-3dbfa496eaeb None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:20.911956 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7dd01-d363-44ac-9133-1fb96b7b45d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:20.912691 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7dd01-d363-44ac-9133-1fb96b7b45d6 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:20.913012 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7dd01-d363-44ac-9133-1fb96b7b45d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:20.913346 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7dd01-d363-44ac-9133-1fb96b7b45d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:20.948888 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:20.997863 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d7dd01-d363-44ac-9133-1fb96b7b45d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:20.999640 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d7dd01-d363-44ac-9133-1fb96b7b45d6 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:21.131362 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 607/1214] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:56:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 08 11:56:21.137206 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a42f7-965d-4ef6-a598-22f1ac29ccd4 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:21.163259 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:21.265122 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a42f7-965d-4ef6-a598-22f1ac29ccd4 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:21.306424 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5291a0-2270-439f-83cc-6db5e4c6ee18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:21.307519 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5291a0-2270-439f-83cc-6db5e4c6ee18 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:21.308051 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5291a0-2270-439f-83cc-6db5e4c6ee18 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:21.308569 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5291a0-2270-439f-83cc-6db5e4c6ee18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:21.321673 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5291a0-2270-439f-83cc-6db5e4c6ee18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:21.323288 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5291a0-2270-439f-83cc-6db5e4c6ee18 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:21.344943 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-fb5291a0-2270-439f-83cc-6db5e4c6ee18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:56:21.344943 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:56:21.344943 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:56:21.344943 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:56:21.344943 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:56:21.344943 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:56:21.344943 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:56:21.344943 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:56:21.344943 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:56:21.344943 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:56:21.344943 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:56:21.344943 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:56:21.344943 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:56:21.344943 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:56:21.344943 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:56:21.345977 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:56:21.345977 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:56:21.345977 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:56:21.345977 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:56:21.345977 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:56:21.345977 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:56:21.345977 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:56:21.345977 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:56:21.345977 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:56:21.345977 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:56:21.345977 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:56:21.345977 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:56:21.345977 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:56:21.345977 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:56:21.345977 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:56:21.345977 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:56:21.345977 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:56:21.346933 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:56:21.346933 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:56:21.346933 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:56:21.346933 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:56:21.351709 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 608/1215] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:56:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:56:21.352870 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7dd01-d363-44ac-9133-1fb96b7b45d6 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:21.428741 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:21.476711 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7dd01-d363-44ac-9133-1fb96b7b45d6 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:21.520287 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676258d0-19ae-400c-a7a1-56fbc1861d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:21.521043 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676258d0-19ae-400c-a7a1-56fbc1861d34 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:21.521332 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676258d0-19ae-400c-a7a1-56fbc1861d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:21.521630 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676258d0-19ae-400c-a7a1-56fbc1861d34 None admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:21.522929 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676258d0-19ae-400c-a7a1-56fbc1861d34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:56:21.523434 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676258d0-19ae-400c-a7a1-56fbc1861d34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:21.524845 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676258d0-19ae-400c-a7a1-56fbc1861d34 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:21.544206 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 608/1216] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:56:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:56:21.547188 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5291a0-2270-439f-83cc-6db5e4c6ee18 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:21.642208 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:21.689204 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5291a0-2270-439f-83cc-6db5e4c6ee18 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:21.745817 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90daaa13-49b6-466e-878e-9939fb59e89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:21.746725 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90daaa13-49b6-466e-878e-9939fb59e89d None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:21.747186 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90daaa13-49b6-466e-878e-9939fb59e89d None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:21.747484 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90daaa13-49b6-466e-878e-9939fb59e89d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:21.757283 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90daaa13-49b6-466e-878e-9939fb59e89d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:21.758737 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90daaa13-49b6-466e-878e-9939fb59e89d None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:21.777891 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-90daaa13-49b6-466e-878e-9939fb59e89d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:56:21.777891 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:56:21.777891 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:56:21.777891 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:56:21.777891 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:56:21.777891 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:56:21.777891 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:56:21.777891 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:56:21.777891 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:56:21.777891 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:56:21.777891 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:56:21.777891 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:56:21.777891 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 11:56:21.777891 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 11:56:21.777891 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 11:56:21.779164 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 11:56:21.779164 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:56:21.779164 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:56:21.779164 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:56:21.779164 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:56:21.779164 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:56:21.779164 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:56:21.779164 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:56:21.779164 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:56:21.779164 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:56:21.779164 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:56:21.779164 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:56:21.779164 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:56:21.779164 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:56:21.779164 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:56:21.779164 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:56:21.779164 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:56:21.785167 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 11:56:21.785167 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 11:56:21.785167 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 11:56:21.785167 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 11:56:21.785167 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 11:56:21.785167 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 11:56:21.785167 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:56:21.785167 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:56:21.785167 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 609/1217] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Jun 8 11:56:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:56:21.788988 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676258d0-19ae-400c-a7a1-56fbc1861d34 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:21.912510 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676258d0-19ae-400c-a7a1-56fbc1861d34 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:21.940724 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:21.955431 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aad52d-071a-4a7b-85c1-f9d814e136a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:21.956229 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aad52d-071a-4a7b-85c1-f9d814e136a0 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:21.956523 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aad52d-071a-4a7b-85c1-f9d814e136a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:21.956885 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aad52d-071a-4a7b-85c1-f9d814e136a0 None admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:21.957802 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aad52d-071a-4a7b-85c1-f9d814e136a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:56:21.958163 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aad52d-071a-4a7b-85c1-f9d814e136a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:21.959658 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aad52d-071a-4a7b-85c1-f9d814e136a0 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:21.976844 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 609/1218] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Jun 8 11:56:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:56:21.983147 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90daaa13-49b6-466e-878e-9939fb59e89d None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:22.106914 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90daaa13-49b6-466e-878e-9939fb59e89d None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:22.140734 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:22.147730 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ffdb82-8c3f-49aa-a5e6-30d2f884e3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:22.148515 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ffdb82-8c3f-49aa-a5e6-30d2f884e3c6 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:22.148811 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ffdb82-8c3f-49aa-a5e6-30d2f884e3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:22.149055 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ffdb82-8c3f-49aa-a5e6-30d2f884e3c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:22.149889 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ffdb82-8c3f-49aa-a5e6-30d2f884e3c6 None admin] RBAC: Adding query filter params (role.id=125b7374688b4b009d443f1b34947c49, scope.project.id=6a7fee684e8b43e199c95aeeb92640d4, user.id=e9009560a846414b849d42efa8625ff5) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:56:22.150193 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ffdb82-8c3f-49aa-a5e6-30d2f884e3c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:22.151623 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ffdb82-8c3f-49aa-a5e6-30d2f884e3c6 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:22.158103 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 610/1219] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Jun 8 11:56:21 2022] GET /identity/v3/role_assignments?user.id=e9009560a846414b849d42efa8625ff5&scope.project.id=6a7fee684e8b43e199c95aeeb92640d4&role.id=125b7374688b4b009d443f1b34947c49 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:56:24.479582 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb9212-195c-4fa3-b008-e21cf2fb2ed0 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:24.480150 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb9212-195c-4fa3-b008-e21cf2fb2ed0 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:24.480150 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb9212-195c-4fa3-b008-e21cf2fb2ed0 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:24.481530 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 610/1220] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:56:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:56:24.489218 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19579276-5acd-45f4-870d-2bcd000c20b6 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:24.489218 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19579276-5acd-45f4-870d-2bcd000c20b6 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:24.489218 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19579276-5acd-45f4-870d-2bcd000c20b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:24.506844 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-19579276-5acd-45f4-870d-2bcd000c20b6 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:56:24.508044 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-19579276-5acd-45f4-870d-2bcd000c20b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:56:24.587755 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 611/1221] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:56:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 11:56:24.614166 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb9212-195c-4fa3-b008-e21cf2fb2ed0 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:24.737921 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb9212-195c-4fa3-b008-e21cf2fb2ed0 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:24.776418 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b218d-7322-48ea-94ac-8e62453f2dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:24.777227 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b218d-7322-48ea-94ac-8e62453f2dbe None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:24.777508 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b218d-7322-48ea-94ac-8e62453f2dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:24.777785 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b218d-7322-48ea-94ac-8e62453f2dbe None admin] PATH_INFO: `/v3/roles/service` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:24.789525 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4b218d-7322-48ea-94ac-8e62453f2dbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:56:24.798084 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-5a4b218d-7322-48ea-94ac-8e62453f2dbe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 11:56:24.798084 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:56:24.798084 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:56:24.798084 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:56:24.798084 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:56:24.798084 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:56:24.798084 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:56:24.798084 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:56:24.798084 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:56:24.798084 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:56:24.798084 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:56:24.798084 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:56:24.798084 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:56:24.798084 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:56:24.798084 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:56:24.798084 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:56:24.799033 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:56:24.799033 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:56:24.799033 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:56:24.799033 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:56:24.799033 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:56:24.799033 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:56:24.799033 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:56:24.799033 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:56:24.799033 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:56:24.799033 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:56:24.799033 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:56:24.799033 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:56:24.799033 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:56:24.799033 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:56:24.799033 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:56:24.799033 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:56:24.800972 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:56:24.800972 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:56:24.800972 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:56:24.800972 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:56:24.800972 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:56:24.800972 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:56:24.800972 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:56:24.800972 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:56:24.800972 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:56:24.800972 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:56:24.800972 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 11:56:24.800972 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:56:24.800972 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 611/1222] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Jun 8 11:56:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:56:24.805291 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19579276-5acd-45f4-870d-2bcd000c20b6 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:24.919694 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19579276-5acd-45f4-870d-2bcd000c20b6 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:24.944641 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:24.956921 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7ee2ef-ce37-440c-b302-a17e15072537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:24.957596 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ee2ef-ce37-440c-b302-a17e15072537 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:24.957874 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ee2ef-ce37-440c-b302-a17e15072537 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:24.958147 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ee2ef-ce37-440c-b302-a17e15072537 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:24.958906 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7ee2ef-ce37-440c-b302-a17e15072537 None admin] RBAC: Adding query filter params (name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:56:24.959191 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7ee2ef-ce37-440c-b302-a17e15072537 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:24.960633 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7ee2ef-ce37-440c-b302-a17e15072537 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:24.970691 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 612/1223] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Jun 8 11:56:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:56:24.976436 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b218d-7322-48ea-94ac-8e62453f2dbe None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:25.023130 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:25.090957 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b218d-7322-48ea-94ac-8e62453f2dbe None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:25.131400 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa09d4b-2367-4a18-b70b-90b6d5c5fb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:25.132238 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa09d4b-2367-4a18-b70b-90b6d5c5fb66 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:25.132525 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa09d4b-2367-4a18-b70b-90b6d5c5fb66 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:25.132800 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa09d4b-2367-4a18-b70b-90b6d5c5fb66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:25.143987 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa09d4b-2367-4a18-b70b-90b6d5c5fb66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:25.145481 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa09d4b-2367-4a18-b70b-90b6d5c5fb66 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:25.163357 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-4fa09d4b-2367-4a18-b70b-90b6d5c5fb66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:56:25.163357 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:56:25.163357 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:56:25.163357 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:56:25.163357 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:56:25.163357 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:56:25.163357 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:56:25.163357 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:56:25.163357 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:56:25.163357 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:56:25.163357 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:56:25.163357 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:56:25.163357 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:56:25.163357 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:56:25.163357 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:56:25.164449 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:56:25.164449 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:56:25.164449 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:56:25.164449 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:56:25.164449 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:56:25.164449 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:56:25.164449 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:56:25.164449 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:56:25.164449 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:56:25.164449 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:56:25.164449 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:56:25.164449 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:56:25.164449 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:56:25.164449 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:56:25.164449 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:56:25.164449 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:56:25.164449 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:56:25.165361 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:56:25.165361 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:56:25.165361 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:56:25.165361 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:56:25.165361 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 612/1224] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:56:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:56:25.172101 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7ee2ef-ce37-440c-b302-a17e15072537 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:25.296082 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7ee2ef-ce37-440c-b302-a17e15072537 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:25.333234 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77316d11-74d8-431c-89ee-191c3221bab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:25.333856 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77316d11-74d8-431c-89ee-191c3221bab2 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:25.334224 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77316d11-74d8-431c-89ee-191c3221bab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:25.334489 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77316d11-74d8-431c-89ee-191c3221bab2 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:25.335255 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77316d11-74d8-431c-89ee-191c3221bab2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:56:25.335543 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77316d11-74d8-431c-89ee-191c3221bab2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:25.336940 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77316d11-74d8-431c-89ee-191c3221bab2 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:25.351125 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 613/1225] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:56:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:56:25.356971 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa09d4b-2367-4a18-b70b-90b6d5c5fb66 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:25.466361 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:25.476096 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa09d4b-2367-4a18-b70b-90b6d5c5fb66 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:25.516577 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e2f266-a104-42da-a3e0-343972096c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:25.518116 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2f266-a104-42da-a3e0-343972096c43 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:25.518421 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2f266-a104-42da-a3e0-343972096c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:25.518692 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2f266-a104-42da-a3e0-343972096c43 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:25.526788 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e2f266-a104-42da-a3e0-343972096c43 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:25.528270 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e2f266-a104-42da-a3e0-343972096c43 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:25.543560 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-01e2f266-a104-42da-a3e0-343972096c43 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 08 11:56:25.543560 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:56:25.543560 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:56:25.543560 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:56:25.543560 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:56:25.543560 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:56:25.543560 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:56:25.543560 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:56:25.543560 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:56:25.543560 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:56:25.543560 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:56:25.543560 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:56:25.543560 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 11:56:25.543560 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 11:56:25.543560 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 11:56:25.543560 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 11:56:25.544914 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:56:25.544914 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:56:25.544914 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 11:56:25.544914 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:56:25.544914 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 11:56:25.544914 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:56:25.544914 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:56:25.544914 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:56:25.544914 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:56:25.544914 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:56:25.544914 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:56:25.544914 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:56:25.544914 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:56:25.544914 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:56:25.544914 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:56:25.544914 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:56:25.544914 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:56:25.544914 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:56:25.546188 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:56:25.546188 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:56:25.546188 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 11:56:25.546188 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 11:56:25.546188 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 11:56:25.546188 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 11:56:25.546188 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 11:56:25.546188 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 11:56:25.546188 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 08 11:56:25.546188 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:56:25.547850 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 613/1226] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:56:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 11:56:25.553414 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77316d11-74d8-431c-89ee-191c3221bab2 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:25.610062 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:25.671285 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77316d11-74d8-431c-89ee-191c3221bab2 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:25.711155 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f54cef-4006-407c-be1c-19b75db7e64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:25.711874 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f54cef-4006-407c-be1c-19b75db7e64c None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:25.712156 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f54cef-4006-407c-be1c-19b75db7e64c None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:25.712504 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f54cef-4006-407c-be1c-19b75db7e64c None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:25.713361 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f54cef-4006-407c-be1c-19b75db7e64c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:56:25.713669 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f54cef-4006-407c-be1c-19b75db7e64c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:25.715326 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f54cef-4006-407c-be1c-19b75db7e64c None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:25.742296 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 614/1227] 10.222.0.39 () {56 vars in 1143 bytes} [Wed Jun 8 11:56:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:56:25.743889 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e2f266-a104-42da-a3e0-343972096c43 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:25.878387 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e2f266-a104-42da-a3e0-343972096c43 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:25.914891 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10479f84-365d-4d19-ad74-d1baa89aa1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:25.915689 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10479f84-365d-4d19-ad74-d1baa89aa1d8 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:25.915973 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10479f84-365d-4d19-ad74-d1baa89aa1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:25.916279 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10479f84-365d-4d19-ad74-d1baa89aa1d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:25.929213 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10479f84-365d-4d19-ad74-d1baa89aa1d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:25.930728 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10479f84-365d-4d19-ad74-d1baa89aa1d8 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:25.951122 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-10479f84-365d-4d19-ad74-d1baa89aa1d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:56:25.951122 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:56:25.951122 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:56:25.951122 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:56:25.951122 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:56:25.951122 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:56:25.951122 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:56:25.951122 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:56:25.951122 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:56:25.951122 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:56:25.951122 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:56:25.951122 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:56:25.951122 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:56:25.951122 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:56:25.951122 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:56:25.952424 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:56:25.952424 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:56:25.952424 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:56:25.952424 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:56:25.952424 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:56:25.952424 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:56:25.952424 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:56:25.952424 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:56:25.952424 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:56:25.952424 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:56:25.952424 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:56:25.952424 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:56:25.952424 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:56:25.952424 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:56:25.952424 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:56:25.952424 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:56:25.952424 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:56:25.953863 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:56:25.953863 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:56:25.953863 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:56:25.953863 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:56:25.953863 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 614/1228] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:56:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:56:25.960276 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f54cef-4006-407c-be1c-19b75db7e64c None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:26.069078 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f54cef-4006-407c-be1c-19b75db7e64c None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:26.071470 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:26.105158 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5977b-08f0-4317-81f8-f91924962f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:26.105818 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5977b-08f0-4317-81f8-f91924962f2d None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:26.106103 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5977b-08f0-4317-81f8-f91924962f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:26.106404 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5977b-08f0-4317-81f8-f91924962f2d None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:26.107109 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c5977b-08f0-4317-81f8-f91924962f2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:56:26.107417 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c5977b-08f0-4317-81f8-f91924962f2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:26.108936 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c5977b-08f0-4317-81f8-f91924962f2d None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:26.120794 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 615/1229] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:56:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:56:26.127442 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10479f84-365d-4d19-ad74-d1baa89aa1d8 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:26.140372 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:26.244457 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10479f84-365d-4d19-ad74-d1baa89aa1d8 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:26.284460 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356af472-2393-42fb-aed8-e96f0064f423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:26.285292 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356af472-2393-42fb-aed8-e96f0064f423 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:26.285548 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356af472-2393-42fb-aed8-e96f0064f423 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:26.285831 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356af472-2393-42fb-aed8-e96f0064f423 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:26.292833 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356af472-2393-42fb-aed8-e96f0064f423 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:26.294261 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356af472-2393-42fb-aed8-e96f0064f423 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:26.308467 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-356af472-2393-42fb-aed8-e96f0064f423 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:56:26.308467 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:56:26.308467 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:56:26.308467 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:56:26.308467 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:56:26.308467 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:56:26.308467 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:56:26.308467 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:56:26.308467 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:56:26.308467 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:56:26.308467 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:56:26.308467 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:56:26.308467 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 11:56:26.308467 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 11:56:26.308467 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 11:56:26.309608 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 11:56:26.309608 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:56:26.309608 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:56:26.309608 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:56:26.309608 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:56:26.309608 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:56:26.309608 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:56:26.309608 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:56:26.309608 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:56:26.309608 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:56:26.309608 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:56:26.309608 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:56:26.309608 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:56:26.309608 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:56:26.309608 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:56:26.309608 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:56:26.309608 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:56:26.310857 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 11:56:26.310857 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 11:56:26.310857 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 11:56:26.310857 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 11:56:26.310857 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 11:56:26.310857 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 11:56:26.310857 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:56:26.310857 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:56:26.310857 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 615/1230] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Jun 8 11:56:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:56:26.315888 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5977b-08f0-4317-81f8-f91924962f2d None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:26.429455 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5977b-08f0-4317-81f8-f91924962f2d None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:26.464744 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab4f39-1dc3-4edf-90e1-cde5a1561d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:26.465409 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab4f39-1dc3-4edf-90e1-cde5a1561d1f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:26.465766 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab4f39-1dc3-4edf-90e1-cde5a1561d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:26.466041 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab4f39-1dc3-4edf-90e1-cde5a1561d1f None admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:26.466819 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab4f39-1dc3-4edf-90e1-cde5a1561d1f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:56:26.467222 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab4f39-1dc3-4edf-90e1-cde5a1561d1f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:26.469066 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab4f39-1dc3-4edf-90e1-cde5a1561d1f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:26.481980 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 616/1231] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Jun 8 11:56:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:56:26.488695 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356af472-2393-42fb-aed8-e96f0064f423 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:26.558679 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:26.600379 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356af472-2393-42fb-aed8-e96f0064f423 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:26.636585 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672990cb-3663-47aa-939f-1497129822df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:26.637493 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672990cb-3663-47aa-939f-1497129822df None admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:26.637776 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672990cb-3663-47aa-939f-1497129822df None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:26.638051 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672990cb-3663-47aa-939f-1497129822df None admin] PATH_INFO: `/v3/projects/6a7fee684e8b43e199c95aeeb92640d4/users/e9009560a846414b849d42efa8625ff5/roles/125b7374688b4b009d443f1b34947c49` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:26.653437 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672990cb-3663-47aa-939f-1497129822df None admin] RBAC: Authorizing `identity:create_grant(project_id=6a7fee684e8b43e199c95aeeb92640d4, user_id=e9009560a846414b849d42efa8625ff5, role_id=125b7374688b4b009d443f1b34947c49)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:26.655555 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672990cb-3663-47aa-939f-1497129822df None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:26.669262 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 616/1232] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Jun 8 11:56:26 2022] PUT /identity/v3/projects/6a7fee684e8b43e199c95aeeb92640d4/users/e9009560a846414b849d42efa8625ff5/roles/125b7374688b4b009d443f1b34947c49 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 11:56:29.075479 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b7607-fdaf-4365-b823-e3b3e3967e4b None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:29.075991 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b7607-fdaf-4365-b823-e3b3e3967e4b None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:29.075991 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b7607-fdaf-4365-b823-e3b3e3967e4b None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:29.077737 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 617/1233] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:56:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:56:29.083589 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff865a-90f1-4f1f-acd7-71018dc3b173 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:29.084027 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff865a-90f1-4f1f-acd7-71018dc3b173 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:29.084190 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff865a-90f1-4f1f-acd7-71018dc3b173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:29.103843 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-4cff865a-90f1-4f1f-acd7-71018dc3b173 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:56:29.105083 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-4cff865a-90f1-4f1f-acd7-71018dc3b173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:56:29.176688 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 617/1234] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:56:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 11:56:29.201174 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b7607-fdaf-4365-b823-e3b3e3967e4b None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:29.229653 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:29.318705 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b7607-fdaf-4365-b823-e3b3e3967e4b None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:29.360092 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a47e479-01c2-46e4-9325-9cf6dbefd88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:29.360945 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47e479-01c2-46e4-9325-9cf6dbefd88b None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:29.361283 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47e479-01c2-46e4-9325-9cf6dbefd88b None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:29.361611 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47e479-01c2-46e4-9325-9cf6dbefd88b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:29.374957 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a47e479-01c2-46e4-9325-9cf6dbefd88b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:56:29.384206 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-3a47e479-01c2-46e4-9325-9cf6dbefd88b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 08 11:56:29.384206 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:56:29.384206 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:56:29.384206 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:56:29.384206 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:56:29.384206 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:56:29.384206 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:56:29.384206 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:56:29.384206 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:56:29.384206 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:56:29.384206 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:56:29.384206 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:56:29.384206 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:56:29.384206 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:56:29.384206 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:56:29.384206 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:56:29.385566 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:56:29.385566 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:56:29.385566 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:56:29.385566 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:56:29.385566 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:56:29.385566 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:56:29.385566 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:56:29.385566 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:56:29.385566 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:56:29.385566 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:56:29.385566 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:56:29.385566 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:56:29.385566 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:56:29.385566 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:56:29.385566 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:56:29.385566 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:56:29.386606 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:56:29.386606 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:56:29.386606 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:56:29.386606 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:56:29.386606 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:56:29.386606 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:56:29.386606 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:56:29.386606 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:56:29.386606 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:56:29.386606 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:56:29.386606 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 08 11:56:29.386606 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:56:29.386606 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 618/1235] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Jun 8 11:56:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:56:29.392123 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cff865a-90f1-4f1f-acd7-71018dc3b173 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:29.443828 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:29.500618 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cff865a-90f1-4f1f-acd7-71018dc3b173 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:29.536309 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac6cfdb-b130-488f-ace3-6e9e7fb33beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:29.536991 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6cfdb-b130-488f-ace3-6e9e7fb33beb None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:29.537272 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6cfdb-b130-488f-ace3-6e9e7fb33beb None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:29.537548 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6cfdb-b130-488f-ace3-6e9e7fb33beb None admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:29.538297 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac6cfdb-b130-488f-ace3-6e9e7fb33beb None admin] RBAC: Adding query filter params (name=service) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:56:29.538608 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac6cfdb-b130-488f-ace3-6e9e7fb33beb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:29.539991 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac6cfdb-b130-488f-ace3-6e9e7fb33beb None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:29.550498 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 618/1236] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Jun 8 11:56:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:56:29.556004 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a47e479-01c2-46e4-9325-9cf6dbefd88b None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:29.655093 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:29.674100 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a47e479-01c2-46e4-9325-9cf6dbefd88b None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:29.714227 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab6948-e327-4900-a187-b78320806e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:29.715027 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab6948-e327-4900-a187-b78320806e71 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:29.715333 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab6948-e327-4900-a187-b78320806e71 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:29.715670 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab6948-e327-4900-a187-b78320806e71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:29.727747 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ab6948-e327-4900-a187-b78320806e71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:29.729229 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ab6948-e327-4900-a187-b78320806e71 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:29.746937 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-b4ab6948-e327-4900-a187-b78320806e71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:56:29.746937 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:56:29.746937 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:56:29.746937 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:56:29.746937 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:56:29.746937 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:56:29.746937 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:56:29.746937 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:56:29.746937 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:56:29.746937 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:56:29.746937 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:56:29.746937 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:56:29.746937 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:56:29.746937 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:56:29.746937 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:56:29.748059 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:56:29.748059 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:56:29.748059 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:56:29.748059 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:56:29.748059 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:56:29.748059 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:56:29.748059 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:56:29.748059 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:56:29.748059 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:56:29.748059 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:56:29.748059 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:56:29.748059 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:56:29.748059 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:56:29.748059 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:56:29.748059 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:56:29.748059 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:56:29.748059 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:56:29.750347 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:56:29.750347 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:56:29.750347 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:56:29.750347 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:56:29.750347 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 619/1237] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:56:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:56:29.754808 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac6cfdb-b130-488f-ace3-6e9e7fb33beb None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:29.861551 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac6cfdb-b130-488f-ace3-6e9e7fb33beb None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:29.871137 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:29.898690 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d02f6-f4dd-4a9f-be99-13f9d7ca43df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:29.899395 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d02f6-f4dd-4a9f-be99-13f9d7ca43df None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:29.899683 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d02f6-f4dd-4a9f-be99-13f9d7ca43df None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:29.899962 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d02f6-f4dd-4a9f-be99-13f9d7ca43df None admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:29.900728 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321d02f6-f4dd-4a9f-be99-13f9d7ca43df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:56:29.901039 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321d02f6-f4dd-4a9f-be99-13f9d7ca43df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:29.902415 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321d02f6-f4dd-4a9f-be99-13f9d7ca43df None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:29.915030 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 619/1238] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:56:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:56:29.921036 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab6948-e327-4900-a187-b78320806e71 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:30.026227 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab6948-e327-4900-a187-b78320806e71 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:30.062534 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760bb21a-0d18-45f7-a37e-cc266d3cc1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:30.063209 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760bb21a-0d18-45f7-a37e-cc266d3cc1e4 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:30.063479 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760bb21a-0d18-45f7-a37e-cc266d3cc1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:30.063756 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760bb21a-0d18-45f7-a37e-cc266d3cc1e4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:30.066846 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:30.072395 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760bb21a-0d18-45f7-a37e-cc266d3cc1e4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:30.074214 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760bb21a-0d18-45f7-a37e-cc266d3cc1e4 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:30.089331 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-760bb21a-0d18-45f7-a37e-cc266d3cc1e4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 08 11:56:30.089331 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:56:30.089331 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:56:30.089331 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:56:30.089331 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:56:30.089331 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:56:30.089331 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:56:30.089331 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:56:30.089331 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:56:30.089331 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:56:30.089331 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:56:30.089331 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:56:30.089331 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 11:56:30.089331 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 11:56:30.089331 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 11:56:30.089331 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 11:56:30.091040 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:56:30.091040 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:56:30.091040 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 11:56:30.091040 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:56:30.091040 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 11:56:30.091040 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:56:30.091040 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:56:30.091040 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:56:30.091040 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:56:30.091040 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:56:30.091040 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:56:30.091040 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:56:30.091040 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:56:30.091040 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:56:30.091040 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:56:30.091040 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:56:30.091040 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:56:30.091040 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:56:30.092072 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:56:30.092072 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:56:30.092072 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 11:56:30.092072 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 11:56:30.092072 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 11:56:30.092072 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 11:56:30.092072 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 11:56:30.092072 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 11:56:30.092072 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 08 11:56:30.092072 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:56:30.092072 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 620/1239] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:56:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:56:30.097700 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d02f6-f4dd-4a9f-be99-13f9d7ca43df None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:30.209617 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d02f6-f4dd-4a9f-be99-13f9d7ca43df None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:30.247438 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92dc147-5bd4-4ee0-9223-c2b8e3d2bee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:30.249743 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92dc147-5bd4-4ee0-9223-c2b8e3d2bee5 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:30.250104 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92dc147-5bd4-4ee0-9223-c2b8e3d2bee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:30.250494 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92dc147-5bd4-4ee0-9223-c2b8e3d2bee5 None admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:30.251365 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92dc147-5bd4-4ee0-9223-c2b8e3d2bee5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:56:30.251679 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92dc147-5bd4-4ee0-9223-c2b8e3d2bee5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:30.253437 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92dc147-5bd4-4ee0-9223-c2b8e3d2bee5 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:30.275354 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 620/1240] 10.222.0.39 () {56 vars in 1143 bytes} [Wed Jun 8 11:56:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:56:30.284147 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760bb21a-0d18-45f7-a37e-cc266d3cc1e4 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:30.393505 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760bb21a-0d18-45f7-a37e-cc266d3cc1e4 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:30.438191 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aabf14a-f157-4ea6-8c61-e7c317c5beaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:30.439086 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabf14a-f157-4ea6-8c61-e7c317c5beaf None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:30.439374 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabf14a-f157-4ea6-8c61-e7c317c5beaf None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:30.439654 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabf14a-f157-4ea6-8c61-e7c317c5beaf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:30.514726 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:30.523483 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aabf14a-f157-4ea6-8c61-e7c317c5beaf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:30.525123 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aabf14a-f157-4ea6-8c61-e7c317c5beaf None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:30.647095 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 621/1241] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:56:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 11:56:30.657257 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92dc147-5bd4-4ee0-9223-c2b8e3d2bee5 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:30.689892 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:30.776128 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92dc147-5bd4-4ee0-9223-c2b8e3d2bee5 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:30.820611 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b42684-d337-4e29-99a1-87f9f1522dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:30.821804 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b42684-d337-4e29-99a1-87f9f1522dc5 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:30.822329 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b42684-d337-4e29-99a1-87f9f1522dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:30.822613 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b42684-d337-4e29-99a1-87f9f1522dc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:30.836709 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b42684-d337-4e29-99a1-87f9f1522dc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:30.838186 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b42684-d337-4e29-99a1-87f9f1522dc5 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:30.859271 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-a4b42684-d337-4e29-99a1-87f9f1522dc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:56:30.859271 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:56:30.859271 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:56:30.859271 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:56:30.859271 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:56:30.859271 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:56:30.859271 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:56:30.859271 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:56:30.859271 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:56:30.859271 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:56:30.859271 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:56:30.859271 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:56:30.859271 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:56:30.859271 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:56:30.859271 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:56:30.862312 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:56:30.862312 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:56:30.862312 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:56:30.862312 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:56:30.862312 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:56:30.862312 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:56:30.862312 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:56:30.862312 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:56:30.862312 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:56:30.862312 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:56:30.862312 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:56:30.862312 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:56:30.862312 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:56:30.862312 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:56:30.862312 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:56:30.862312 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:56:30.862312 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:56:30.863558 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:56:30.863558 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:56:30.863558 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:56:30.863558 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:56:30.863558 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 621/1242] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:56:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:56:30.869119 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aabf14a-f157-4ea6-8c61-e7c317c5beaf None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:30.977018 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:30.983502 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aabf14a-f157-4ea6-8c61-e7c317c5beaf None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:31.022516 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43847575-e1ef-4a43-9079-f5269e5ad90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:31.023215 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43847575-e1ef-4a43-9079-f5269e5ad90e None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:31.023499 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43847575-e1ef-4a43-9079-f5269e5ad90e None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:31.023774 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43847575-e1ef-4a43-9079-f5269e5ad90e None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:31.024531 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43847575-e1ef-4a43-9079-f5269e5ad90e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:56:31.024839 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43847575-e1ef-4a43-9079-f5269e5ad90e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:31.026286 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43847575-e1ef-4a43-9079-f5269e5ad90e None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:31.040005 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 622/1243] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:56:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:56:31.046840 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b42684-d337-4e29-99a1-87f9f1522dc5 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:31.128706 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:31.153867 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b42684-d337-4e29-99a1-87f9f1522dc5 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:31.197128 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f19828-3ff0-41a7-bce6-3e1784a05ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:31.198063 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f19828-3ff0-41a7-bce6-3e1784a05ae8 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:31.198369 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f19828-3ff0-41a7-bce6-3e1784a05ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:31.198679 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f19828-3ff0-41a7-bce6-3e1784a05ae8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:31.207748 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f19828-3ff0-41a7-bce6-3e1784a05ae8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:31.209367 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f19828-3ff0-41a7-bce6-3e1784a05ae8 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:31.225773 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-06f19828-3ff0-41a7-bce6-3e1784a05ae8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:56:31.225773 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:56:31.225773 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:56:31.225773 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:56:31.225773 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:56:31.225773 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:56:31.225773 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:56:31.225773 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:56:31.225773 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:56:31.225773 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:56:31.225773 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:56:31.225773 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:56:31.225773 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 11:56:31.225773 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 11:56:31.225773 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 11:56:31.227142 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 11:56:31.227142 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:56:31.227142 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:56:31.227142 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:56:31.227142 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:56:31.227142 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:56:31.227142 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:56:31.227142 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:56:31.227142 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:56:31.227142 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:56:31.227142 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:56:31.227142 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:56:31.227142 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:56:31.227142 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:56:31.227142 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:56:31.227142 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:56:31.227142 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:56:31.228056 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 11:56:31.228056 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 11:56:31.228056 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 11:56:31.228056 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 11:56:31.228056 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 11:56:31.228056 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 11:56:31.228056 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:56:31.228056 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:56:31.228056 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 622/1244] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Jun 8 11:56:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 11:56:31.234108 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43847575-e1ef-4a43-9079-f5269e5ad90e None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:31.352027 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43847575-e1ef-4a43-9079-f5269e5ad90e None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:31.394441 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1e314a-8ed0-4197-b702-a34655999b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:31.395594 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e314a-8ed0-4197-b702-a34655999b22 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:31.395963 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e314a-8ed0-4197-b702-a34655999b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:31.396311 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e314a-8ed0-4197-b702-a34655999b22 None admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:31.397266 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1e314a-8ed0-4197-b702-a34655999b22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:56:31.397658 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1e314a-8ed0-4197-b702-a34655999b22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:31.399367 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1e314a-8ed0-4197-b702-a34655999b22 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:31.414586 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 623/1245] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Jun 8 11:56:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:56:31.421707 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f19828-3ff0-41a7-bce6-3e1784a05ae8 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:31.541703 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f19828-3ff0-41a7-bce6-3e1784a05ae8 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:31.592413 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d0859-e056-4bd3-99bc-a600c03e8b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:31.593197 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d0859-e056-4bd3-99bc-a600c03e8b2c None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:31.593526 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d0859-e056-4bd3-99bc-a600c03e8b2c None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:31.594086 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d0859-e056-4bd3-99bc-a600c03e8b2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:31.595219 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0d0859-e056-4bd3-99bc-a600c03e8b2c None admin] RBAC: Adding query filter params (role.id=125b7374688b4b009d443f1b34947c49, scope.project.id=6a7fee684e8b43e199c95aeeb92640d4, user.id=e9009560a846414b849d42efa8625ff5) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:56:31.595645 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0d0859-e056-4bd3-99bc-a600c03e8b2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:31.597643 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0d0859-e056-4bd3-99bc-a600c03e8b2c None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:31.605298 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 623/1246] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Jun 8 11:56:31 2022] GET /identity/v3/role_assignments?user.id=e9009560a846414b849d42efa8625ff5&scope.project.id=6a7fee684e8b43e199c95aeeb92640d4&role.id=125b7374688b4b009d443f1b34947c49 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:56:34.387268 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bfa9cc-a8a0-420d-a2d1-f3bd430318ef None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:34.387880 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bfa9cc-a8a0-420d-a2d1-f3bd430318ef None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:34.388193 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bfa9cc-a8a0-420d-a2d1-f3bd430318ef None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:34.390755 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 624/1247] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:56:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:56:34.398855 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a761b4-88a7-4133-9ef7-8360e48ce88f None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:34.398855 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a761b4-88a7-4133-9ef7-8360e48ce88f None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:34.398855 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a761b4-88a7-4133-9ef7-8360e48ce88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:34.403818 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:34.417336 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-93a761b4-88a7-4133-9ef7-8360e48ce88f None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:56:34.418607 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-93a761b4-88a7-4133-9ef7-8360e48ce88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:56:34.496789 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 624/1248] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:56:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 11:56:34.522637 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bfa9cc-a8a0-420d-a2d1-f3bd430318ef None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:34.546177 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:34.647217 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bfa9cc-a8a0-420d-a2d1-f3bd430318ef None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:34.687832 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e8b9d-167e-4817-8df8-015668b16f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:34.688651 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e8b9d-167e-4817-8df8-015668b16f84 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:34.688953 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e8b9d-167e-4817-8df8-015668b16f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:34.689233 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e8b9d-167e-4817-8df8-015668b16f84 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:34.700812 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049e8b9d-167e-4817-8df8-015668b16f84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:56:34.708794 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-049e8b9d-167e-4817-8df8-015668b16f84 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:56:34.708794 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:56:34.708794 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:56:34.708794 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:56:34.708794 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:56:34.708794 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:56:34.708794 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:56:34.708794 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:56:34.708794 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:56:34.708794 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:56:34.708794 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:56:34.708794 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:56:34.708794 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:56:34.708794 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:56:34.708794 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:56:34.708794 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:56:34.710296 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:56:34.710296 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:56:34.710296 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:56:34.710296 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:56:34.710296 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:56:34.710296 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:56:34.710296 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:56:34.710296 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:56:34.710296 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:56:34.710296 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:56:34.710296 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:56:34.710296 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:56:34.710296 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:56:34.710296 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:56:34.710296 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:56:34.710296 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:56:34.711393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:56:34.711393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:56:34.711393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:56:34.711393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:56:34.711393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:56:34.711393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:56:34.711393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:56:34.711393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:56:34.711393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:56:34.711393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:56:34.711393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:56:34.711393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:56:34.711393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 625/1249] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Jun 8 11:56:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:56:34.716057 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a761b4-88a7-4133-9ef7-8360e48ce88f None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:34.832823 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a761b4-88a7-4133-9ef7-8360e48ce88f None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:34.865542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:34.872911 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f866c3-a7dd-4064-aacd-043eb1257e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:34.873592 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f866c3-a7dd-4064-aacd-043eb1257e35 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:34.873873 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f866c3-a7dd-4064-aacd-043eb1257e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:34.874150 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f866c3-a7dd-4064-aacd-043eb1257e35 None admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:34.875013 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f866c3-a7dd-4064-aacd-043eb1257e35 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:56:34.875382 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f866c3-a7dd-4064-aacd-043eb1257e35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:34.876892 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f866c3-a7dd-4064-aacd-043eb1257e35 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:34.886403 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 625/1250] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:56:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:56:34.892841 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e8b9d-167e-4817-8df8-015668b16f84 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:34.983374 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:35.008635 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e8b9d-167e-4817-8df8-015668b16f84 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:35.048319 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222f850-45c2-4edf-91b9-15f3ae047df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:35.049074 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222f850-45c2-4edf-91b9-15f3ae047df9 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:35.049363 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222f850-45c2-4edf-91b9-15f3ae047df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:35.049638 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222f850-45c2-4edf-91b9-15f3ae047df9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:35.061856 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f222f850-45c2-4edf-91b9-15f3ae047df9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:35.063618 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f222f850-45c2-4edf-91b9-15f3ae047df9 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:35.082759 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-f222f850-45c2-4edf-91b9-15f3ae047df9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:56:35.082759 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:56:35.082759 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:56:35.082759 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:56:35.082759 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:56:35.082759 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:56:35.082759 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:56:35.082759 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:56:35.082759 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:56:35.082759 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:56:35.082759 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:56:35.082759 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:56:35.082759 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:56:35.082759 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:56:35.082759 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:56:35.083836 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:56:35.083836 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:56:35.083836 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:56:35.083836 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:56:35.083836 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:56:35.083836 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:56:35.083836 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:56:35.083836 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:56:35.083836 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:56:35.083836 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:56:35.083836 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:56:35.083836 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:56:35.083836 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:56:35.083836 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:56:35.083836 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:56:35.083836 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:56:35.083836 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:56:35.090692 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:56:35.090692 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:56:35.090692 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:56:35.090692 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:56:35.090692 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 626/1251] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:56:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 11:56:35.092268 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f866c3-a7dd-4064-aacd-043eb1257e35 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:35.203357 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f866c3-a7dd-4064-aacd-043eb1257e35 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:35.245387 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e44f0-f539-426d-8e47-ea140e61afbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:35.246050 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e44f0-f539-426d-8e47-ea140e61afbc None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:35.246337 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e44f0-f539-426d-8e47-ea140e61afbc None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:35.246610 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e44f0-f539-426d-8e47-ea140e61afbc None admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:35.247540 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9e44f0-f539-426d-8e47-ea140e61afbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:56:35.247842 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9e44f0-f539-426d-8e47-ea140e61afbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:35.250280 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9e44f0-f539-426d-8e47-ea140e61afbc None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:35.264493 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 626/1252] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:56:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:56:35.270635 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222f850-45c2-4edf-91b9-15f3ae047df9 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:35.384324 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222f850-45c2-4edf-91b9-15f3ae047df9 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:35.423379 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:35.433027 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ded27-d6c2-43c9-980d-1a279f73ce99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:35.434204 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ded27-d6c2-43c9-980d-1a279f73ce99 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:35.434494 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ded27-d6c2-43c9-980d-1a279f73ce99 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:35.434810 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ded27-d6c2-43c9-980d-1a279f73ce99 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:35.444705 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8ded27-d6c2-43c9-980d-1a279f73ce99 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:35.446547 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8ded27-d6c2-43c9-980d-1a279f73ce99 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:35.462449 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-1f8ded27-d6c2-43c9-980d-1a279f73ce99 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 08 11:56:35.462449 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:56:35.462449 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:56:35.462449 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:56:35.462449 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:56:35.462449 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:56:35.462449 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:56:35.462449 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:56:35.462449 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:56:35.462449 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:56:35.462449 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:56:35.462449 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:56:35.462449 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 11:56:35.462449 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 11:56:35.462449 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 11:56:35.462449 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 11:56:35.463452 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:56:35.463452 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:56:35.463452 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 11:56:35.463452 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:56:35.463452 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 11:56:35.463452 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:56:35.463452 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:56:35.463452 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:56:35.463452 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:56:35.463452 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:56:35.463452 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:56:35.463452 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:56:35.463452 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:56:35.463452 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:56:35.463452 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:56:35.463452 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:56:35.463452 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:56:35.463452 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:56:35.464650 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:56:35.464650 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:56:35.464650 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 11:56:35.464650 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 11:56:35.464650 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 11:56:35.464650 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 11:56:35.464650 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 11:56:35.464650 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 11:56:35.464650 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 08 11:56:35.464650 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:56:35.464650 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 627/1253] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:56:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:56:35.470215 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e44f0-f539-426d-8e47-ea140e61afbc None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:35.533551 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:35.594025 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e44f0-f539-426d-8e47-ea140e61afbc None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:35.637171 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f99023-47db-4054-8f2e-32bf86858572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:35.637947 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f99023-47db-4054-8f2e-32bf86858572 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:35.638232 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f99023-47db-4054-8f2e-32bf86858572 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:35.639056 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f99023-47db-4054-8f2e-32bf86858572 None admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:35.639594 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f99023-47db-4054-8f2e-32bf86858572 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:56:35.639909 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f99023-47db-4054-8f2e-32bf86858572 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:35.641439 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f99023-47db-4054-8f2e-32bf86858572 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:35.660488 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 627/1254] 10.222.0.39 () {56 vars in 1143 bytes} [Wed Jun 8 11:56:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:56:35.666189 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ded27-d6c2-43c9-980d-1a279f73ce99 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:35.779651 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ded27-d6c2-43c9-980d-1a279f73ce99 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:35.816833 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f41e88-8f2f-4708-8f7b-8574c5e573a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:35.817409 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f41e88-8f2f-4708-8f7b-8574c5e573a0 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:35.817692 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f41e88-8f2f-4708-8f7b-8574c5e573a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:35.817965 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f41e88-8f2f-4708-8f7b-8574c5e573a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:35.882456 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:35.901768 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f41e88-8f2f-4708-8f7b-8574c5e573a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:35.903270 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f41e88-8f2f-4708-8f7b-8574c5e573a0 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:36.012627 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 628/1255] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:56:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 08 11:56:36.019039 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f99023-47db-4054-8f2e-32bf86858572 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:36.124813 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f99023-47db-4054-8f2e-32bf86858572 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:36.139056 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:36.161600 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c923439-7e5c-4493-a979-d0e6204f49a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:36.162389 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c923439-7e5c-4493-a979-d0e6204f49a0 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:36.162683 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c923439-7e5c-4493-a979-d0e6204f49a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:36.162944 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c923439-7e5c-4493-a979-d0e6204f49a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:36.177436 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c923439-7e5c-4493-a979-d0e6204f49a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:36.178908 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c923439-7e5c-4493-a979-d0e6204f49a0 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:36.198497 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-5c923439-7e5c-4493-a979-d0e6204f49a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:56:36.198497 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:56:36.198497 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:56:36.198497 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:56:36.198497 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:56:36.198497 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:56:36.198497 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:56:36.198497 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:56:36.198497 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:56:36.198497 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:56:36.198497 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:56:36.198497 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:56:36.198497 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:56:36.198497 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:56:36.198497 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:56:36.200003 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:56:36.200003 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:56:36.200003 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:56:36.200003 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:56:36.200003 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:56:36.200003 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:56:36.200003 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:56:36.200003 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:56:36.200003 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:56:36.200003 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:56:36.200003 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:56:36.200003 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:56:36.200003 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:56:36.200003 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:56:36.200003 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:56:36.200003 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:56:36.200003 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:56:36.201867 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:56:36.201867 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:56:36.201867 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:56:36.201867 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:56:36.201867 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 628/1256] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:56:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 11:56:36.206549 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f41e88-8f2f-4708-8f7b-8574c5e573a0 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:36.308571 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:36.323286 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f41e88-8f2f-4708-8f7b-8574c5e573a0 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:36.362997 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a35b8-830a-4c01-bdb1-a44d72c6d1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:36.363828 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a35b8-830a-4c01-bdb1-a44d72c6d1d7 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:36.364199 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a35b8-830a-4c01-bdb1-a44d72c6d1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:36.364552 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a35b8-830a-4c01-bdb1-a44d72c6d1d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:36.365594 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79a35b8-830a-4c01-bdb1-a44d72c6d1d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:56:36.366080 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79a35b8-830a-4c01-bdb1-a44d72c6d1d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:36.368585 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79a35b8-830a-4c01-bdb1-a44d72c6d1d7 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:36.387461 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 629/1257] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:56:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:56:36.393906 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c923439-7e5c-4493-a979-d0e6204f49a0 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:36.510367 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c923439-7e5c-4493-a979-d0e6204f49a0 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:36.550040 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f93c7-52b5-4ca5-8d27-78592153c97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:36.550983 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f93c7-52b5-4ca5-8d27-78592153c97d None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:36.551267 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f93c7-52b5-4ca5-8d27-78592153c97d None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:36.551539 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f93c7-52b5-4ca5-8d27-78592153c97d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:36.559313 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f93c7-52b5-4ca5-8d27-78592153c97d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:36.560847 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f93c7-52b5-4ca5-8d27-78592153c97d None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:36.576625 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-1d5f93c7-52b5-4ca5-8d27-78592153c97d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:56:36.576625 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:56:36.576625 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:56:36.576625 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:56:36.576625 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:56:36.576625 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:56:36.576625 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:56:36.576625 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:56:36.576625 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:56:36.576625 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:56:36.576625 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:56:36.576625 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:56:36.576625 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 11:56:36.576625 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 11:56:36.576625 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 11:56:36.577911 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 11:56:36.577911 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:56:36.577911 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:56:36.577911 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:56:36.577911 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:56:36.577911 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:56:36.577911 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:56:36.577911 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:56:36.577911 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:56:36.577911 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:56:36.577911 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:56:36.577911 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:56:36.577911 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:56:36.577911 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:56:36.577911 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:56:36.577911 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:56:36.577911 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:56:36.578834 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 11:56:36.578834 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 11:56:36.578834 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 11:56:36.578834 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 11:56:36.578834 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 11:56:36.578834 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 11:56:36.578834 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:56:36.578834 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:56:36.578834 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 629/1258] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Jun 8 11:56:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:56:36.584007 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a35b8-830a-4c01-bdb1-a44d72c6d1d7 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:36.693921 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a35b8-830a-4c01-bdb1-a44d72c6d1d7 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:36.729521 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386de554-37d1-4bf0-bc30-bc866c915ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:36.730198 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386de554-37d1-4bf0-bc30-bc866c915ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:36.730484 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386de554-37d1-4bf0-bc30-bc866c915ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:36.730760 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386de554-37d1-4bf0-bc30-bc866c915ff9 None admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:36.731558 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386de554-37d1-4bf0-bc30-bc866c915ff9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:56:36.731867 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386de554-37d1-4bf0-bc30-bc866c915ff9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:36.734214 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386de554-37d1-4bf0-bc30-bc866c915ff9 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:36.752664 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 630/1259] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Jun 8 11:56:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:56:36.754149 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f93c7-52b5-4ca5-8d27-78592153c97d None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:36.783790 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:36.865805 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f93c7-52b5-4ca5-8d27-78592153c97d None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:36.901201 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f9ce4-47fa-4bd3-aeb3-fa7940f6d9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:36.901874 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f9ce4-47fa-4bd3-aeb3-fa7940f6d9d0 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:36.902159 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f9ce4-47fa-4bd3-aeb3-fa7940f6d9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:36.902437 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f9ce4-47fa-4bd3-aeb3-fa7940f6d9d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:36.903287 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f9ce4-47fa-4bd3-aeb3-fa7940f6d9d0 None admin] RBAC: Adding query filter params (role.id=028d4429a4554bbb88b3aec9f6a9d937, scope.project.id=6a7fee684e8b43e199c95aeeb92640d4, user.id=e9009560a846414b849d42efa8625ff5) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:56:36.903594 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f9ce4-47fa-4bd3-aeb3-fa7940f6d9d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:36.905453 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f9ce4-47fa-4bd3-aeb3-fa7940f6d9d0 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:36.913041 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 630/1260] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Jun 8 11:56:36 2022] GET /identity/v3/role_assignments?user.id=e9009560a846414b849d42efa8625ff5&scope.project.id=6a7fee684e8b43e199c95aeeb92640d4&role.id=028d4429a4554bbb88b3aec9f6a9d937 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:56:39.175254 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410a5d5-dd19-444b-855a-d53cd4f44ef4 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:39.175816 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410a5d5-dd19-444b-855a-d53cd4f44ef4 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:39.175816 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410a5d5-dd19-444b-855a-d53cd4f44ef4 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:39.177227 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 631/1261] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:56:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:56:39.182255 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c21bd-276e-433b-82fb-2541e0336b69 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:39.182675 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c21bd-276e-433b-82fb-2541e0336b69 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:39.182815 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c21bd-276e-433b-82fb-2541e0336b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:39.199868 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-c90c21bd-276e-433b-82fb-2541e0336b69 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:56:39.201255 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-c90c21bd-276e-433b-82fb-2541e0336b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:56:39.265778 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 631/1262] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:56:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 11:56:39.288466 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c410a5d5-dd19-444b-855a-d53cd4f44ef4 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:39.299629 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:39.393952 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c410a5d5-dd19-444b-855a-d53cd4f44ef4 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:39.429212 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4830909-06da-45c9-8415-06fd97c4b816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:39.429749 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4830909-06da-45c9-8415-06fd97c4b816 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:39.430039 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4830909-06da-45c9-8415-06fd97c4b816 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:39.430301 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4830909-06da-45c9-8415-06fd97c4b816 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:39.441563 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4830909-06da-45c9-8415-06fd97c4b816 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:56:39.449197 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-e4830909-06da-45c9-8415-06fd97c4b816 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:56:39.449197 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:56:39.449197 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:56:39.449197 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:56:39.449197 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:56:39.449197 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:56:39.449197 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:56:39.449197 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:56:39.449197 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:56:39.449197 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:56:39.449197 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:56:39.449197 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:56:39.449197 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:56:39.449197 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:56:39.449197 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:56:39.449197 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:56:39.450303 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:56:39.450303 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:56:39.450303 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:56:39.450303 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:56:39.450303 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:56:39.450303 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:56:39.450303 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:56:39.450303 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:56:39.450303 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:56:39.450303 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:56:39.450303 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:56:39.450303 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:56:39.450303 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:56:39.450303 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:56:39.450303 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:56:39.450303 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:56:39.451872 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:56:39.451872 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:56:39.451872 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:56:39.451872 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:56:39.451872 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:56:39.451872 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:56:39.451872 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:56:39.451872 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:56:39.451872 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:56:39.451872 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:56:39.451872 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:56:39.451872 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:56:39.451872 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 632/1263] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Jun 8 11:56:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:56:39.457072 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c21bd-276e-433b-82fb-2541e0336b69 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:39.474983 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:39.553345 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c21bd-276e-433b-82fb-2541e0336b69 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:39.590942 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b6f79-b8aa-453e-ac42-fea59e86ab61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:39.591664 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b6f79-b8aa-453e-ac42-fea59e86ab61 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:39.591942 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b6f79-b8aa-453e-ac42-fea59e86ab61 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:39.592322 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b6f79-b8aa-453e-ac42-fea59e86ab61 None admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:39.593083 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b6f79-b8aa-453e-ac42-fea59e86ab61 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:56:39.593390 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b6f79-b8aa-453e-ac42-fea59e86ab61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:39.595088 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b6f79-b8aa-453e-ac42-fea59e86ab61 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:39.603295 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 632/1264] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:56:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:56:39.609627 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4830909-06da-45c9-8415-06fd97c4b816 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:39.674530 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:39.707240 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4830909-06da-45c9-8415-06fd97c4b816 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:39.739663 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e438e-cb9c-4764-a1f0-f1b1b0668f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:39.740476 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e438e-cb9c-4764-a1f0-f1b1b0668f62 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:39.740759 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e438e-cb9c-4764-a1f0-f1b1b0668f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:39.741035 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e438e-cb9c-4764-a1f0-f1b1b0668f62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:39.751926 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430e438e-cb9c-4764-a1f0-f1b1b0668f62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:39.753408 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430e438e-cb9c-4764-a1f0-f1b1b0668f62 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:39.769973 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-430e438e-cb9c-4764-a1f0-f1b1b0668f62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:56:39.769973 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:56:39.769973 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:56:39.769973 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:56:39.769973 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:56:39.769973 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:56:39.769973 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:56:39.769973 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:56:39.769973 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:56:39.769973 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:56:39.769973 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:56:39.769973 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:56:39.769973 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:56:39.769973 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:56:39.769973 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:56:39.770989 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:56:39.770989 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:56:39.770989 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:56:39.770989 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:56:39.770989 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:56:39.770989 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:56:39.770989 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:56:39.770989 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:56:39.770989 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:56:39.770989 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:56:39.770989 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:56:39.770989 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:56:39.770989 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:56:39.770989 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:56:39.770989 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:56:39.770989 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:56:39.770989 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:56:39.772103 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:56:39.772103 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:56:39.772103 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:56:39.772103 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:56:39.772103 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 633/1265] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:56:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:56:39.776796 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b6f79-b8aa-453e-ac42-fea59e86ab61 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:39.856082 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:39.877686 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b6f79-b8aa-453e-ac42-fea59e86ab61 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:39.911617 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea287a8c-0eb0-46ca-9729-60fa3d333f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:39.912300 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea287a8c-0eb0-46ca-9729-60fa3d333f2b None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:39.912585 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea287a8c-0eb0-46ca-9729-60fa3d333f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:39.912858 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea287a8c-0eb0-46ca-9729-60fa3d333f2b None admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:39.913566 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea287a8c-0eb0-46ca-9729-60fa3d333f2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:56:39.913869 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea287a8c-0eb0-46ca-9729-60fa3d333f2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:39.915226 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea287a8c-0eb0-46ca-9729-60fa3d333f2b None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:39.927661 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 633/1266] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:56:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:56:39.933383 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e438e-cb9c-4764-a1f0-f1b1b0668f62 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:40.033119 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e438e-cb9c-4764-a1f0-f1b1b0668f62 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:40.052597 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:40.066780 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd83a32-64a8-4c5a-8528-8650a8c80a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:40.067563 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd83a32-64a8-4c5a-8528-8650a8c80a3f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:40.067840 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd83a32-64a8-4c5a-8528-8650a8c80a3f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:40.068110 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd83a32-64a8-4c5a-8528-8650a8c80a3f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:40.075335 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd83a32-64a8-4c5a-8528-8650a8c80a3f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:40.076825 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd83a32-64a8-4c5a-8528-8650a8c80a3f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:40.090902 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-8bd83a32-64a8-4c5a-8528-8650a8c80a3f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 08 11:56:40.090902 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:56:40.090902 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:56:40.090902 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:56:40.090902 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:56:40.090902 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:56:40.090902 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:56:40.090902 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:56:40.090902 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:56:40.090902 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:56:40.090902 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:56:40.090902 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:56:40.090902 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 11:56:40.090902 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 11:56:40.090902 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 11:56:40.090902 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 11:56:40.092623 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:56:40.092623 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:56:40.092623 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 11:56:40.092623 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:56:40.092623 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 11:56:40.092623 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:56:40.092623 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:56:40.092623 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:56:40.092623 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:56:40.092623 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:56:40.092623 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:56:40.092623 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:56:40.092623 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:56:40.092623 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:56:40.092623 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:56:40.092623 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:56:40.092623 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:56:40.092623 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:56:40.094008 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:56:40.094008 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:56:40.094008 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 11:56:40.094008 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 11:56:40.094008 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 11:56:40.094008 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 11:56:40.094008 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 11:56:40.094008 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 11:56:40.094008 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 08 11:56:40.094008 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:56:40.094008 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 634/1267] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:56:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:56:40.098597 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea287a8c-0eb0-46ca-9729-60fa3d333f2b None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:40.194263 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea287a8c-0eb0-46ca-9729-60fa3d333f2b None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:40.227254 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4cf219-461a-4f2f-9590-57dcf26f0132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:40.227910 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4cf219-461a-4f2f-9590-57dcf26f0132 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:40.228214 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4cf219-461a-4f2f-9590-57dcf26f0132 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:40.228495 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4cf219-461a-4f2f-9590-57dcf26f0132 None admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:40.229323 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4cf219-461a-4f2f-9590-57dcf26f0132 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:56:40.229631 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4cf219-461a-4f2f-9590-57dcf26f0132 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:40.231051 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4cf219-461a-4f2f-9590-57dcf26f0132 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:40.239426 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:40.249800 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 634/1268] 10.222.0.39 () {56 vars in 1143 bytes} [Wed Jun 8 11:56:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:56:40.255414 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd83a32-64a8-4c5a-8528-8650a8c80a3f None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:40.352388 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd83a32-64a8-4c5a-8528-8650a8c80a3f None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:40.391048 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78948050-bfca-4145-9119-78be6b5821ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:40.392208 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78948050-bfca-4145-9119-78be6b5821ad None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:40.392632 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78948050-bfca-4145-9119-78be6b5821ad None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:40.393105 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78948050-bfca-4145-9119-78be6b5821ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:40.405447 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78948050-bfca-4145-9119-78be6b5821ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:40.406909 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78948050-bfca-4145-9119-78be6b5821ad None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:40.424538 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-78948050-bfca-4145-9119-78be6b5821ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:56:40.424538 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:56:40.424538 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:56:40.424538 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:56:40.424538 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:56:40.424538 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:56:40.424538 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:56:40.424538 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:56:40.424538 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:56:40.424538 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:56:40.424538 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:56:40.424538 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:56:40.424538 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:56:40.424538 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:56:40.424538 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:56:40.425618 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:56:40.425618 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:56:40.425618 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:56:40.425618 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:56:40.425618 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:56:40.425618 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:56:40.425618 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:56:40.425618 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:56:40.425618 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:56:40.425618 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:56:40.425618 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:56:40.425618 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:56:40.425618 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:56:40.425618 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:56:40.425618 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:56:40.425618 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:56:40.425618 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:56:40.426907 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:56:40.426907 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:56:40.426907 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:56:40.426907 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:56:40.426907 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 635/1269] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:56:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:56:40.431388 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4cf219-461a-4f2f-9590-57dcf26f0132 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:40.526696 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4cf219-461a-4f2f-9590-57dcf26f0132 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:40.559306 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5eead1-fda9-4c6c-8e14-8c320f557781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:40.559987 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5eead1-fda9-4c6c-8e14-8c320f557781 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:40.561003 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5eead1-fda9-4c6c-8e14-8c320f557781 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:40.561275 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5eead1-fda9-4c6c-8e14-8c320f557781 None admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:40.561983 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5eead1-fda9-4c6c-8e14-8c320f557781 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:56:40.562286 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5eead1-fda9-4c6c-8e14-8c320f557781 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:40.563659 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5eead1-fda9-4c6c-8e14-8c320f557781 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:40.574402 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 635/1270] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:56:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:56:40.580031 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78948050-bfca-4145-9119-78be6b5821ad None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:40.614406 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:40.681587 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78948050-bfca-4145-9119-78be6b5821ad None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:40.714753 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb26fe8a-8e46-4c82-ad67-96dd202d8a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:40.715526 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26fe8a-8e46-4c82-ad67-96dd202d8a11 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:40.715815 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26fe8a-8e46-4c82-ad67-96dd202d8a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:40.716091 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26fe8a-8e46-4c82-ad67-96dd202d8a11 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:40.723130 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb26fe8a-8e46-4c82-ad67-96dd202d8a11 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:40.724615 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb26fe8a-8e46-4c82-ad67-96dd202d8a11 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:40.739069 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-eb26fe8a-8e46-4c82-ad67-96dd202d8a11 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:56:40.739069 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:56:40.739069 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:56:40.739069 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:56:40.739069 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:56:40.739069 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:56:40.739069 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:56:40.739069 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:56:40.739069 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:56:40.739069 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:56:40.739069 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:56:40.739069 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:56:40.739069 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 11:56:40.739069 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 11:56:40.739069 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 11:56:40.740135 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 11:56:40.740135 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:56:40.740135 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:56:40.740135 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:56:40.740135 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:56:40.740135 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:56:40.740135 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:56:40.740135 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:56:40.740135 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:56:40.740135 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:56:40.740135 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:56:40.740135 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:56:40.740135 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:56:40.740135 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:56:40.740135 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:56:40.740135 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:56:40.740135 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:56:40.741152 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 11:56:40.741152 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 11:56:40.741152 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 11:56:40.741152 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 11:56:40.741152 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 11:56:40.741152 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 11:56:40.741152 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:56:40.741152 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:56:40.741152 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 636/1271] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Jun 8 11:56:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:56:40.746060 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5eead1-fda9-4c6c-8e14-8c320f557781 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:40.803398 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:40.844315 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5eead1-fda9-4c6c-8e14-8c320f557781 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:40.876642 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069f9156-99f8-4148-b09a-8b58a107c61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:40.877236 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f9156-99f8-4148-b09a-8b58a107c61a None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:40.877520 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f9156-99f8-4148-b09a-8b58a107c61a None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:40.877796 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f9156-99f8-4148-b09a-8b58a107c61a None admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:40.878580 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069f9156-99f8-4148-b09a-8b58a107c61a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:56:40.878888 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069f9156-99f8-4148-b09a-8b58a107c61a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:40.880329 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069f9156-99f8-4148-b09a-8b58a107c61a None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:40.892140 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 636/1272] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Jun 8 11:56:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:56:40.898213 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb26fe8a-8e46-4c82-ad67-96dd202d8a11 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:40.988334 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:40.997256 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb26fe8a-8e46-4c82-ad67-96dd202d8a11 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:41.029972 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8eaceb-afe7-4fc2-a3f3-ea66af9f19a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:41.030842 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8eaceb-afe7-4fc2-a3f3-ea66af9f19a9 None admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:41.031126 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8eaceb-afe7-4fc2-a3f3-ea66af9f19a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:41.031403 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8eaceb-afe7-4fc2-a3f3-ea66af9f19a9 None admin] PATH_INFO: `/v3/projects/6a7fee684e8b43e199c95aeeb92640d4/users/e9009560a846414b849d42efa8625ff5/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:41.033338 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8eaceb-afe7-4fc2-a3f3-ea66af9f19a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=6a7fee684e8b43e199c95aeeb92640d4, user_id=e9009560a846414b849d42efa8625ff5, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:41.034749 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8eaceb-afe7-4fc2-a3f3-ea66af9f19a9 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:41.047151 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 637/1273] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Jun 8 11:56:40 2022] PUT /identity/v3/projects/6a7fee684e8b43e199c95aeeb92640d4/users/e9009560a846414b849d42efa8625ff5/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 11:56:43.272973 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7916e-d603-4e19-a916-bd2bab00460f None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:43.273555 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7916e-d603-4e19-a916-bd2bab00460f None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:43.273555 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7916e-d603-4e19-a916-bd2bab00460f None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:43.274896 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 637/1274] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:56:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:56:43.281087 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3e4d2-f9f2-4180-b008-84f9bfe6f507 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:43.281513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3e4d2-f9f2-4180-b008-84f9bfe6f507 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:43.281637 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3e4d2-f9f2-4180-b008-84f9bfe6f507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:43.298738 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-5ee3e4d2-f9f2-4180-b008-84f9bfe6f507 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:56:43.299940 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-5ee3e4d2-f9f2-4180-b008-84f9bfe6f507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:56:43.367652 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 638/1275] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:56:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 11:56:43.394512 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d7916e-d603-4e19-a916-bd2bab00460f None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:43.499227 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d7916e-d603-4e19-a916-bd2bab00460f None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:43.516309 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:43.533360 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18630e57-5c7a-4edb-bf8b-7037577f9029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:43.534090 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18630e57-5c7a-4edb-bf8b-7037577f9029 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:43.534372 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18630e57-5c7a-4edb-bf8b-7037577f9029 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:43.534644 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18630e57-5c7a-4edb-bf8b-7037577f9029 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:43.544525 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18630e57-5c7a-4edb-bf8b-7037577f9029 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 08 11:56:43.552401 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-18630e57-5c7a-4edb-bf8b-7037577f9029 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:56:43.552401 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:56:43.552401 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:56:43.552401 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:56:43.552401 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:56:43.552401 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:56:43.552401 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:56:43.552401 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:56:43.552401 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:56:43.552401 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:56:43.552401 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:56:43.552401 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:56:43.552401 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 08 11:56:43.552401 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 08 11:56:43.552401 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 08 11:56:43.552401 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 08 11:56:43.553509 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 08 11:56:43.553509 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 08 11:56:43.553509 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 08 11:56:43.553509 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 08 11:56:43.553509 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:56:43.553509 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:56:43.553509 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:56:43.553509 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:56:43.553509 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:56:43.553509 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:56:43.553509 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:56:43.553509 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:56:43.553509 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:56:43.553509 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:56:43.553509 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:56:43.553509 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:56:43.554384 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:56:43.554384 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:56:43.554384 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:56:43.554384 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:56:43.554384 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 08 11:56:43.554384 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 08 11:56:43.554384 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 08 11:56:43.554384 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 08 11:56:43.554384 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 08 11:56:43.554384 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 08 11:56:43.554384 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 08 11:56:43.554384 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:56:43.554384 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 638/1276] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Jun 8 11:56:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 08 11:56:43.559547 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee3e4d2-f9f2-4180-b008-84f9bfe6f507 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:43.641730 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:43.660808 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee3e4d2-f9f2-4180-b008-84f9bfe6f507 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:43.694951 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c68287-9648-4135-b126-3ec5b4083945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:43.695958 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c68287-9648-4135-b126-3ec5b4083945 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:43.696281 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c68287-9648-4135-b126-3ec5b4083945 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:43.696563 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c68287-9648-4135-b126-3ec5b4083945 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:43.697312 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c68287-9648-4135-b126-3ec5b4083945 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:56:43.697624 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c68287-9648-4135-b126-3ec5b4083945 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:43.698999 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c68287-9648-4135-b126-3ec5b4083945 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:43.707089 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 639/1277] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Jun 8 11:56:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:56:43.712841 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18630e57-5c7a-4edb-bf8b-7037577f9029 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:43.814976 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18630e57-5c7a-4edb-bf8b-7037577f9029 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:43.856101 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f64f5-55ae-4ede-84e2-72e4fc37cdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:43.857661 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f64f5-55ae-4ede-84e2-72e4fc37cdf7 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:43.858105 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f64f5-55ae-4ede-84e2-72e4fc37cdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:43.858385 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f64f5-55ae-4ede-84e2-72e4fc37cdf7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:43.868537 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f64f5-55ae-4ede-84e2-72e4fc37cdf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:43.869974 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f64f5-55ae-4ede-84e2-72e4fc37cdf7 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:43.886550 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-909f64f5-55ae-4ede-84e2-72e4fc37cdf7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:56:43.886550 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:56:43.886550 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:56:43.886550 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:56:43.886550 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:56:43.886550 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:56:43.886550 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:56:43.886550 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:56:43.886550 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:56:43.886550 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:56:43.886550 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:56:43.886550 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:56:43.886550 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:56:43.886550 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:56:43.886550 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:56:43.887601 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:56:43.887601 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:56:43.887601 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:56:43.887601 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:56:43.887601 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:56:43.887601 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:56:43.887601 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:56:43.887601 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:56:43.887601 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:56:43.887601 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:56:43.887601 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:56:43.887601 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:56:43.887601 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:56:43.887601 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:56:43.887601 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:56:43.887601 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:56:43.887601 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:56:43.888710 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:56:43.888710 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:56:43.888710 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:56:43.888710 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:56:43.888710 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 639/1278] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:56:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:56:43.893698 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c68287-9648-4135-b126-3ec5b4083945 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:43.992707 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c68287-9648-4135-b126-3ec5b4083945 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:44.025920 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4914a1bc-23a6-49f8-bbe9-58ccb903301a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:44.026585 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914a1bc-23a6-49f8-bbe9-58ccb903301a None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:44.026872 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914a1bc-23a6-49f8-bbe9-58ccb903301a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:44.027149 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914a1bc-23a6-49f8-bbe9-58ccb903301a None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:44.027870 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4914a1bc-23a6-49f8-bbe9-58ccb903301a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:56:44.028206 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4914a1bc-23a6-49f8-bbe9-58ccb903301a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:44.029601 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4914a1bc-23a6-49f8-bbe9-58ccb903301a None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:44.041274 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 640/1279] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:56:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:56:44.047061 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f64f5-55ae-4ede-84e2-72e4fc37cdf7 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:44.086695 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:44.156391 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f64f5-55ae-4ede-84e2-72e4fc37cdf7 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:44.188756 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd6328-50bf-4db7-b654-b916f8add23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:44.189547 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd6328-50bf-4db7-b654-b916f8add23e None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:44.189828 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd6328-50bf-4db7-b654-b916f8add23e None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:44.190105 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd6328-50bf-4db7-b654-b916f8add23e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:44.197498 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd6328-50bf-4db7-b654-b916f8add23e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:44.198938 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd6328-50bf-4db7-b654-b916f8add23e None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:44.213173 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-24bd6328-50bf-4db7-b654-b916f8add23e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 08 11:56:44.213173 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:56:44.213173 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:56:44.213173 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:56:44.213173 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:56:44.213173 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:56:44.213173 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:56:44.213173 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:56:44.213173 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:56:44.213173 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:56:44.213173 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:56:44.213173 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:56:44.213173 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 08 11:56:44.213173 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 08 11:56:44.213173 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 08 11:56:44.213173 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 08 11:56:44.214198 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:56:44.214198 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:56:44.214198 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 08 11:56:44.214198 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:56:44.214198 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 08 11:56:44.214198 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 08 11:56:44.214198 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:56:44.214198 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:56:44.214198 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:56:44.214198 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:56:44.214198 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:56:44.214198 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:56:44.214198 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:56:44.214198 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:56:44.214198 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:56:44.214198 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:56:44.214198 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:56:44.214198 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:56:44.215160 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:56:44.215160 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:56:44.215160 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 08 11:56:44.215160 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 08 11:56:44.215160 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 08 11:56:44.215160 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 08 11:56:44.215160 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 08 11:56:44.215160 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 08 11:56:44.215160 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 08 11:56:44.215160 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:56:44.215160 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 640/1280] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:56:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:56:44.221223 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4914a1bc-23a6-49f8-bbe9-58ccb903301a None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:44.224980 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:44.317274 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4914a1bc-23a6-49f8-bbe9-58ccb903301a None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:44.349984 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d159a-7d9b-4f87-82dd-0fe909b9de11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:44.350586 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d159a-7d9b-4f87-82dd-0fe909b9de11 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:44.350865 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d159a-7d9b-4f87-82dd-0fe909b9de11 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:44.351134 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d159a-7d9b-4f87-82dd-0fe909b9de11 None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:44.351953 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d159a-7d9b-4f87-82dd-0fe909b9de11 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:56:44.352283 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d159a-7d9b-4f87-82dd-0fe909b9de11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:44.353691 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d159a-7d9b-4f87-82dd-0fe909b9de11 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:44.374096 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 641/1281] 10.222.0.39 () {56 vars in 1143 bytes} [Wed Jun 8 11:56:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:56:44.380085 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd6328-50bf-4db7-b654-b916f8add23e None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:44.469183 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:44.478868 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd6328-50bf-4db7-b654-b916f8add23e None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:44.511778 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a382fe55-bac2-4366-bfa1-bb83a50295a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:44.512450 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382fe55-bac2-4366-bfa1-bb83a50295a3 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:44.512734 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382fe55-bac2-4366-bfa1-bb83a50295a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:44.513130 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382fe55-bac2-4366-bfa1-bb83a50295a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:44.578440 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a382fe55-bac2-4366-bfa1-bb83a50295a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:44.579902 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a382fe55-bac2-4366-bfa1-bb83a50295a3 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:44.694130 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:44.706872 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 641/1282] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Jun 8 11:56:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 08 11:56:44.714686 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d159a-7d9b-4f87-82dd-0fe909b9de11 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:44.783067 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:44.822493 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d159a-7d9b-4f87-82dd-0fe909b9de11 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:44.858880 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245eaa5-e8a4-432c-a26a-22fd361a43e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:44.859826 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245eaa5-e8a4-432c-a26a-22fd361a43e4 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:44.860107 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245eaa5-e8a4-432c-a26a-22fd361a43e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:44.860412 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245eaa5-e8a4-432c-a26a-22fd361a43e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:44.870591 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6245eaa5-e8a4-432c-a26a-22fd361a43e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:44.872038 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6245eaa5-e8a4-432c-a26a-22fd361a43e4 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:44.890576 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-6245eaa5-e8a4-432c-a26a-22fd361a43e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:56:44.890576 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:56:44.890576 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:56:44.890576 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:56:44.890576 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:56:44.890576 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:56:44.890576 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:56:44.890576 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:56:44.890576 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:56:44.890576 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:56:44.890576 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:56:44.890576 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:56:44.890576 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 08 11:56:44.890576 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 08 11:56:44.890576 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 08 11:56:44.891727 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 08 11:56:44.891727 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:56:44.891727 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:56:44.891727 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:56:44.891727 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:56:44.891727 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:56:44.891727 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:56:44.891727 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:56:44.891727 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:56:44.891727 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:56:44.891727 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:56:44.891727 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:56:44.891727 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:56:44.891727 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:56:44.891727 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:56:44.891727 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:56:44.891727 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:56:44.892883 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 08 11:56:44.892883 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 08 11:56:44.892883 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 08 11:56:44.892883 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:56:44.893226 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 642/1283] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 11:56:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:56:44.898743 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a382fe55-bac2-4366-bfa1-bb83a50295a3 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:45.000704 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a382fe55-bac2-4366-bfa1-bb83a50295a3 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:45.035553 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cde908-d7f7-476f-ad19-431c7a08c945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:45.036244 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cde908-d7f7-476f-ad19-431c7a08c945 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:45.036528 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cde908-d7f7-476f-ad19-431c7a08c945 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:45.036801 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cde908-d7f7-476f-ad19-431c7a08c945 None admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:45.037519 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cde908-d7f7-476f-ad19-431c7a08c945 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:56:45.037822 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cde908-d7f7-476f-ad19-431c7a08c945 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:45.039419 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cde908-d7f7-476f-ad19-431c7a08c945 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:45.053465 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 642/1284] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Jun 8 11:56:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:56:45.059229 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245eaa5-e8a4-432c-a26a-22fd361a43e4 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:45.171653 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245eaa5-e8a4-432c-a26a-22fd361a43e4 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:45.186033 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:45.206089 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a02f291-4fdd-46d4-9ed4-ab90e3b78d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:45.206878 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a02f291-4fdd-46d4-9ed4-ab90e3b78d70 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:45.207162 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a02f291-4fdd-46d4-9ed4-ab90e3b78d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:45.207438 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a02f291-4fdd-46d4-9ed4-ab90e3b78d70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:45.213933 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a02f291-4fdd-46d4-9ed4-ab90e3b78d70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:45.215369 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a02f291-4fdd-46d4-9ed4-ab90e3b78d70 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:45.229013 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-6a02f291-4fdd-46d4-9ed4-ab90e3b78d70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:56:45.229013 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:56:45.229013 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:56:45.229013 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:56:45.229013 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:56:45.229013 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:56:45.229013 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:56:45.229013 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:56:45.229013 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:56:45.229013 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:56:45.229013 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:56:45.229013 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:56:45.229013 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 08 11:56:45.229013 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 08 11:56:45.229013 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 08 11:56:45.230045 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 08 11:56:45.230045 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:56:45.230045 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:56:45.230045 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:56:45.230045 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:56:45.230045 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:56:45.230045 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:56:45.230045 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:56:45.230045 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Jun 08 11:56:45.230045 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:56:45.230045 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:56:45.230045 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:56:45.230045 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:56:45.230045 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:56:45.230045 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:56:45.230045 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:56:45.230045 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:56:45.231095 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 08 11:56:45.231095 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 08 11:56:45.231095 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 08 11:56:45.231095 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 08 11:56:45.231095 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 08 11:56:45.231095 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 08 11:56:45.231095 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 08 11:56:45.231095 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: ERROR keystone.server.flask.application Jun 08 11:56:45.231095 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 643/1285] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Jun 8 11:56:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:56:45.236825 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cde908-d7f7-476f-ad19-431c7a08c945 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:45.285738 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:45.333670 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cde908-d7f7-476f-ad19-431c7a08c945 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:45.367687 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c499a200-21bf-4580-aa04-ae8789fd100b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:45.368368 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499a200-21bf-4580-aa04-ae8789fd100b None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:45.368650 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499a200-21bf-4580-aa04-ae8789fd100b None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:45.368925 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499a200-21bf-4580-aa04-ae8789fd100b None admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:45.369703 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c499a200-21bf-4580-aa04-ae8789fd100b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:56:45.370011 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c499a200-21bf-4580-aa04-ae8789fd100b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:45.371426 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c499a200-21bf-4580-aa04-ae8789fd100b None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:45.383215 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 643/1286] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Jun 8 11:56:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:56:45.389427 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a02f291-4fdd-46d4-9ed4-ab90e3b78d70 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:45.487567 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a02f291-4fdd-46d4-9ed4-ab90e3b78d70 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:45.519768 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39665290-c0be-4896-a93c-149ecfe95389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:45.520447 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39665290-c0be-4896-a93c-149ecfe95389 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:45.520733 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39665290-c0be-4896-a93c-149ecfe95389 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:45.521010 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39665290-c0be-4896-a93c-149ecfe95389 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:45.521835 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39665290-c0be-4896-a93c-149ecfe95389 None admin] RBAC: Adding query filter params (role.id=028d4429a4554bbb88b3aec9f6a9d937, scope.project.id=6a7fee684e8b43e199c95aeeb92640d4, user.id=e9009560a846414b849d42efa8625ff5) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:56:45.522145 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39665290-c0be-4896-a93c-149ecfe95389 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:45.523570 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39665290-c0be-4896-a93c-149ecfe95389 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:45.530296 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 644/1287] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Jun 8 11:56:45 2022] GET /identity/v3/role_assignments?user.id=e9009560a846414b849d42efa8625ff5&scope.project.id=6a7fee684e8b43e199c95aeeb92640d4&role.id=028d4429a4554bbb88b3aec9f6a9d937 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:56:47.804335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e5a087-2e94-4c44-88ff-b042825c2342 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:47.804893 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e5a087-2e94-4c44-88ff-b042825c2342 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:47.804893 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e5a087-2e94-4c44-88ff-b042825c2342 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:47.806322 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 644/1288] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:56:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:56:47.812060 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab2343-8a02-46ae-95c9-131246b7fd95 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:47.812523 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab2343-8a02-46ae-95c9-131246b7fd95 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:47.812700 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab2343-8a02-46ae-95c9-131246b7fd95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:47.829911 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-90ab2343-8a02-46ae-95c9-131246b7fd95 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:56:47.831093 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-90ab2343-8a02-46ae-95c9-131246b7fd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:56:47.860448 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:47.896952 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 645/1289] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:56:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 11:56:47.919788 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e5a087-2e94-4c44-88ff-b042825c2342 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:48.022790 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e5a087-2e94-4c44-88ff-b042825c2342 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:48.033146 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:48.056291 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d10fb0-b30b-47aa-9f7f-730f82d28733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:48.057087 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d10fb0-b30b-47aa-9f7f-730f82d28733 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:48.057374 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d10fb0-b30b-47aa-9f7f-730f82d28733 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:48.057650 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d10fb0-b30b-47aa-9f7f-730f82d28733 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:48.058300 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d10fb0-b30b-47aa-9f7f-730f82d28733 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:48.060319 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d10fb0-b30b-47aa-9f7f-730f82d28733 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:48.071909 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-18d10fb0-b30b-47aa-9f7f-730f82d28733 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 08 11:56:48.071909 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:56:48.071909 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 11:56:48.071909 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 11:56:48.071909 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 11:56:48.071909 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 11:56:48.071909 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 11:56:48.071909 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 11:56:48.071909 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 08 11:56:48.071909 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:56:48.071909 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 11:56:48.071909 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:56:48.071909 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:56:48.071909 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:56:48.071909 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:56:48.071909 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:56:48.071909 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:56:48.073157 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:56:48.073157 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:56:48.073157 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:56:48.073157 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:56:48.073157 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:56:48.073157 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:56:48.073157 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 11:56:48.073157 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 11:56:48.073157 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 11:56:48.073157 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 11:56:48.073157 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:56:48.073157 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:56:48.073157 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:56:48.073157 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:56:48.073157 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:56:48.073157 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:56:48.074303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:56:48.074303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:56:48.074303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:56:48.074303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:56:48.074303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:56:48.074303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:56:48.074303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:56:48.074303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:56:48.074303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:56:48.074303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:56:48.074303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 11:56:48.074303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 11:56:48.074303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 08 11:56:48.074303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:56:48.076326 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 645/1290] 10.222.0.39 () {56 vars in 1117 bytes} [Wed Jun 8 11:56:47 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:56:48.079278 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab2343-8a02-46ae-95c9-131246b7fd95 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:48.176249 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab2343-8a02-46ae-95c9-131246b7fd95 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:48.208875 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df773f8-b4c4-4155-9eb2-75fc11cf8366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:48.209533 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df773f8-b4c4-4155-9eb2-75fc11cf8366 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:48.209821 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df773f8-b4c4-4155-9eb2-75fc11cf8366 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:48.210101 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df773f8-b4c4-4155-9eb2-75fc11cf8366 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:48.210802 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df773f8-b4c4-4155-9eb2-75fc11cf8366 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:56:48.211113 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df773f8-b4c4-4155-9eb2-75fc11cf8366 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:48.212527 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df773f8-b4c4-4155-9eb2-75fc11cf8366 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:48.218051 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 646/1291] 10.222.0.39 () {56 vars in 1116 bytes} [Wed Jun 8 11:56:48 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:56:48.223896 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d10fb0-b30b-47aa-9f7f-730f82d28733 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:48.322603 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d10fb0-b30b-47aa-9f7f-730f82d28733 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:48.355258 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694861ce-0b64-45ae-a33d-114a79715c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:48.355917 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694861ce-0b64-45ae-a33d-114a79715c3b None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:48.356225 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694861ce-0b64-45ae-a33d-114a79715c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:48.356552 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694861ce-0b64-45ae-a33d-114a79715c3b None admin] PATH_INFO: `/v3/services` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:48.357209 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694861ce-0b64-45ae-a33d-114a79715c3b None admin] RBAC: Adding query filter params (type=placement) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:56:48.357511 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694861ce-0b64-45ae-a33d-114a79715c3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:48.358877 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694861ce-0b64-45ae-a33d-114a79715c3b None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:48.363866 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 646/1292] 10.222.0.39 () {56 vars in 1116 bytes} [Wed Jun 8 11:56:48 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:56:50.591921 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f5c81-acdf-41e3-a3ed-73cae287d3d4 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:50.592517 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f5c81-acdf-41e3-a3ed-73cae287d3d4 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:50.592517 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f5c81-acdf-41e3-a3ed-73cae287d3d4 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:50.594566 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 647/1293] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:56:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:56:50.599463 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6563d76-30ba-446d-80c3-c83296a8ca2a None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:50.599915 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6563d76-30ba-446d-80c3-c83296a8ca2a None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:50.600033 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6563d76-30ba-446d-80c3-c83296a8ca2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:50.617151 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-d6563d76-30ba-446d-80c3-c83296a8ca2a None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:56:50.618340 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-d6563d76-30ba-446d-80c3-c83296a8ca2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:56:50.646318 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:50.688458 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 647/1294] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:56:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 11:56:50.710806 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f5c81-acdf-41e3-a3ed-73cae287d3d4 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:50.742659 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:50.811244 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f5c81-acdf-41e3-a3ed-73cae287d3d4 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:50.844323 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625bcb2e-bc86-48b5-b32e-27fe29dbd3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:50.844925 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bcb2e-bc86-48b5-b32e-27fe29dbd3dc None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:50.845210 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bcb2e-bc86-48b5-b32e-27fe29dbd3dc None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:50.845487 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bcb2e-bc86-48b5-b32e-27fe29dbd3dc None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:50.846212 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625bcb2e-bc86-48b5-b32e-27fe29dbd3dc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:50.847582 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625bcb2e-bc86-48b5-b32e-27fe29dbd3dc None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:50.859963 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 648/1295] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Jun 8 11:56:50 2022] POST /identity/v3/services => generated 246 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 11:56:53.091776 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72aba8-a281-4e84-a621-e4fcf08ba0ba None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:53.092376 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72aba8-a281-4e84-a621-e4fcf08ba0ba None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:53.092376 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72aba8-a281-4e84-a621-e4fcf08ba0ba None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:53.093985 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 648/1296] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:56:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:56:53.099068 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe722f-e726-49d4-a1ba-f5c905fe61a8 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:53.099458 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe722f-e726-49d4-a1ba-f5c905fe61a8 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:53.099628 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe722f-e726-49d4-a1ba-f5c905fe61a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:53.116653 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-affe722f-e726-49d4-a1ba-f5c905fe61a8 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:56:53.117837 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-affe722f-e726-49d4-a1ba-f5c905fe61a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:56:53.187844 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 649/1297] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:56:53 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 08 11:56:53.210744 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a72aba8-a281-4e84-a621-e4fcf08ba0ba None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:53.310931 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a72aba8-a281-4e84-a621-e4fcf08ba0ba None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:53.344910 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb5ddf-a778-4586-b6e3-079caad5ae9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:53.345638 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb5ddf-a778-4586-b6e3-079caad5ae9d None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:53.345921 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb5ddf-a778-4586-b6e3-079caad5ae9d None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:53.346194 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb5ddf-a778-4586-b6e3-079caad5ae9d None admin] PATH_INFO: `/v3/services/placement` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:53.346839 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb5ddf-a778-4586-b6e3-079caad5ae9d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:53.348220 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb5ddf-a778-4586-b6e3-079caad5ae9d None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:53.359921 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-bddb5ddf-a778-4586-b6e3-079caad5ae9d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 08 11:56:53.359921 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:56:53.359921 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 11:56:53.359921 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 11:56:53.359921 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 11:56:53.359921 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 11:56:53.359921 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 11:56:53.359921 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 11:56:53.359921 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 08 11:56:53.359921 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:56:53.359921 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 11:56:53.359921 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:56:53.359921 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:56:53.359921 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:56:53.359921 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:56:53.359921 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:56:53.359921 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:56:53.361671 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:56:53.361671 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:56:53.361671 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:56:53.361671 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:56:53.361671 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:56:53.361671 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:56:53.361671 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 11:56:53.361671 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 11:56:53.361671 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 11:56:53.361671 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 11:56:53.361671 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:56:53.361671 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:56:53.361671 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:56:53.361671 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:56:53.361671 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:56:53.361671 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:56:53.362889 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:56:53.362889 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:56:53.362889 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:56:53.362889 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:56:53.362889 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:56:53.362889 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:56:53.362889 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:56:53.362889 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:56:53.362889 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:56:53.362889 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:56:53.362889 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 11:56:53.362889 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 11:56:53.362889 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 08 11:56:53.362889 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:56:53.362889 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 649/1298] 10.222.0.39 () {56 vars in 1117 bytes} [Wed Jun 8 11:56:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:56:53.367658 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe722f-e726-49d4-a1ba-f5c905fe61a8 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:53.388604 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:53.479565 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe722f-e726-49d4-a1ba-f5c905fe61a8 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:53.513113 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d120dd-586c-480b-9b51-8bcf243b8e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:53.513782 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d120dd-586c-480b-9b51-8bcf243b8e90 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:53.514068 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d120dd-586c-480b-9b51-8bcf243b8e90 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:53.514344 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d120dd-586c-480b-9b51-8bcf243b8e90 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:53.515050 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d120dd-586c-480b-9b51-8bcf243b8e90 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:56:53.515358 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d120dd-586c-480b-9b51-8bcf243b8e90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:53.516767 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d120dd-586c-480b-9b51-8bcf243b8e90 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:53.521778 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 650/1299] 10.222.0.39 () {56 vars in 1116 bytes} [Wed Jun 8 11:56:53 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 11:56:53.527739 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb5ddf-a778-4586-b6e3-079caad5ae9d None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:53.558104 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:53.626216 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb5ddf-a778-4586-b6e3-079caad5ae9d None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:53.658647 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a28e631-142d-44ce-9ea0-365bd6c88829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:53.659406 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a28e631-142d-44ce-9ea0-365bd6c88829 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:53.659674 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a28e631-142d-44ce-9ea0-365bd6c88829 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:53.659947 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a28e631-142d-44ce-9ea0-365bd6c88829 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:53.660763 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a28e631-142d-44ce-9ea0-365bd6c88829 None admin] RBAC: Adding query filter params (interface=public, service_id=9b552b487cac470489ca76222f58a5df, region_id=RegionOne) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:56:53.661076 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a28e631-142d-44ce-9ea0-365bd6c88829 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:53.662432 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a28e631-142d-44ce-9ea0-365bd6c88829 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:53.667661 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 650/1300] 10.222.0.39 () {56 vars in 1251 bytes} [Wed Jun 8 11:56:53 2022] GET /identity/v3/endpoints?service_id=9b552b487cac470489ca76222f58a5df&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:56:53.673312 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d120dd-586c-480b-9b51-8bcf243b8e90 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:53.752797 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:53.770912 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d120dd-586c-480b-9b51-8bcf243b8e90 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:53.802895 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284fbf9-e908-43c6-8651-d63a04bb6e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:53.803549 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284fbf9-e908-43c6-8651-d63a04bb6e58 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:53.803833 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284fbf9-e908-43c6-8651-d63a04bb6e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:53.804110 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284fbf9-e908-43c6-8651-d63a04bb6e58 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:53.804812 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a284fbf9-e908-43c6-8651-d63a04bb6e58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:53.806175 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a284fbf9-e908-43c6-8651-d63a04bb6e58 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:53.813422 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 651/1301] 10.222.0.39 () {56 vars in 1087 bytes} [Wed Jun 8 11:56:53 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 11:56:56.029033 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7519b2e-bc16-47fc-b917-de5ec42faa34 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:56.029033 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7519b2e-bc16-47fc-b917-de5ec42faa34 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:56.029640 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7519b2e-bc16-47fc-b917-de5ec42faa34 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:56.030684 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 651/1302] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:56:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:56:56.036045 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef1410-317a-473c-8989-bdc9acb7736f None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:56.036486 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef1410-317a-473c-8989-bdc9acb7736f None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:56.036738 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef1410-317a-473c-8989-bdc9acb7736f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:56.054653 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-30ef1410-317a-473c-8989-bdc9acb7736f None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:56:56.055815 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-30ef1410-317a-473c-8989-bdc9acb7736f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:56:56.119435 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 652/1303] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:56:56 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 08 11:56:56.142686 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7519b2e-bc16-47fc-b917-de5ec42faa34 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:56.235056 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:56.242051 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7519b2e-bc16-47fc-b917-de5ec42faa34 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:56.274413 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3fd984-6ad5-431e-978a-bec4c934cd15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:56.275204 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3fd984-6ad5-431e-978a-bec4c934cd15 None admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:56.275487 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3fd984-6ad5-431e-978a-bec4c934cd15 None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:56.275764 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3fd984-6ad5-431e-978a-bec4c934cd15 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:56.276442 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3fd984-6ad5-431e-978a-bec4c934cd15 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:56.277902 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3fd984-6ad5-431e-978a-bec4c934cd15 None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:56.289648 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application [None req-2b3fd984-6ad5-431e-978a-bec4c934cd15 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 08 11:56:56.289648 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:56:56.289648 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 08 11:56:56.289648 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 08 11:56:56.289648 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 08 11:56:56.289648 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 08 11:56:56.289648 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 08 11:56:56.289648 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 11:56:56.289648 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 08 11:56:56.289648 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:56:56.289648 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 08 11:56:56.289648 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:56:56.289648 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 08 11:56:56.289648 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 08 11:56:56.289648 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 08 11:56:56.289648 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 08 11:56:56.289648 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 08 11:56:56.290805 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 08 11:56:56.290805 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 08 11:56:56.290805 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 08 11:56:56.290805 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 08 11:56:56.290805 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 08 11:56:56.290805 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 08 11:56:56.290805 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 08 11:56:56.290805 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 08 11:56:56.290805 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 08 11:56:56.290805 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 08 11:56:56.290805 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 08 11:56:56.290805 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 08 11:56:56.290805 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 08 11:56:56.290805 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 08 11:56:56.290805 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 08 11:56:56.290805 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.get_or_create( Jun 08 11:56:56.291855 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 08 11:56:56.291855 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application with Lock( Jun 08 11:56:56.291855 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 08 11:56:56.291855 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self._enter() Jun 08 11:56:56.291855 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 08 11:56:56.291855 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 08 11:56:56.291855 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 08 11:56:56.291855 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application return self.creator() Jun 08 11:56:56.291855 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 08 11:56:56.291855 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application created_value = creator( Jun 08 11:56:56.291855 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 08 11:56:56.291855 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 08 11:56:56.291855 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 08 11:56:56.291855 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: ERROR keystone.server.flask.application Jun 08 11:56:56.291855 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 652/1304] 10.222.0.39 () {56 vars in 1117 bytes} [Wed Jun 8 11:56:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 08 11:56:56.297535 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef1410-317a-473c-8989-bdc9acb7736f None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:56.372195 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:56:56.395004 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef1410-317a-473c-8989-bdc9acb7736f None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:56.428220 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47708cbd-9b37-46e2-8fce-faa75b25ac8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:56.428872 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47708cbd-9b37-46e2-8fce-faa75b25ac8c None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:56.429159 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47708cbd-9b37-46e2-8fce-faa75b25ac8c None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:56.429431 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47708cbd-9b37-46e2-8fce-faa75b25ac8c None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:56.430124 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47708cbd-9b37-46e2-8fce-faa75b25ac8c None admin] RBAC: Adding query filter params (name=placement) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 11:56:56.430428 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47708cbd-9b37-46e2-8fce-faa75b25ac8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:56.431789 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47708cbd-9b37-46e2-8fce-faa75b25ac8c None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:56.437461 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 653/1305] 10.222.0.39 () {56 vars in 1116 bytes} [Wed Jun 8 11:56:56 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 11:56:56.443129 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3fd984-6ad5-431e-978a-bec4c934cd15 None admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:56:56.541063 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3fd984-6ad5-431e-978a-bec4c934cd15 None admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:56:56.573840 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa786325-ffd8-4010-a7b1-5597310a29ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:56:56.574488 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa786325-ffd8-4010-a7b1-5597310a29ab None admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:56:56.575470 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa786325-ffd8-4010-a7b1-5597310a29ab None admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:56:56.575773 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa786325-ffd8-4010-a7b1-5597310a29ab None admin] PATH_INFO: `/v3/endpoints` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:56:56.576555 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa786325-ffd8-4010-a7b1-5597310a29ab None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:56:56.577940 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa786325-ffd8-4010-a7b1-5597310a29ab None admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:56:56.596341 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 653/1306] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Jun 8 11:56:56 2022] POST /identity/v3/endpoints => generated 331 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 11:57:06.433933 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=30 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:57:06.591674 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:58:00.517437 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d1e1cc-a646-4c0a-8509-3126b7c69bd9 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:58:00.518043 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d1e1cc-a646-4c0a-8509-3126b7c69bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:58:00.518043 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d1e1cc-a646-4c0a-8509-3126b7c69bd9 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:58:00.519526 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 654/1307] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:58:00.530052 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31a80c-d214-4b4d-99ae-51e7177e2503 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:58:00.530531 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31a80c-d214-4b4d-99ae-51e7177e2503 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:58:00.530628 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31a80c-d214-4b4d-99ae-51e7177e2503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:58:00.706722 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-1c31a80c-d214-4b4d-99ae-51e7177e2503 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:58:00.707969 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-1c31a80c-d214-4b4d-99ae-51e7177e2503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:58:00.947882 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 654/1308] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 11:58:01.002511 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8618b16-72fc-4295-930c-304ca17c9c21 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:58:01.003227 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8618b16-72fc-4295-930c-304ca17c9c21 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:58:01.003699 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8618b16-72fc-4295-930c-304ca17c9c21 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:58:01.005593 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 655/1309] 10.222.0.39 () {54 vars in 964 bytes} [Wed Jun 8 11:58:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:58:01.012032 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e4203-aca5-47e5-87f0-abdeba574fa0 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:58:01.012350 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e4203-aca5-47e5-87f0-abdeba574fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:58:01.012664 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e4203-aca5-47e5-87f0-abdeba574fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:58:01.171358 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-821e4203-aca5-47e5-87f0-abdeba574fa0 None None] MFA Rules not processed for user `2fef074aa2ea4570928109f62ea1aa96`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:58:01.175245 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-821e4203-aca5-47e5-87f0-abdeba574fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:58:01.215816 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:58:01.367018 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 655/1310] 10.222.0.39 () {58 vars in 1061 bytes} [Wed Jun 8 11:58:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 11:58:01.377292 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8618b16-72fc-4295-930c-304ca17c9c21 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:58:01.379431 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b8618b16-72fc-4295-930c-304ca17c9c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:58:01.506441 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8618b16-72fc-4295-930c-304ca17c9c21 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:58:01.597170 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f77548-f0d4-45a6-bc41-a7773e53ed51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:58:01.598437 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f77548-f0d4-45a6-bc41-a7773e53ed51 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:58:01.598876 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f77548-f0d4-45a6-bc41-a7773e53ed51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:58:01.599301 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f77548-f0d4-45a6-bc41-a7773e53ed51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:58:01.601849 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f6f77548-f0d4-45a6-bc41-a7773e53ed51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:58:01.669411 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:58:01.731986 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f77548-f0d4-45a6-bc41-a7773e53ed51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:58:01.733622 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f77548-f0d4-45a6-bc41-a7773e53ed51 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:58:01.754110 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 656/1311] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 11:58:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 11:58:04.371212 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170f408-980b-4207-adc8-7fe3d08d9741 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:58:04.371755 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170f408-980b-4207-adc8-7fe3d08d9741 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:58:04.371894 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170f408-980b-4207-adc8-7fe3d08d9741 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:58:04.373372 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 656/1312] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:58:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:58:04.378658 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eeffd5-ce8d-46e8-b69c-08a2c87c4f6b None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:58:04.379069 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eeffd5-ce8d-46e8-b69c-08a2c87c4f6b None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:58:04.379232 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eeffd5-ce8d-46e8-b69c-08a2c87c4f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:58:04.458058 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-29eeffd5-ce8d-46e8-b69c-08a2c87c4f6b None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:58:04.459757 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-29eeffd5-ce8d-46e8-b69c-08a2c87c4f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:58:04.559627 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 657/1313] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:58:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 11:58:04.614014 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6f532-18be-4254-a537-666d65613ad1 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:58:04.614307 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6f532-18be-4254-a537-666d65613ad1 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:58:04.614590 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6f532-18be-4254-a537-666d65613ad1 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:58:04.615960 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 657/1314] 10.222.0.39 () {54 vars in 964 bytes} [Wed Jun 8 11:58:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:58:04.622795 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b9f47-c32c-41bc-ab74-e1f5c1424070 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:58:04.623104 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b9f47-c32c-41bc-ab74-e1f5c1424070 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:58:04.623463 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b9f47-c32c-41bc-ab74-e1f5c1424070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:58:04.634514 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:58:04.699400 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-924b9f47-c32c-41bc-ab74-e1f5c1424070 None None] MFA Rules not processed for user `2fef074aa2ea4570928109f62ea1aa96`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:58:04.700643 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-924b9f47-c32c-41bc-ab74-e1f5c1424070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:58:04.788657 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 658/1315] 10.222.0.39 () {58 vars in 1061 bytes} [Wed Jun 8 11:58:04 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 11:58:04.801425 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6f532-18be-4254-a537-666d65613ad1 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:58:04.802964 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-59d6f532-18be-4254-a537-666d65613ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:58:05.035329 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6f532-18be-4254-a537-666d65613ad1 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:58:05.119810 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:58:05.122560 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba6b7c-21e8-45a2-b859-8da06b3bc389 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:58:05.123407 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba6b7c-21e8-45a2-b859-8da06b3bc389 service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:58:05.123865 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba6b7c-21e8-45a2-b859-8da06b3bc389 service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:58:05.124365 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba6b7c-21e8-45a2-b859-8da06b3bc389 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:58:05.126025 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-1dba6b7c-21e8-45a2-b859-8da06b3bc389 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:58:05.237866 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba6b7c-21e8-45a2-b859-8da06b3bc389 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:58:05.239303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba6b7c-21e8-45a2-b859-8da06b3bc389 service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:58:05.257655 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 658/1316] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 11:58:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 11:58:08.131190 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb17e4a-1b2d-4325-95e8-0e4c534e4d81 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:58:08.131723 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb17e4a-1b2d-4325-95e8-0e4c534e4d81 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:58:08.131820 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb17e4a-1b2d-4325-95e8-0e4c534e4d81 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:58:08.133992 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 659/1317] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:58:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:58:08.139197 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36e828-41f1-46c0-9ccc-62590bbb3c09 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:58:08.139637 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36e828-41f1-46c0-9ccc-62590bbb3c09 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:58:08.139759 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36e828-41f1-46c0-9ccc-62590bbb3c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:58:08.202749 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-aa36e828-41f1-46c0-9ccc-62590bbb3c09 None None] MFA Rules not processed for user `1541e9b140b0436399c5ed9a4362ef6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:58:08.203980 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-aa36e828-41f1-46c0-9ccc-62590bbb3c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:58:08.259207 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:58:08.303116 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 659/1318] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:58:08 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 11:58:08.343442 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb17e4a-1b2d-4325-95e8-0e4c534e4d81 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:58:08.345033 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-efb17e4a-1b2d-4325-95e8-0e4c534e4d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:58:08.447774 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb17e4a-1b2d-4325-95e8-0e4c534e4d81 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:58:08.450565 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:58:08.521949 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd69744-f536-485f-bda0-e48fece266be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:58:08.522595 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd69744-f536-485f-bda0-e48fece266be service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:58:08.522875 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd69744-f536-485f-bda0-e48fece266be service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:58:08.523149 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd69744-f536-485f-bda0-e48fece266be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:58:08.525358 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-bdd69744-f536-485f-bda0-e48fece266be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:58:08.634390 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd69744-f536-485f-bda0-e48fece266be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:58:08.635830 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd69744-f536-485f-bda0-e48fece266be service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:58:08.654959 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 660/1319] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 11:58:08 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 11:58:11.632007 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d877839-659c-4b41-83fd-3487d18eb75b None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:58:11.632532 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d877839-659c-4b41-83fd-3487d18eb75b None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:58:11.632646 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d877839-659c-4b41-83fd-3487d18eb75b None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:58:11.634029 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 660/1320] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:58:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:58:11.639321 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07807fd4-3ba0-4e10-9c58-8929ae516f46 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:58:11.639706 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07807fd4-3ba0-4e10-9c58-8929ae516f46 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:58:11.639883 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07807fd4-3ba0-4e10-9c58-8929ae516f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:58:11.809984 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:58:11.834802 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-07807fd4-3ba0-4e10-9c58-8929ae516f46 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:58:11.836670 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-07807fd4-3ba0-4e10-9c58-8929ae516f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:58:11.930640 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 661/1321] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:58:11 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 11:58:11.970139 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d877839-659c-4b41-83fd-3487d18eb75b None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:58:11.971676 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-6d877839-659c-4b41-83fd-3487d18eb75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:58:12.072774 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d877839-659c-4b41-83fd-3487d18eb75b None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:58:12.143008 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72cbb31-7f53-4618-9ee5-fba9a6e5dc99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:58:12.143644 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72cbb31-7f53-4618-9ee5-fba9a6e5dc99 service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:58:12.143920 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72cbb31-7f53-4618-9ee5-fba9a6e5dc99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:58:12.144207 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72cbb31-7f53-4618-9ee5-fba9a6e5dc99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:58:12.145821 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-f72cbb31-7f53-4618-9ee5-fba9a6e5dc99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:58:12.153809 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:58:12.254154 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72cbb31-7f53-4618-9ee5-fba9a6e5dc99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:58:12.255506 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72cbb31-7f53-4618-9ee5-fba9a6e5dc99 service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:58:12.274132 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 661/1322] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 11:58:11 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 11:58:15.218338 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb153d1e-ff0b-44e7-a1a3-6bed889cea7b None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:58:15.218862 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb153d1e-ff0b-44e7-a1a3-6bed889cea7b None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:58:15.218862 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb153d1e-ff0b-44e7-a1a3-6bed889cea7b None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:58:15.220413 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 662/1323] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:58:15.225676 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7bd802-ff2b-411a-afc3-fe315b5eb881 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:58:15.226613 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7bd802-ff2b-411a-afc3-fe315b5eb881 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:58:15.227059 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7bd802-ff2b-411a-afc3-fe315b5eb881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:58:15.293177 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-0d7bd802-ff2b-411a-afc3-fe315b5eb881 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:58:15.294385 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-0d7bd802-ff2b-411a-afc3-fe315b5eb881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:58:15.355109 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:58:15.394513 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 662/1324] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:58:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 11:58:15.431103 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb153d1e-ff0b-44e7-a1a3-6bed889cea7b None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:58:15.432780 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-cb153d1e-ff0b-44e7-a1a3-6bed889cea7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:58:15.537988 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb153d1e-ff0b-44e7-a1a3-6bed889cea7b None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:58:15.551270 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:58:15.619614 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea84e36d-12cc-46b3-b1b6-3177bcf8c7a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:58:15.620473 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84e36d-12cc-46b3-b1b6-3177bcf8c7a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:58:15.620785 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84e36d-12cc-46b3-b1b6-3177bcf8c7a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:58:15.621092 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84e36d-12cc-46b3-b1b6-3177bcf8c7a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:58:15.622736 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ea84e36d-12cc-46b3-b1b6-3177bcf8c7a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:58:15.733519 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea84e36d-12cc-46b3-b1b6-3177bcf8c7a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:58:15.734955 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea84e36d-12cc-46b3-b1b6-3177bcf8c7a5 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:58:15.753024 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 663/1325] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 11:58:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 11:58:18.063462 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb4bd1-7141-4c90-b02d-c4036c1faede None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:58:18.063986 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb4bd1-7141-4c90-b02d-c4036c1faede None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:58:18.063986 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb4bd1-7141-4c90-b02d-c4036c1faede None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:58:18.065512 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 663/1326] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:58:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:58:18.071302 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a6b9f-127f-4a2a-8a86-1dbbdb2945b9 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:58:18.071754 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a6b9f-127f-4a2a-8a86-1dbbdb2945b9 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:58:18.071847 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a6b9f-127f-4a2a-8a86-1dbbdb2945b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:58:18.117874 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:58:18.137607 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-969a6b9f-127f-4a2a-8a86-1dbbdb2945b9 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:58:18.138806 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-969a6b9f-127f-4a2a-8a86-1dbbdb2945b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:58:18.235392 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 664/1327] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:58:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 11:58:18.271426 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eb4bd1-7141-4c90-b02d-c4036c1faede None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:58:18.273094 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-95eb4bd1-7141-4c90-b02d-c4036c1faede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:58:18.386582 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eb4bd1-7141-4c90-b02d-c4036c1faede None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:58:18.458389 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a98a05-bc68-4c50-a207-334ded286c9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:58:18.459039 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a98a05-bc68-4c50-a207-334ded286c9b service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:58:18.459320 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a98a05-bc68-4c50-a207-334ded286c9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:58:18.459596 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a98a05-bc68-4c50-a207-334ded286c9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:58:18.461460 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-30a98a05-bc68-4c50-a207-334ded286c9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:58:18.477932 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:58:18.569090 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a98a05-bc68-4c50-a207-334ded286c9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:58:18.570767 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a98a05-bc68-4c50-a207-334ded286c9b service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:58:18.603666 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 664/1328] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 11:58:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 11:58:20.974565 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0390c93-1e6d-436c-9aba-b469b5cf8f34 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:58:20.975129 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0390c93-1e6d-436c-9aba-b469b5cf8f34 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:58:20.975129 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0390c93-1e6d-436c-9aba-b469b5cf8f34 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:58:20.976896 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 665/1329] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:58:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:58:20.981824 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d47b8-de2a-42c2-9410-4eee29434679 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:58:20.982222 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d47b8-de2a-42c2-9410-4eee29434679 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:58:20.982378 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d47b8-de2a-42c2-9410-4eee29434679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:58:21.050893 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-c54d47b8-de2a-42c2-9410-4eee29434679 None None] MFA Rules not processed for user `1541e9b140b0436399c5ed9a4362ef6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:58:21.052101 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-c54d47b8-de2a-42c2-9410-4eee29434679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:58:21.117234 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:58:21.150377 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 665/1330] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:58:20 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 11:58:21.186770 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0390c93-1e6d-436c-9aba-b469b5cf8f34 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:58:21.188309 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b0390c93-1e6d-436c-9aba-b469b5cf8f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:58:21.291006 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0390c93-1e6d-436c-9aba-b469b5cf8f34 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:58:21.311007 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:58:21.364364 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1197c2-3874-4cde-a776-55b0c29b26a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:58:21.365018 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1197c2-3874-4cde-a776-55b0c29b26a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:58:21.365302 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1197c2-3874-4cde-a776-55b0c29b26a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:58:21.365571 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1197c2-3874-4cde-a776-55b0c29b26a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:58:21.368134 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-dc1197c2-3874-4cde-a776-55b0c29b26a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:58:21.475454 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1197c2-3874-4cde-a776-55b0c29b26a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:58:21.476890 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1197c2-3874-4cde-a776-55b0c29b26a5 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:58:21.494872 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 666/1331] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 11:58:21 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 11:58:23.986289 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bbadeb-3012-4486-b216-e2078125aee5 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:58:23.986757 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bbadeb-3012-4486-b216-e2078125aee5 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:58:23.986851 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bbadeb-3012-4486-b216-e2078125aee5 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:58:23.988431 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 666/1332] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:58:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:58:23.994420 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26833720-e1f1-4bc5-9520-7fc6bdb1d085 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:58:23.994860 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26833720-e1f1-4bc5-9520-7fc6bdb1d085 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:58:23.994970 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26833720-e1f1-4bc5-9520-7fc6bdb1d085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:58:24.063083 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:58:24.066099 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-26833720-e1f1-4bc5-9520-7fc6bdb1d085 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:58:24.067651 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-26833720-e1f1-4bc5-9520-7fc6bdb1d085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:58:24.168055 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 667/1333] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:58:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 11:58:24.206170 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bbadeb-3012-4486-b216-e2078125aee5 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:58:24.207688 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-40bbadeb-3012-4486-b216-e2078125aee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:58:24.340043 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bbadeb-3012-4486-b216-e2078125aee5 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:58:24.425256 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a971b-1f61-4357-825f-f850d55816bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:58:24.425917 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a971b-1f61-4357-825f-f850d55816bc service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:58:24.426205 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a971b-1f61-4357-825f-f850d55816bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:58:24.426483 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a971b-1f61-4357-825f-f850d55816bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:58:24.428153 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-fd0a971b-1f61-4357-825f-f850d55816bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:58:24.466823 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:58:24.569971 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0a971b-1f61-4357-825f-f850d55816bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:58:24.571439 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0a971b-1f61-4357-825f-f850d55816bc service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:58:24.594130 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 667/1334] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 11:58:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 11:58:26.922221 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81ee67-0b58-4e5f-b1f8-0c0cf12affdd None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:58:26.922786 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81ee67-0b58-4e5f-b1f8-0c0cf12affdd None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:58:26.922786 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81ee67-0b58-4e5f-b1f8-0c0cf12affdd None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:58:26.924152 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 668/1335] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:58:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:58:26.929491 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcfefb4-7bb5-4755-8acd-bea37c7d1d4f None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:58:26.929929 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcfefb4-7bb5-4755-8acd-bea37c7d1d4f None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:58:26.930052 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcfefb4-7bb5-4755-8acd-bea37c7d1d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:58:26.995289 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-3fcfefb4-7bb5-4755-8acd-bea37c7d1d4f None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:58:26.996535 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-3fcfefb4-7bb5-4755-8acd-bea37c7d1d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:58:27.074069 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:58:27.097052 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 668/1336] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:58:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 11:58:27.136765 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b81ee67-0b58-4e5f-b1f8-0c0cf12affdd None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:58:27.138300 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-1b81ee67-0b58-4e5f-b1f8-0c0cf12affdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:58:27.240453 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b81ee67-0b58-4e5f-b1f8-0c0cf12affdd None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:58:27.271548 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:58:27.315848 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9346dfea-fccc-4c32-ba7a-ed2ee860ff71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:58:27.316564 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346dfea-fccc-4c32-ba7a-ed2ee860ff71 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:58:27.316846 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346dfea-fccc-4c32-ba7a-ed2ee860ff71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:58:27.317119 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346dfea-fccc-4c32-ba7a-ed2ee860ff71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:58:27.318736 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-9346dfea-fccc-4c32-ba7a-ed2ee860ff71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:58:27.424555 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9346dfea-fccc-4c32-ba7a-ed2ee860ff71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:58:27.426250 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9346dfea-fccc-4c32-ba7a-ed2ee860ff71 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:58:27.446310 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 669/1337] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 11:58:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 11:58:30.010531 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f3bc9-fb09-413b-a29f-6aa1956b35ac None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:58:30.010988 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f3bc9-fb09-413b-a29f-6aa1956b35ac None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:58:30.011102 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f3bc9-fb09-413b-a29f-6aa1956b35ac None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:58:30.012488 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 669/1338] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:58:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:58:30.017588 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27793e-16df-47a4-a0c1-f7a5768db50c None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:58:30.017992 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27793e-16df-47a4-a0c1-f7a5768db50c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:58:30.018172 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27793e-16df-47a4-a0c1-f7a5768db50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:58:30.081997 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-2e27793e-16df-47a4-a0c1-f7a5768db50c None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:58:30.083192 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-2e27793e-16df-47a4-a0c1-f7a5768db50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:58:30.092242 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:58:30.179146 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 670/1339] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:58:30 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 11:58:30.215031 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f3bc9-fb09-413b-a29f-6aa1956b35ac None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:58:30.216809 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-f50f3bc9-fb09-413b-a29f-6aa1956b35ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:58:30.320927 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f3bc9-fb09-413b-a29f-6aa1956b35ac None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:58:30.399679 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af92eec1-87dc-4484-80fd-ae81b1550e3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:58:30.400368 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92eec1-87dc-4484-80fd-ae81b1550e3c service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:58:30.400658 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92eec1-87dc-4484-80fd-ae81b1550e3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:58:30.400937 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92eec1-87dc-4484-80fd-ae81b1550e3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:58:30.402587 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-af92eec1-87dc-4484-80fd-ae81b1550e3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:58:30.438519 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:58:30.511270 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af92eec1-87dc-4484-80fd-ae81b1550e3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:58:30.512890 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af92eec1-87dc-4484-80fd-ae81b1550e3c service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:58:30.534333 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 670/1340] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 11:58:30 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 11:58:34.704036 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead544b1-382f-49e6-8651-8ce42bb8a99f None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:58:34.704599 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead544b1-382f-49e6-8651-8ce42bb8a99f None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:58:34.704599 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead544b1-382f-49e6-8651-8ce42bb8a99f None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:58:34.706013 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 671/1341] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:58:34.711318 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ab290-39a0-45b3-b5c2-077b082bccfc None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:58:34.711755 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ab290-39a0-45b3-b5c2-077b082bccfc None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:58:34.712020 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ab290-39a0-45b3-b5c2-077b082bccfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:58:34.781882 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-bc9ab290-39a0-45b3-b5c2-077b082bccfc None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:58:34.782995 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-bc9ab290-39a0-45b3-b5c2-077b082bccfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:58:34.875075 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:58:34.888863 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 671/1342] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:58:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 11:58:34.931498 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead544b1-382f-49e6-8651-8ce42bb8a99f None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:58:34.933725 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ead544b1-382f-49e6-8651-8ce42bb8a99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:58:35.032313 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead544b1-382f-49e6-8651-8ce42bb8a99f None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:58:35.035732 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99975e4-431d-4794-b4c1-ae8a78e02477 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:58:35.036411 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99975e4-431d-4794-b4c1-ae8a78e02477 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:58:35.036692 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99975e4-431d-4794-b4c1-ae8a78e02477 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:58:35.036963 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99975e4-431d-4794-b4c1-ae8a78e02477 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:58:35.046280 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99975e4-431d-4794-b4c1-ae8a78e02477 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:58:35.047730 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99975e4-431d-4794-b4c1-ae8a78e02477 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:58:35.058411 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 672/1343] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 11:58:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 11:58:37.952374 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eadba0-1115-4086-af4f-1a393d898cc5 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:58:37.952894 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eadba0-1115-4086-af4f-1a393d898cc5 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:58:37.952998 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eadba0-1115-4086-af4f-1a393d898cc5 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:58:37.954318 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 672/1344] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:58:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:58:37.959573 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8f311-b495-4f1e-807f-226cb912abae None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:58:37.960534 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8f311-b495-4f1e-807f-226cb912abae None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:58:37.960854 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8f311-b495-4f1e-807f-226cb912abae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:58:37.988559 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-5ee8f311-b495-4f1e-807f-226cb912abae None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:58:37.989727 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-5ee8f311-b495-4f1e-807f-226cb912abae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:58:38.016743 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:58:38.066685 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 673/1345] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:58:37 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 11:58:38.105198 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eadba0-1115-4086-af4f-1a393d898cc5 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:58:38.106885 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-a9eadba0-1115-4086-af4f-1a393d898cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:58:38.120774 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eadba0-1115-4086-af4f-1a393d898cc5 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:58:38.124219 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb0e46-a9b5-4bcf-929a-cad6023fe88f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:58:38.124861 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb0e46-a9b5-4bcf-929a-cad6023fe88f service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:58:38.125146 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb0e46-a9b5-4bcf-929a-cad6023fe88f service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:58:38.125420 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb0e46-a9b5-4bcf-929a-cad6023fe88f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:58:38.134389 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb0e46-a9b5-4bcf-929a-cad6023fe88f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:58:38.135813 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb0e46-a9b5-4bcf-929a-cad6023fe88f service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:58:38.145391 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 673/1346] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 11:58:38 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 11:58:42.785299 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cff5f7-9408-4d7a-b64e-b12ee518e82c None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:58:42.785872 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cff5f7-9408-4d7a-b64e-b12ee518e82c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:58:42.785872 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cff5f7-9408-4d7a-b64e-b12ee518e82c None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:58:42.787238 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 674/1347] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:58:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:58:42.793356 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c277d-37e9-4056-89a3-bc0d2c934ea5 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:58:42.793767 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c277d-37e9-4056-89a3-bc0d2c934ea5 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:58:42.793908 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c277d-37e9-4056-89a3-bc0d2c934ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:58:42.811762 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-f35c277d-37e9-4056-89a3-bc0d2c934ea5 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:58:42.812951 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-f35c277d-37e9-4056-89a3-bc0d2c934ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:58:42.820681 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 674/1348] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:58:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 11:58:42.858772 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cff5f7-9408-4d7a-b64e-b12ee518e82c None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:58:42.870753 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cff5f7-9408-4d7a-b64e-b12ee518e82c None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:58:42.874228 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4620ad-d645-4c37-abab-660c936bb7e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:58:42.874863 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4620ad-d645-4c37-abab-660c936bb7e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:58:42.875146 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4620ad-d645-4c37-abab-660c936bb7e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:58:42.875475 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4620ad-d645-4c37-abab-660c936bb7e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:58:42.884999 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4620ad-d645-4c37-abab-660c936bb7e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:58:42.886428 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4620ad-d645-4c37-abab-660c936bb7e7 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:58:42.895926 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 675/1349] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 11:58:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 11:58:48.396831 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ba0c8-1e3f-456b-a8d8-739dc18996e9 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:58:48.397339 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ba0c8-1e3f-456b-a8d8-739dc18996e9 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:58:48.397492 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ba0c8-1e3f-456b-a8d8-739dc18996e9 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:58:48.399102 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 675/1350] 10.222.0.39 () {54 vars in 921 bytes} [Wed Jun 8 11:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:58:48.404005 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f50359-09e2-4e37-89fd-52355c82e6a0 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:58:48.404472 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f50359-09e2-4e37-89fd-52355c82e6a0 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:58:48.404646 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f50359-09e2-4e37-89fd-52355c82e6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:58:48.486782 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-e5f50359-09e2-4e37-89fd-52355c82e6a0 None None] MFA Rules not processed for user `e9009560a846414b849d42efa8625ff5`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:58:48.488351 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-e5f50359-09e2-4e37-89fd-52355c82e6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:58:48.567292 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 676/1351] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Jun 8 11:58:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 11:58:52.806872 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=13 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:58:53.054059 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c3e43-4a82-43ee-a640-f93616c45af8 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:58:53.054437 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c3e43-4a82-43ee-a640-f93616c45af8 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:58:53.054758 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c3e43-4a82-43ee-a640-f93616c45af8 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:58:53.056275 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 676/1352] 10.222.0.39 () {54 vars in 921 bytes} [Wed Jun 8 11:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:58:53.061256 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc72421-18eb-42f2-bc89-9417b6420d34 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:58:53.061719 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc72421-18eb-42f2-bc89-9417b6420d34 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:58:53.061829 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc72421-18eb-42f2-bc89-9417b6420d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:58:53.081084 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-1dc72421-18eb-42f2-bc89-9417b6420d34 None None] MFA Rules not processed for user `e9009560a846414b849d42efa8625ff5`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:58:53.082291 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-1dc72421-18eb-42f2-bc89-9417b6420d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:58:53.091957 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 677/1353] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Jun 8 11:58:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 11:58:54.622343 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92f75c-0492-4a44-b0e8-991e300216b3 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:58:54.622867 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92f75c-0492-4a44-b0e8-991e300216b3 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:58:54.623017 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92f75c-0492-4a44-b0e8-991e300216b3 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:58:54.624482 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 677/1354] 10.222.0.39 () {54 vars in 921 bytes} [Wed Jun 8 11:58:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:58:54.629662 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37100c5-a669-4a27-9c03-f4229b21bbfc None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:58:54.630099 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37100c5-a669-4a27-9c03-f4229b21bbfc None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:58:54.630203 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37100c5-a669-4a27-9c03-f4229b21bbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:58:54.650726 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-a37100c5-a669-4a27-9c03-f4229b21bbfc None None] MFA Rules not processed for user `e9009560a846414b849d42efa8625ff5`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:58:54.651977 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a37100c5-a669-4a27-9c03-f4229b21bbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:58:54.660914 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 678/1355] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Jun 8 11:58:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 11:58:58.531747 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a515c78-c761-47a6-8863-b2aaee688827 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:58:58.532318 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a515c78-c761-47a6-8863-b2aaee688827 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:58:58.532318 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a515c78-c761-47a6-8863-b2aaee688827 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:58:58.533858 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 678/1356] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:58:58.540047 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df59c7f-7765-45e2-81c5-f54244c1364f None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:58:58.540541 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df59c7f-7765-45e2-81c5-f54244c1364f None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:58:58.540814 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df59c7f-7765-45e2-81c5-f54244c1364f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:58:58.559166 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-2df59c7f-7765-45e2-81c5-f54244c1364f None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:58:58.560452 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-2df59c7f-7765-45e2-81c5-f54244c1364f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:58:58.568664 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 679/1357] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:58:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 11:58:58.628556 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561ea25-0245-4228-b3e2-2e045e82b497 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:58:58.629072 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561ea25-0245-4228-b3e2-2e045e82b497 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:58:58.629571 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561ea25-0245-4228-b3e2-2e045e82b497 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:58:58.631996 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 679/1358] 10.222.0.39 () {54 vars in 961 bytes} [Wed Jun 8 11:58:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 11:58:58.655752 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47950ed-3160-4e71-afc8-5a2366f8f7f6 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:58:58.656078 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47950ed-3160-4e71-afc8-5a2366f8f7f6 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:58:58.656495 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47950ed-3160-4e71-afc8-5a2366f8f7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:58:58.703576 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:58:58.715107 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-f47950ed-3160-4e71-afc8-5a2366f8f7f6 None None] MFA Rules not processed for user `7ef7edb5e9ce49e6b098f48bf060b228`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:58:58.716519 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f47950ed-3160-4e71-afc8-5a2366f8f7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:58:58.816197 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 680/1359] 10.222.0.39 () {58 vars in 1058 bytes} [Wed Jun 8 11:58:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 11:58:58.822435 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5561ea25-0245-4228-b3e2-2e045e82b497 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:58:58.837085 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5561ea25-0245-4228-b3e2-2e045e82b497 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:58:58.842468 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d873234d-1d95-4d95-b6f6-dee330889b4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef7edb5e9ce49e6b098f48bf060b228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:58:58.843394 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873234d-1d95-4d95-b6f6-dee330889b4b service nova] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:58:58.843796 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873234d-1d95-4d95-b6f6-dee330889b4b service nova] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:58:58.844080 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873234d-1d95-4d95-b6f6-dee330889b4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:58:58.853394 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d873234d-1d95-4d95-b6f6-dee330889b4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:58:58.855223 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d873234d-1d95-4d95-b6f6-dee330889b4b service nova] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:58:58.864939 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 680/1360] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 11:58:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 11:59:01.350282 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce386c0a-fa29-4586-8508-0c2d578fc067 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:01.352791 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce386c0a-fa29-4586-8508-0c2d578fc067 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:01.352791 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce386c0a-fa29-4586-8508-0c2d578fc067 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:01.353318 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 681/1361] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:59:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:59:01.358926 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be693e2c-4439-4728-b338-3e81594443d7 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:01.359363 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be693e2c-4439-4728-b338-3e81594443d7 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:01.359529 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be693e2c-4439-4728-b338-3e81594443d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:01.381279 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-be693e2c-4439-4728-b338-3e81594443d7 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:59:01.382497 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-be693e2c-4439-4728-b338-3e81594443d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:59:01.392045 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 681/1362] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:59:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 11:59:01.436429 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce386c0a-fa29-4586-8508-0c2d578fc067 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:59:01.451665 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce386c0a-fa29-4586-8508-0c2d578fc067 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:59:01.457207 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08b6ab-c774-44bc-9d6c-a0bf103743ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef7edb5e9ce49e6b098f48bf060b228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:59:01.457958 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08b6ab-c774-44bc-9d6c-a0bf103743ae service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:01.458352 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08b6ab-c774-44bc-9d6c-a0bf103743ae service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:01.458754 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08b6ab-c774-44bc-9d6c-a0bf103743ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:01.467805 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e08b6ab-c774-44bc-9d6c-a0bf103743ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:59:01.469788 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e08b6ab-c774-44bc-9d6c-a0bf103743ae service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:59:01.481191 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 682/1363] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 11:59:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 11:59:04.099278 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d3c98-526e-4956-8f33-3c4cecf8b5c3 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:04.100333 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d3c98-526e-4956-8f33-3c4cecf8b5c3 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:04.100864 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d3c98-526e-4956-8f33-3c4cecf8b5c3 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:04.102670 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 682/1364] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:59:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:59:04.107874 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f4d1c-5f3f-4e64-95c5-758c895f3942 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:04.108328 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f4d1c-5f3f-4e64-95c5-758c895f3942 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:04.108644 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f4d1c-5f3f-4e64-95c5-758c895f3942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:04.127502 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-f51f4d1c-5f3f-4e64-95c5-758c895f3942 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:59:04.128658 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f51f4d1c-5f3f-4e64-95c5-758c895f3942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:59:04.137199 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 683/1365] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:59:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 11:59:04.182126 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c86413-2543-4a08-bd38-54433576206e None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:04.182411 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c86413-2543-4a08-bd38-54433576206e None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:04.182684 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c86413-2543-4a08-bd38-54433576206e None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:04.184061 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 683/1366] 10.222.0.39 () {54 vars in 961 bytes} [Wed Jun 8 11:59:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:59:04.189384 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c872b0-a937-4cee-913e-fdb40267ee00 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:04.189740 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c872b0-a937-4cee-913e-fdb40267ee00 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:04.190026 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c872b0-a937-4cee-913e-fdb40267ee00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:04.209231 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-14c872b0-a937-4cee-913e-fdb40267ee00 None None] MFA Rules not processed for user `7ef7edb5e9ce49e6b098f48bf060b228`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:59:04.210397 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-14c872b0-a937-4cee-913e-fdb40267ee00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:59:04.221220 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 684/1367] 10.222.0.39 () {58 vars in 1058 bytes} [Wed Jun 8 11:59:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 11:59:04.231588 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c86413-2543-4a08-bd38-54433576206e None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:59:04.246112 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c86413-2543-4a08-bd38-54433576206e None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:59:04.251538 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd9839c-63af-4994-82e2-68e950b0cb24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef7edb5e9ce49e6b098f48bf060b228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:59:04.252198 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9839c-63af-4994-82e2-68e950b0cb24 service nova] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:04.252477 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9839c-63af-4994-82e2-68e950b0cb24 service nova] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:04.252751 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9839c-63af-4994-82e2-68e950b0cb24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:04.261482 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd9839c-63af-4994-82e2-68e950b0cb24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:59:04.263054 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd9839c-63af-4994-82e2-68e950b0cb24 service nova] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:59:04.272377 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 684/1368] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 11:59:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 11:59:06.660309 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079ba96-455b-4b50-afe5-3e18cc6ee4df None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:06.660841 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079ba96-455b-4b50-afe5-3e18cc6ee4df None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:06.660841 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079ba96-455b-4b50-afe5-3e18cc6ee4df None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:06.662280 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 685/1369] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:59:06.668479 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d9160-e2c6-4034-bb25-e4ce5e09ad84 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:06.668930 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d9160-e2c6-4034-bb25-e4ce5e09ad84 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:06.669045 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d9160-e2c6-4034-bb25-e4ce5e09ad84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:06.689066 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-727d9160-e2c6-4034-bb25-e4ce5e09ad84 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:59:06.690297 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-727d9160-e2c6-4034-bb25-e4ce5e09ad84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:59:06.699196 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 685/1370] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:59:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 11:59:06.745788 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a079ba96-455b-4b50-afe5-3e18cc6ee4df None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:59:06.761172 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a079ba96-455b-4b50-afe5-3e18cc6ee4df None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:59:06.766537 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460090f9-f359-4570-b1cf-cde3b1847a2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef7edb5e9ce49e6b098f48bf060b228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:59:06.767240 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460090f9-f359-4570-b1cf-cde3b1847a2b service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:06.767574 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460090f9-f359-4570-b1cf-cde3b1847a2b service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:06.767857 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460090f9-f359-4570-b1cf-cde3b1847a2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:06.777642 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460090f9-f359-4570-b1cf-cde3b1847a2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:59:06.779341 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460090f9-f359-4570-b1cf-cde3b1847a2b service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:59:06.791870 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 686/1371] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 11:59:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 11:59:06.914682 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12fe25-4160-4833-8c05-e1c611884879 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:06.914987 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12fe25-4160-4833-8c05-e1c611884879 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:06.915359 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12fe25-4160-4833-8c05-e1c611884879 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:06.917089 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 686/1372] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:59:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 11:59:06.925749 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85553e48-6445-4d49-bc0f-48c4e797281a None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:06.926869 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85553e48-6445-4d49-bc0f-48c4e797281a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:06.927712 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85553e48-6445-4d49-bc0f-48c4e797281a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:06.953856 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-85553e48-6445-4d49-bc0f-48c4e797281a None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:59:06.955877 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-85553e48-6445-4d49-bc0f-48c4e797281a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:59:06.971224 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 687/1373] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:59:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 11:59:07.290090 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a0edbd-60b9-4adf-ac2b-18252eaffac2 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:07.290090 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a0edbd-60b9-4adf-ac2b-18252eaffac2 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:07.290090 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a0edbd-60b9-4adf-ac2b-18252eaffac2 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:07.293284 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 687/1374] 10.222.0.39 () {54 vars in 963 bytes} [Wed Jun 8 11:59:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:59:07.298519 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9316b-fd86-4d30-a57b-4189585842e7 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:07.298813 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9316b-fd86-4d30-a57b-4189585842e7 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:07.299092 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9316b-fd86-4d30-a57b-4189585842e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:07.349318 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-51d9316b-fd86-4d30-a57b-4189585842e7 None None] MFA Rules not processed for user `a2d235956e984676be738414b948bde3`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:59:07.350518 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-51d9316b-fd86-4d30-a57b-4189585842e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:59:07.420102 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 688/1375] 10.222.0.39 () {58 vars in 1060 bytes} [Wed Jun 8 11:59:07 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 11:59:07.427798 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a0edbd-60b9-4adf-ac2b-18252eaffac2 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:59:07.439408 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a0edbd-60b9-4adf-ac2b-18252eaffac2 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:59:07.442935 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164c5542-23fa-47e7-99f1-cb9abe8a62b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:59:07.443666 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c5542-23fa-47e7-99f1-cb9abe8a62b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:07.444043 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c5542-23fa-47e7-99f1-cb9abe8a62b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:07.444411 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c5542-23fa-47e7-99f1-cb9abe8a62b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:07.454791 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164c5542-23fa-47e7-99f1-cb9abe8a62b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:59:07.456457 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164c5542-23fa-47e7-99f1-cb9abe8a62b1 service cinder] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:59:07.469929 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 688/1376] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 11:59:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 11:59:09.117115 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5af2dd-fac4-4073-b29b-31638483d78e None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:09.118240 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5af2dd-fac4-4073-b29b-31638483d78e None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:09.118696 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5af2dd-fac4-4073-b29b-31638483d78e None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:09.120091 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 689/1377] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:59:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:59:09.125635 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf7b1c-f2ba-4474-baa8-a6dd8a630eb2 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:09.126084 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf7b1c-f2ba-4474-baa8-a6dd8a630eb2 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:09.126194 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf7b1c-f2ba-4474-baa8-a6dd8a630eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:09.144612 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-cfbf7b1c-f2ba-4474-baa8-a6dd8a630eb2 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:59:09.145812 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-cfbf7b1c-f2ba-4474-baa8-a6dd8a630eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:59:09.154534 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 689/1378] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:59:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 11:59:09.201130 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5af2dd-fac4-4073-b29b-31638483d78e None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:59:09.218269 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5af2dd-fac4-4073-b29b-31638483d78e None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:59:09.223956 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245c34a-f6ff-49c7-9079-129f5a13e8e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef7edb5e9ce49e6b098f48bf060b228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:59:09.224652 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245c34a-f6ff-49c7-9079-129f5a13e8e9 service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:09.224935 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245c34a-f6ff-49c7-9079-129f5a13e8e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:09.225205 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245c34a-f6ff-49c7-9079-129f5a13e8e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:09.235081 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b245c34a-f6ff-49c7-9079-129f5a13e8e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:59:09.236745 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b245c34a-f6ff-49c7-9079-129f5a13e8e9 service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:59:09.241442 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:59:09.254378 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 690/1379] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 11:59:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 11:59:11.582031 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d65e50-02cc-48f6-a53d-963448b8ce90 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:11.582536 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d65e50-02cc-48f6-a53d-963448b8ce90 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:11.582641 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d65e50-02cc-48f6-a53d-963448b8ce90 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:11.588929 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 690/1380] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:59:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:59:11.595628 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a1115-3047-4c04-bc24-8ddddd507061 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:11.601668 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a1115-3047-4c04-bc24-8ddddd507061 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:11.601668 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a1115-3047-4c04-bc24-8ddddd507061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:11.618504 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-9f7a1115-3047-4c04-bc24-8ddddd507061 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:59:11.620349 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-9f7a1115-3047-4c04-bc24-8ddddd507061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:59:11.636217 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 691/1381] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:59:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 11:59:11.677793 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d65e50-02cc-48f6-a53d-963448b8ce90 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:59:11.693817 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d65e50-02cc-48f6-a53d-963448b8ce90 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:59:11.699716 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df0e17a-574b-4d9e-867b-5d775d486d44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef7edb5e9ce49e6b098f48bf060b228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:59:11.700537 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df0e17a-574b-4d9e-867b-5d775d486d44 service nova] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:11.700928 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df0e17a-574b-4d9e-867b-5d775d486d44 service nova] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:11.701497 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df0e17a-574b-4d9e-867b-5d775d486d44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:11.710598 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df0e17a-574b-4d9e-867b-5d775d486d44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:59:11.713045 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df0e17a-574b-4d9e-867b-5d775d486d44 service nova] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:59:11.723861 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 691/1382] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 11:59:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 11:59:14.048941 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53cbdd3-b46e-472f-aaf8-cd8dfe1980cc None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:14.049573 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53cbdd3-b46e-472f-aaf8-cd8dfe1980cc None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:14.049573 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53cbdd3-b46e-472f-aaf8-cd8dfe1980cc None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:14.050870 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 692/1383] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:59:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:59:14.056940 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0150397-3310-4fc7-86ee-5d843c7c737d None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:14.057359 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0150397-3310-4fc7-86ee-5d843c7c737d None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:14.057641 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0150397-3310-4fc7-86ee-5d843c7c737d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:14.076997 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-f0150397-3310-4fc7-86ee-5d843c7c737d None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:59:14.078280 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-f0150397-3310-4fc7-86ee-5d843c7c737d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:59:14.088213 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 692/1384] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:59:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 11:59:14.129488 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53cbdd3-b46e-472f-aaf8-cd8dfe1980cc None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:59:14.145254 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53cbdd3-b46e-472f-aaf8-cd8dfe1980cc None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:59:14.151055 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a553699-311b-48e9-874e-d59808787dd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef7edb5e9ce49e6b098f48bf060b228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:59:14.151704 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a553699-311b-48e9-874e-d59808787dd1 service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:14.151990 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a553699-311b-48e9-874e-d59808787dd1 service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:14.152301 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a553699-311b-48e9-874e-d59808787dd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:14.161183 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a553699-311b-48e9-874e-d59808787dd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:59:14.162773 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a553699-311b-48e9-874e-d59808787dd1 service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:59:14.173816 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 693/1385] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 11:59:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 11:59:16.675729 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231091f9-d8a6-4f7b-a5ca-f760922295ec None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:16.676304 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231091f9-d8a6-4f7b-a5ca-f760922295ec None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:16.676458 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231091f9-d8a6-4f7b-a5ca-f760922295ec None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:16.677837 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 693/1386] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:59:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:59:16.683525 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e723d63-0d7c-465e-b67f-e61fe49a0d00 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:16.683963 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e723d63-0d7c-465e-b67f-e61fe49a0d00 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:16.684086 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e723d63-0d7c-465e-b67f-e61fe49a0d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:16.702432 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-8e723d63-0d7c-465e-b67f-e61fe49a0d00 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:59:16.703623 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-8e723d63-0d7c-465e-b67f-e61fe49a0d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:59:16.713351 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 694/1387] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:59:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 11:59:16.757431 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231091f9-d8a6-4f7b-a5ca-f760922295ec None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:59:16.776748 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231091f9-d8a6-4f7b-a5ca-f760922295ec None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:59:16.783430 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f8c0dd-8b9c-47ff-97ce-2435cc38615a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef7edb5e9ce49e6b098f48bf060b228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:59:16.784327 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8c0dd-8b9c-47ff-97ce-2435cc38615a service nova] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:16.784690 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8c0dd-8b9c-47ff-97ce-2435cc38615a service nova] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:16.785049 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8c0dd-8b9c-47ff-97ce-2435cc38615a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:16.796461 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f8c0dd-8b9c-47ff-97ce-2435cc38615a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:59:16.798493 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f8c0dd-8b9c-47ff-97ce-2435cc38615a service nova] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:59:16.810556 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 694/1388] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 11:59:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 11:59:19.176146 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407fffb3-38a5-49c5-a3eb-8c9d354d9836 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:19.176700 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407fffb3-38a5-49c5-a3eb-8c9d354d9836 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:19.176795 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407fffb3-38a5-49c5-a3eb-8c9d354d9836 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:19.178171 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 695/1389] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:59:19.184746 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d083972-4455-4642-b627-c927678e7bf7 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:19.185258 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d083972-4455-4642-b627-c927678e7bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:19.185258 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d083972-4455-4642-b627-c927678e7bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:19.203726 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-8d083972-4455-4642-b627-c927678e7bf7 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:59:19.204975 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-8d083972-4455-4642-b627-c927678e7bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:59:19.213027 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 695/1390] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:59:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 11:59:19.259960 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407fffb3-38a5-49c5-a3eb-8c9d354d9836 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:59:19.277925 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407fffb3-38a5-49c5-a3eb-8c9d354d9836 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:59:19.283342 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c879d8f-d89b-4769-8557-98d009da0d19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef7edb5e9ce49e6b098f48bf060b228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:59:19.283986 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c879d8f-d89b-4769-8557-98d009da0d19 service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:19.284299 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c879d8f-d89b-4769-8557-98d009da0d19 service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:19.284583 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c879d8f-d89b-4769-8557-98d009da0d19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:19.293172 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c879d8f-d89b-4769-8557-98d009da0d19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:59:19.294753 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c879d8f-d89b-4769-8557-98d009da0d19 service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:59:19.304244 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 696/1391] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 11:59:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 11:59:22.000666 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19747174-fb11-4daf-a2ff-d897c227b299 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:22.001233 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19747174-fb11-4daf-a2ff-d897c227b299 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:22.001233 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19747174-fb11-4daf-a2ff-d897c227b299 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:22.002491 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 696/1392] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:59:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:59:22.008006 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d9ee9-42ec-4b93-ad0e-5bf2d0cb6348 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:22.009285 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d9ee9-42ec-4b93-ad0e-5bf2d0cb6348 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:22.009410 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d9ee9-42ec-4b93-ad0e-5bf2d0cb6348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:22.028111 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-581d9ee9-42ec-4b93-ad0e-5bf2d0cb6348 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:59:22.029333 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-581d9ee9-42ec-4b93-ad0e-5bf2d0cb6348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:59:22.036982 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 697/1393] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:59:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 11:59:22.081111 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19747174-fb11-4daf-a2ff-d897c227b299 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:59:22.096389 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19747174-fb11-4daf-a2ff-d897c227b299 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:59:22.101815 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7337c708-7c55-4df3-84c4-177ecf843ab7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef7edb5e9ce49e6b098f48bf060b228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:59:22.103162 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337c708-7c55-4df3-84c4-177ecf843ab7 service nova] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:22.103444 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337c708-7c55-4df3-84c4-177ecf843ab7 service nova] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:22.103717 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337c708-7c55-4df3-84c4-177ecf843ab7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:22.112093 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7337c708-7c55-4df3-84c4-177ecf843ab7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:59:22.113704 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7337c708-7c55-4df3-84c4-177ecf843ab7 service nova] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:59:22.124331 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 697/1394] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 11:59:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 11:59:23.313075 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122388b-3e5b-469b-96a1-f48af3c958b4 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:23.313613 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122388b-3e5b-469b-96a1-f48af3c958b4 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:23.313613 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122388b-3e5b-469b-96a1-f48af3c958b4 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:23.314983 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 698/1395] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:59:23.320395 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f86bc-2c2c-47fb-8a8c-e95b07853420 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:23.321403 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f86bc-2c2c-47fb-8a8c-e95b07853420 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:23.321511 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f86bc-2c2c-47fb-8a8c-e95b07853420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:23.327587 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=52 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:59:23.341853 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-e06f86bc-2c2c-47fb-8a8c-e95b07853420 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:59:23.343053 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-e06f86bc-2c2c-47fb-8a8c-e95b07853420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:59:23.351151 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 698/1396] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:59:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 11:59:23.407259 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d779cf7-b03a-41ed-9e52-7774a9b03e69 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:23.407550 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d779cf7-b03a-41ed-9e52-7774a9b03e69 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:23.407831 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d779cf7-b03a-41ed-9e52-7774a9b03e69 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:23.409231 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 699/1397] 10.222.0.39 () {54 vars in 962 bytes} [Wed Jun 8 11:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:59:23.414280 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b26a2-9193-4ad1-8845-84800df80671 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:23.415166 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b26a2-9193-4ad1-8845-84800df80671 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:23.415448 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b26a2-9193-4ad1-8845-84800df80671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:23.463622 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-889b26a2-9193-4ad1-8845-84800df80671 None None] MFA Rules not processed for user `2e2f8b5040a048c5bf4eef36f2ecd678`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:59:23.464908 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-889b26a2-9193-4ad1-8845-84800df80671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:59:23.525200 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 699/1398] 10.222.0.39 () {58 vars in 1059 bytes} [Wed Jun 8 11:59:23 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 11:59:23.532540 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d779cf7-b03a-41ed-9e52-7774a9b03e69 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:59:23.544066 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d779cf7-b03a-41ed-9e52-7774a9b03e69 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:59:23.547575 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3428b2e0-a5fa-4fc2-b207-9a458f964fc8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2f8b5040a048c5bf4eef36f2ecd678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:59:23.548331 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428b2e0-a5fa-4fc2-b207-9a458f964fc8 service glance] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:23.548674 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428b2e0-a5fa-4fc2-b207-9a458f964fc8 service glance] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:23.549015 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428b2e0-a5fa-4fc2-b207-9a458f964fc8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:23.558393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3428b2e0-a5fa-4fc2-b207-9a458f964fc8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:59:23.559817 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3428b2e0-a5fa-4fc2-b207-9a458f964fc8 service glance] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:59:23.569115 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 700/1399] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 11:59:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 11:59:24.113436 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375ab53-b861-4060-973c-814a012990da None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:24.114118 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375ab53-b861-4060-973c-814a012990da None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:24.114477 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375ab53-b861-4060-973c-814a012990da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:24.171214 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-b375ab53-b861-4060-973c-814a012990da None None] MFA Rules not processed for user `d52efc21c66d4300a8a979d92dbfeb47`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:59:24.172480 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-b375ab53-b861-4060-973c-814a012990da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:59:24.238574 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 700/1400] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Jun 8 11:59:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 11:59:24.283745 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a571f7-c3aa-46c2-84fe-a5f9f51baed9 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:24.284124 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a571f7-c3aa-46c2-84fe-a5f9f51baed9 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:24.284529 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a571f7-c3aa-46c2-84fe-a5f9f51baed9 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:24.285988 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 701/1401] 10.222.0.39 () {54 vars in 942 bytes} [Wed Jun 8 11:59:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:59:24.292577 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20469e-902b-45af-8cb9-b364bb505c0e None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:24.292871 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20469e-902b-45af-8cb9-b364bb505c0e None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:24.293153 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20469e-902b-45af-8cb9-b364bb505c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:24.350899 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-ae20469e-902b-45af-8cb9-b364bb505c0e None None] MFA Rules not processed for user `753bde6a72d64045abd3ad44b9b0de04`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:59:24.352188 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-ae20469e-902b-45af-8cb9-b364bb505c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:59:24.366047 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:59:24.441445 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 701/1402] 10.222.0.39 () {58 vars in 1039 bytes} [Wed Jun 8 11:59:24 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 11:59:24.452793 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a571f7-c3aa-46c2-84fe-a5f9f51baed9 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:59:24.467477 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a571f7-c3aa-46c2-84fe-a5f9f51baed9 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:59:24.473084 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e57d336-7193-4728-8272-f9e2b4ddf5a2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753bde6a72d64045abd3ad44b9b0de04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:59:24.473899 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e57d336-7193-4728-8272-f9e2b4ddf5a2 service swift] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:24.474186 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e57d336-7193-4728-8272-f9e2b4ddf5a2 service swift] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:24.474465 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e57d336-7193-4728-8272-f9e2b4ddf5a2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:24.485492 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e57d336-7193-4728-8272-f9e2b4ddf5a2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:59:24.486514 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4409f-1379-40bf-97a4-8d45c8266797 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:24.486806 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4409f-1379-40bf-97a4-8d45c8266797 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:24.487086 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4409f-1379-40bf-97a4-8d45c8266797 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:24.487721 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e57d336-7193-4728-8272-f9e2b4ddf5a2 service swift] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:59:24.488509 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 702/1403] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:59:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 11:59:24.494531 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728012a-6f3e-4aa5-a4a0-b2af174a18c2 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:24.494818 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728012a-6f3e-4aa5-a4a0-b2af174a18c2 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:24.495097 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728012a-6f3e-4aa5-a4a0-b2af174a18c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:24.500493 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 702/1404] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Jun 8 11:59:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 11:59:24.515939 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-f728012a-6f3e-4aa5-a4a0-b2af174a18c2 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:59:24.517271 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-f728012a-6f3e-4aa5-a4a0-b2af174a18c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:59:24.525844 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 703/1405] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:59:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 11:59:24.576031 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e57d336-7193-4728-8272-f9e2b4ddf5a2 service swift] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:59:24.589205 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e57d336-7193-4728-8272-f9e2b4ddf5a2 service swift] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:59:24.600212 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a277b10-590e-4aa5-84f5-b4454c792199 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef7edb5e9ce49e6b098f48bf060b228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:59:24.601081 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a277b10-590e-4aa5-84f5-b4454c792199 service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:24.601400 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a277b10-590e-4aa5-84f5-b4454c792199 service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:24.601775 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a277b10-590e-4aa5-84f5-b4454c792199 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:24.611996 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a277b10-590e-4aa5-84f5-b4454c792199 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:59:24.614277 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a277b10-590e-4aa5-84f5-b4454c792199 service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:59:24.626681 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 703/1406] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 11:59:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 11:59:27.082037 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e28526-8934-4ab0-b7b0-ba4bc9bb8798 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:27.082623 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e28526-8934-4ab0-b7b0-ba4bc9bb8798 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:27.082623 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e28526-8934-4ab0-b7b0-ba4bc9bb8798 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:27.084230 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 704/1407] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 11:59:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:59:27.089914 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16475c3-974a-4e5b-b1a2-079c391a6a82 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:27.090366 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16475c3-974a-4e5b-b1a2-079c391a6a82 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:27.090461 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16475c3-974a-4e5b-b1a2-079c391a6a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:27.109002 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-d16475c3-974a-4e5b-b1a2-079c391a6a82 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:59:27.110225 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-d16475c3-974a-4e5b-b1a2-079c391a6a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:59:27.118738 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 704/1408] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 11:59:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 11:59:27.162124 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e28526-8934-4ab0-b7b0-ba4bc9bb8798 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:59:27.177939 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e28526-8934-4ab0-b7b0-ba4bc9bb8798 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:59:27.189407 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2a15c-fef8-421d-ad67-cbd88d20d8d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef7edb5e9ce49e6b098f48bf060b228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:59:27.190002 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2a15c-fef8-421d-ad67-cbd88d20d8d3 service nova] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:27.190290 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2a15c-fef8-421d-ad67-cbd88d20d8d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:27.190571 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2a15c-fef8-421d-ad67-cbd88d20d8d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:27.200212 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa2a15c-fef8-421d-ad67-cbd88d20d8d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:59:27.201824 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa2a15c-fef8-421d-ad67-cbd88d20d8d3 service nova] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:59:27.211702 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 705/1409] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 11:59:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 11:59:37.103655 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=43 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:59:37.207617 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=33 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 11:59:48.184810 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2de504-02f1-494c-a6bc-a833cd596dfc None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:48.185413 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2de504-02f1-494c-a6bc-a833cd596dfc None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:48.185413 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2de504-02f1-494c-a6bc-a833cd596dfc None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:48.186753 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 705/1410] 10.222.0.39 () {54 vars in 918 bytes} [Wed Jun 8 11:59:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:59:48.191862 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e6d69-2ea5-49a1-b3c8-102773dae298 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:48.192341 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e6d69-2ea5-49a1-b3c8-102773dae298 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:48.192450 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e6d69-2ea5-49a1-b3c8-102773dae298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:48.210498 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-596e6d69-2ea5-49a1-b3c8-102773dae298 None None] MFA Rules not processed for user `e9009560a846414b849d42efa8625ff5`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:59:48.211680 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-596e6d69-2ea5-49a1-b3c8-102773dae298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:59:48.220044 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 706/1411] 10.222.0.39 () {58 vars in 1015 bytes} [Wed Jun 8 11:59:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 11:59:48.234684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72b2fd-fcfc-4192-bbfa-8e2d94f1e509 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:48.234973 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72b2fd-fcfc-4192-bbfa-8e2d94f1e509 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:48.235249 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72b2fd-fcfc-4192-bbfa-8e2d94f1e509 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:48.236645 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 706/1412] 10.222.0.39 () {54 vars in 918 bytes} [Wed Jun 8 11:59:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:59:48.241031 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9507b-281d-458a-b0e2-b5e16ace57dd None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:48.241320 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9507b-281d-458a-b0e2-b5e16ace57dd None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:48.241607 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9507b-281d-458a-b0e2-b5e16ace57dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:48.261585 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-4ed9507b-281d-458a-b0e2-b5e16ace57dd None None] MFA Rules not processed for user `7ef7edb5e9ce49e6b098f48bf060b228`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:59:48.262773 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-4ed9507b-281d-458a-b0e2-b5e16ace57dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:59:48.271697 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 707/1413] 10.222.0.39 () {58 vars in 1015 bytes} [Wed Jun 8 11:59:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 11:59:50.998894 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829459b3-98ba-4fc9-b536-87153bf81b9f None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:50.999395 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829459b3-98ba-4fc9-b536-87153bf81b9f None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:50.999492 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829459b3-98ba-4fc9-b536-87153bf81b9f None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:51.000881 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 707/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 11:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:59:51.006181 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c88a0-6c69-4d8f-a743-d6e56585c8b0 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:51.006584 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c88a0-6c69-4d8f-a743-d6e56585c8b0 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:51.006731 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c88a0-6c69-4d8f-a743-d6e56585c8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:51.025564 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-284c88a0-6c69-4d8f-a743-d6e56585c8b0 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:59:51.026733 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-284c88a0-6c69-4d8f-a743-d6e56585c8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:59:51.034335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 708/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 11:59:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 11:59:51.077006 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829459b3-98ba-4fc9-b536-87153bf81b9f None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:59:51.092466 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829459b3-98ba-4fc9-b536-87153bf81b9f None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:59:51.097909 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85125c8-2270-4134-8fbc-dc5d1923cbd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef7edb5e9ce49e6b098f48bf060b228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:59:51.098538 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85125c8-2270-4134-8fbc-dc5d1923cbd1 service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:51.098820 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85125c8-2270-4134-8fbc-dc5d1923cbd1 service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:51.099089 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85125c8-2270-4134-8fbc-dc5d1923cbd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:51.107295 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85125c8-2270-4134-8fbc-dc5d1923cbd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:59:51.108910 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85125c8-2270-4134-8fbc-dc5d1923cbd1 service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:59:51.118021 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 708/1416] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 11:59:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 11:59:52.109296 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e0c0b-5037-40cf-97b3-f4147e11425a None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:52.109839 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e0c0b-5037-40cf-97b3-f4147e11425a None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:52.109839 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e0c0b-5037-40cf-97b3-f4147e11425a None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:52.111290 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 709/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 8 11:59:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:59:52.116597 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa154f70-b9c8-4468-af0f-417399013fcf None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:52.117073 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa154f70-b9c8-4468-af0f-417399013fcf None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:52.117182 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa154f70-b9c8-4468-af0f-417399013fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:52.140575 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-aa154f70-b9c8-4468-af0f-417399013fcf None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:59:52.141773 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-aa154f70-b9c8-4468-af0f-417399013fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:59:52.150437 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 709/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 8 11:59:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 11:59:52.320625 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e0c0b-5037-40cf-97b3-f4147e11425a None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:59:52.335349 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e0c0b-5037-40cf-97b3-f4147e11425a None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:59:52.340735 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2a113-e17a-4b89-93e4-6f9177d88f73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef7edb5e9ce49e6b098f48bf060b228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:59:52.341373 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2a113-e17a-4b89-93e4-6f9177d88f73 service nova] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:52.341655 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2a113-e17a-4b89-93e4-6f9177d88f73 service nova] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:52.341928 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2a113-e17a-4b89-93e4-6f9177d88f73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:52.350057 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f2a113-e17a-4b89-93e4-6f9177d88f73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:59:52.351631 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f2a113-e17a-4b89-93e4-6f9177d88f73 service nova] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:59:52.361444 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 710/1419] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 11:59:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 11:59:53.302477 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63825126-7e42-4a28-aa19-64568eb0c0d7 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:53.302998 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63825126-7e42-4a28-aa19-64568eb0c0d7 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:53.302998 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63825126-7e42-4a28-aa19-64568eb0c0d7 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:53.304341 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 710/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 8 11:59:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:59:53.309494 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f29d4-eb06-4123-9cb3-a59cb6ff0ef0 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:53.309954 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f29d4-eb06-4123-9cb3-a59cb6ff0ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:53.310054 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f29d4-eb06-4123-9cb3-a59cb6ff0ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:53.328521 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-277f29d4-eb06-4123-9cb3-a59cb6ff0ef0 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:59:53.329704 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-277f29d4-eb06-4123-9cb3-a59cb6ff0ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:59:53.338271 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 711/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 8 11:59:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 11:59:53.494642 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63825126-7e42-4a28-aa19-64568eb0c0d7 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:59:53.509551 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63825126-7e42-4a28-aa19-64568eb0c0d7 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:59:53.514919 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f876e-8aec-4178-9d88-3da5d0dbd1a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef7edb5e9ce49e6b098f48bf060b228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:59:53.515564 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f876e-8aec-4178-9d88-3da5d0dbd1a3 service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:53.515847 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f876e-8aec-4178-9d88-3da5d0dbd1a3 service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:53.516125 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f876e-8aec-4178-9d88-3da5d0dbd1a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:53.524159 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8f876e-8aec-4178-9d88-3da5d0dbd1a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:59:53.526105 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8f876e-8aec-4178-9d88-3da5d0dbd1a3 service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:59:53.535359 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 711/1422] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 11:59:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 11:59:54.435551 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0a0db-3f9a-4b59-8720-cacfddb6ffdc None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:54.436158 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0a0db-3f9a-4b59-8720-cacfddb6ffdc None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:54.436158 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0a0db-3f9a-4b59-8720-cacfddb6ffdc None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:54.437599 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 712/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 8 11:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:59:54.442811 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b0f82-8483-4ce5-ae33-5587d369e648 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:54.443201 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b0f82-8483-4ce5-ae33-5587d369e648 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:54.443392 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b0f82-8483-4ce5-ae33-5587d369e648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:54.461597 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-ba9b0f82-8483-4ce5-ae33-5587d369e648 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:59:54.463069 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ba9b0f82-8483-4ce5-ae33-5587d369e648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:59:54.470722 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 712/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 8 11:59:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 11:59:54.622177 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e0a0db-3f9a-4b59-8720-cacfddb6ffdc None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:59:54.636076 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e0a0db-3f9a-4b59-8720-cacfddb6ffdc None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:59:54.641288 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324c7a3-22a8-4e2e-a285-abfa76748c01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef7edb5e9ce49e6b098f48bf060b228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:59:54.641939 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324c7a3-22a8-4e2e-a285-abfa76748c01 service nova] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:54.642220 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324c7a3-22a8-4e2e-a285-abfa76748c01 service nova] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:54.642491 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324c7a3-22a8-4e2e-a285-abfa76748c01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:54.650778 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3324c7a3-22a8-4e2e-a285-abfa76748c01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:59:54.652381 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3324c7a3-22a8-4e2e-a285-abfa76748c01 service nova] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:59:54.661438 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 713/1425] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 11:59:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 11:59:55.577486 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505fe49-c0b0-44a5-bbed-2051f72453ac None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:55.578034 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505fe49-c0b0-44a5-bbed-2051f72453ac None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:55.578034 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505fe49-c0b0-44a5-bbed-2051f72453ac None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:55.579389 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 713/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 8 11:59:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:59:55.584515 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad55f1-20e5-4067-a4ab-491419ee9644 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:55.584919 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad55f1-20e5-4067-a4ab-491419ee9644 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:55.585086 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad55f1-20e5-4067-a4ab-491419ee9644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:55.604035 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-e0ad55f1-20e5-4067-a4ab-491419ee9644 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:59:55.605285 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-e0ad55f1-20e5-4067-a4ab-491419ee9644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:59:55.613787 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 714/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 8 11:59:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 11:59:55.769298 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c505fe49-c0b0-44a5-bbed-2051f72453ac None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:59:55.784417 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c505fe49-c0b0-44a5-bbed-2051f72453ac None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:59:55.789781 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1143ae6-1370-4e66-8fee-da808c17306c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef7edb5e9ce49e6b098f48bf060b228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:59:55.791037 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1143ae6-1370-4e66-8fee-da808c17306c service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:55.791318 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1143ae6-1370-4e66-8fee-da808c17306c service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:55.791584 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1143ae6-1370-4e66-8fee-da808c17306c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:55.799846 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1143ae6-1370-4e66-8fee-da808c17306c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:59:55.801450 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1143ae6-1370-4e66-8fee-da808c17306c service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:59:55.810905 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 714/1428] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 11:59:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 11:59:56.660689 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd10b0b-587f-4dee-af2a-f91309849973 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:56.661242 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd10b0b-587f-4dee-af2a-f91309849973 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:56.661242 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd10b0b-587f-4dee-af2a-f91309849973 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:56.662605 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 715/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 8 11:59:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:59:56.668284 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdefad-7fee-4e43-bd67-178c2775ab86 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:56.668722 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdefad-7fee-4e43-bd67-178c2775ab86 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:56.668844 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdefad-7fee-4e43-bd67-178c2775ab86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:56.686786 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-c4cdefad-7fee-4e43-bd67-178c2775ab86 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:59:56.687996 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-c4cdefad-7fee-4e43-bd67-178c2775ab86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:59:56.695689 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 715/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 8 11:59:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 11:59:56.846278 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd10b0b-587f-4dee-af2a-f91309849973 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:59:56.860984 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd10b0b-587f-4dee-af2a-f91309849973 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:59:56.866195 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d71cc0-a402-4200-be30-0641beed4df7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef7edb5e9ce49e6b098f48bf060b228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:59:56.866821 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d71cc0-a402-4200-be30-0641beed4df7 service nova] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:56.867101 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d71cc0-a402-4200-be30-0641beed4df7 service nova] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:56.867372 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d71cc0-a402-4200-be30-0641beed4df7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:56.875376 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d71cc0-a402-4200-be30-0641beed4df7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:59:56.877036 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d71cc0-a402-4200-be30-0641beed4df7 service nova] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:59:56.887367 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 716/1431] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 11:59:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 11:59:57.752567 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8356ea5-1c37-451d-81f4-d8af8916f827 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:57.753113 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8356ea5-1c37-451d-81f4-d8af8916f827 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:57.753399 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8356ea5-1c37-451d-81f4-d8af8916f827 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:57.755514 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 716/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 8 11:59:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:59:57.761003 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358f229-eeb7-4e80-a4c1-9234d1011442 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:57.761419 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358f229-eeb7-4e80-a4c1-9234d1011442 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:57.761546 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358f229-eeb7-4e80-a4c1-9234d1011442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:57.779926 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-b358f229-eeb7-4e80-a4c1-9234d1011442 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:59:57.781180 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-b358f229-eeb7-4e80-a4c1-9234d1011442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:59:57.788965 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 717/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 8 11:59:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 11:59:57.937203 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8356ea5-1c37-451d-81f4-d8af8916f827 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:59:57.951921 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8356ea5-1c37-451d-81f4-d8af8916f827 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:59:57.957317 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0790c623-ff69-4f95-a22f-95b022c36467 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef7edb5e9ce49e6b098f48bf060b228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:59:57.957977 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790c623-ff69-4f95-a22f-95b022c36467 service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:57.958264 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790c623-ff69-4f95-a22f-95b022c36467 service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:57.958543 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790c623-ff69-4f95-a22f-95b022c36467 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:57.967267 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0790c623-ff69-4f95-a22f-95b022c36467 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:59:57.968892 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0790c623-ff69-4f95-a22f-95b022c36467 service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:59:57.978430 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 717/1434] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 11:59:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 11:59:58.824292 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42f78a-2446-4d13-9cec-5f8555e72da6 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:58.824834 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42f78a-2446-4d13-9cec-5f8555e72da6 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:58.824834 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42f78a-2446-4d13-9cec-5f8555e72da6 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:58.826210 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 718/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 8 11:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:59:58.831310 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a0e76-18e4-4e25-8084-fc4d0ede7b07 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:58.831714 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a0e76-18e4-4e25-8084-fc4d0ede7b07 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:58.831865 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a0e76-18e4-4e25-8084-fc4d0ede7b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:58.850473 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-ad6a0e76-18e4-4e25-8084-fc4d0ede7b07 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:59:58.851605 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ad6a0e76-18e4-4e25-8084-fc4d0ede7b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:59:58.859961 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 718/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 8 11:59:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 11:59:59.008692 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a42f78a-2446-4d13-9cec-5f8555e72da6 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 11:59:59.023753 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a42f78a-2446-4d13-9cec-5f8555e72da6 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 11:59:59.030431 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd51eb5-72be-4be9-8d22-5f7da7e22794 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef7edb5e9ce49e6b098f48bf060b228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 11:59:59.031322 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd51eb5-72be-4be9-8d22-5f7da7e22794 service nova] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:59.031607 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd51eb5-72be-4be9-8d22-5f7da7e22794 service nova] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:59.031880 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd51eb5-72be-4be9-8d22-5f7da7e22794 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:59.040360 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd51eb5-72be-4be9-8d22-5f7da7e22794 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 11:59:59.041921 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd51eb5-72be-4be9-8d22-5f7da7e22794 service nova] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 11:59:59.051125 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 719/1437] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 11:59:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 11:59:59.900395 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2877f6-c0b6-4c36-9187-6644f355a6e9 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:59.900970 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2877f6-c0b6-4c36-9187-6644f355a6e9 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:59.900970 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2877f6-c0b6-4c36-9187-6644f355a6e9 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:59.902366 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 719/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 8 11:59:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 11:59:59.907362 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c8d94-bf74-41cb-a2b3-b31b33383e84 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 11:59:59.907769 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c8d94-bf74-41cb-a2b3-b31b33383e84 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 11:59:59.907914 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c8d94-bf74-41cb-a2b3-b31b33383e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 11:59:59.926286 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-0c2c8d94-bf74-41cb-a2b3-b31b33383e84 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 11:59:59.927491 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-0c2c8d94-bf74-41cb-a2b3-b31b33383e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 11:59:59.935886 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 720/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 8 11:59:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:00:00.084955 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2877f6-c0b6-4c36-9187-6644f355a6e9 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:00:00.099738 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2877f6-c0b6-4c36-9187-6644f355a6e9 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:00:00.106064 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb658f2-b3ca-4ee9-9b89-a11383cab2aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef7edb5e9ce49e6b098f48bf060b228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:00:00.106724 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb658f2-b3ca-4ee9-9b89-a11383cab2aa service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:00:00.107006 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb658f2-b3ca-4ee9-9b89-a11383cab2aa service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:00:00.107275 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb658f2-b3ca-4ee9-9b89-a11383cab2aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:00:00.115303 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb658f2-b3ca-4ee9-9b89-a11383cab2aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:00:00.116915 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb658f2-b3ca-4ee9-9b89-a11383cab2aa service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:00:00.127088 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 720/1440] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:00:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:00:02.238593 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cdaa7-d655-400a-bf87-932f737cb028 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:00:02.239141 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cdaa7-d655-400a-bf87-932f737cb028 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:00:02.239141 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cdaa7-d655-400a-bf87-932f737cb028 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:00:02.240613 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 721/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 12:00:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:00:02.246399 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a652c-7809-4e8d-a1a0-3d02d9d526a1 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:00:02.246795 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a652c-7809-4e8d-a1a0-3d02d9d526a1 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:00:02.246952 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a652c-7809-4e8d-a1a0-3d02d9d526a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:00:02.264227 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-f15a652c-7809-4e8d-a1a0-3d02d9d526a1 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:00:02.265408 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f15a652c-7809-4e8d-a1a0-3d02d9d526a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:00:02.272971 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 721/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 12:00:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:00:02.311447 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8cdaa7-d655-400a-bf87-932f737cb028 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:00:02.322388 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8cdaa7-d655-400a-bf87-932f737cb028 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:00:02.325930 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b3b83c-064e-4442-931d-e00951b04839 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:00:02.326565 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3b83c-064e-4442-931d-e00951b04839 service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:00:02.326848 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3b83c-064e-4442-931d-e00951b04839 service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:00:02.327126 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3b83c-064e-4442-931d-e00951b04839 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:00:02.336072 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b3b83c-064e-4442-931d-e00951b04839 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:00:02.337582 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b3b83c-064e-4442-931d-e00951b04839 service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:00:02.347377 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 722/1443] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:00:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:00:04.767594 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26916e4-868a-4c98-b61e-6209f45833c6 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:00:04.768163 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26916e4-868a-4c98-b61e-6209f45833c6 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:00:04.768163 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26916e4-868a-4c98-b61e-6209f45833c6 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:00:04.769596 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 722/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 12:00:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:00:04.775474 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f292cd-00a3-465e-8185-fd49e41c566a None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:00:04.775918 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f292cd-00a3-465e-8185-fd49e41c566a None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:00:04.776026 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f292cd-00a3-465e-8185-fd49e41c566a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:00:04.793899 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-e0f292cd-00a3-465e-8185-fd49e41c566a None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:00:04.795092 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-e0f292cd-00a3-465e-8185-fd49e41c566a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:00:04.802733 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 723/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 12:00:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:00:04.840540 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26916e4-868a-4c98-b61e-6209f45833c6 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:00:04.851541 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26916e4-868a-4c98-b61e-6209f45833c6 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:00:04.855165 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cfeca0-e843-43ea-ae8d-33875722f0b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:00:04.855798 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfeca0-e843-43ea-ae8d-33875722f0b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:00:04.856079 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfeca0-e843-43ea-ae8d-33875722f0b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:00:04.856378 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfeca0-e843-43ea-ae8d-33875722f0b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:00:04.865100 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cfeca0-e843-43ea-ae8d-33875722f0b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:00:04.866524 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cfeca0-e843-43ea-ae8d-33875722f0b4 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:00:04.876278 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 723/1446] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:00:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:00:07.433692 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091cb3b-6410-4cc0-8228-dc67b41ab067 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:00:07.434235 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091cb3b-6410-4cc0-8228-dc67b41ab067 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:00:07.434235 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091cb3b-6410-4cc0-8228-dc67b41ab067 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:00:07.435652 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 724/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 12:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:00:07.440885 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4df58-2f03-4d28-9f63-ee49effea30c None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:00:07.441316 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4df58-2f03-4d28-9f63-ee49effea30c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:00:07.441456 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4df58-2f03-4d28-9f63-ee49effea30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:00:07.465170 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-f2f4df58-2f03-4d28-9f63-ee49effea30c None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:00:07.466837 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f2f4df58-2f03-4d28-9f63-ee49effea30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:00:07.475392 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 724/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 12:00:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:00:07.516354 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091cb3b-6410-4cc0-8228-dc67b41ab067 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:00:07.527530 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091cb3b-6410-4cc0-8228-dc67b41ab067 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:00:07.531022 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e0d775-9353-4088-809c-9aa19f57af01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:00:07.531654 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0d775-9353-4088-809c-9aa19f57af01 service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:00:07.531942 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0d775-9353-4088-809c-9aa19f57af01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:00:07.532248 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0d775-9353-4088-809c-9aa19f57af01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:00:07.541148 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e0d775-9353-4088-809c-9aa19f57af01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:00:07.542576 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e0d775-9353-4088-809c-9aa19f57af01 service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:00:07.551746 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 725/1449] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:00:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:00:09.951595 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba0a0a-7f4b-4afc-a9d0-e8e8500d96f6 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:00:09.952162 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba0a0a-7f4b-4afc-a9d0-e8e8500d96f6 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:00:09.952162 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba0a0a-7f4b-4afc-a9d0-e8e8500d96f6 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:00:09.953469 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 725/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 12:00:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:00:09.959032 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886086f-69b6-4780-853b-bc090f7008a0 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:00:09.959482 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886086f-69b6-4780-853b-bc090f7008a0 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:00:09.959587 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886086f-69b6-4780-853b-bc090f7008a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:00:09.978721 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-6886086f-69b6-4780-853b-bc090f7008a0 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:00:09.979904 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-6886086f-69b6-4780-853b-bc090f7008a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:00:09.987760 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 726/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 12:00:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:00:10.026567 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba0a0a-7f4b-4afc-a9d0-e8e8500d96f6 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:00:10.037038 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba0a0a-7f4b-4afc-a9d0-e8e8500d96f6 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:00:10.041019 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e96098-923f-46cb-95cb-08e8475c5315 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:00:10.041654 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e96098-923f-46cb-95cb-08e8475c5315 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:00:10.041935 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e96098-923f-46cb-95cb-08e8475c5315 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:00:10.042207 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e96098-923f-46cb-95cb-08e8475c5315 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:00:10.051670 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e96098-923f-46cb-95cb-08e8475c5315 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:00:10.053305 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e96098-923f-46cb-95cb-08e8475c5315 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:00:10.064849 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 726/1452] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:00:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:00:12.357156 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9c65a-15fc-4bb3-8e77-6dfaf21f7afb None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:00:12.357747 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9c65a-15fc-4bb3-8e77-6dfaf21f7afb None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:00:12.357747 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9c65a-15fc-4bb3-8e77-6dfaf21f7afb None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:00:12.359101 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 727/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 12:00:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:00:12.364280 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d27ca0-fe71-412f-a9ab-5cf518ddb643 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:00:12.364721 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d27ca0-fe71-412f-a9ab-5cf518ddb643 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:00:12.364841 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d27ca0-fe71-412f-a9ab-5cf518ddb643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:00:12.383744 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-e4d27ca0-fe71-412f-a9ab-5cf518ddb643 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:00:12.385969 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-e4d27ca0-fe71-412f-a9ab-5cf518ddb643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:00:12.393543 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 727/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 12:00:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:00:12.430633 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d9c65a-15fc-4bb3-8e77-6dfaf21f7afb None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:00:12.441740 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d9c65a-15fc-4bb3-8e77-6dfaf21f7afb None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:00:12.445263 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f92f1-5338-42c6-acea-1a66dc276157 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:00:12.445894 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f92f1-5338-42c6-acea-1a66dc276157 service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:00:12.446174 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f92f1-5338-42c6-acea-1a66dc276157 service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:00:12.446451 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f92f1-5338-42c6-acea-1a66dc276157 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:00:12.456439 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04f92f1-5338-42c6-acea-1a66dc276157 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:00:12.457858 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04f92f1-5338-42c6-acea-1a66dc276157 service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:00:12.467403 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 728/1455] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:00:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:00:14.767980 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f928dfd-ee10-45a3-9903-d842bb7abc0b None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:00:14.768572 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f928dfd-ee10-45a3-9903-d842bb7abc0b None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:00:14.768572 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f928dfd-ee10-45a3-9903-d842bb7abc0b None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:00:14.769950 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 728/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 12:00:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:00:14.775758 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e37df5-6984-4d37-a13b-04e3de8e2c93 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:00:14.776241 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e37df5-6984-4d37-a13b-04e3de8e2c93 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:00:14.776392 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e37df5-6984-4d37-a13b-04e3de8e2c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:00:14.794300 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-46e37df5-6984-4d37-a13b-04e3de8e2c93 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:00:14.795487 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-46e37df5-6984-4d37-a13b-04e3de8e2c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:00:14.803264 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 729/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 12:00:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:00:14.840702 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f928dfd-ee10-45a3-9903-d842bb7abc0b None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:00:14.851448 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f928dfd-ee10-45a3-9903-d842bb7abc0b None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:00:14.855759 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a97cc4-979b-4f24-bad9-886d3f8aad37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:00:14.856415 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a97cc4-979b-4f24-bad9-886d3f8aad37 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:00:14.856696 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a97cc4-979b-4f24-bad9-886d3f8aad37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:00:14.856967 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a97cc4-979b-4f24-bad9-886d3f8aad37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:00:14.865577 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a97cc4-979b-4f24-bad9-886d3f8aad37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:00:14.866992 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a97cc4-979b-4f24-bad9-886d3f8aad37 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:00:14.876799 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 729/1458] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:00:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:00:17.183273 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827ae5d-e010-41cf-badc-9df5e658430c None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:00:17.183829 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827ae5d-e010-41cf-badc-9df5e658430c None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:00:17.183829 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827ae5d-e010-41cf-badc-9df5e658430c None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:00:17.185238 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 730/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 12:00:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:00:17.190501 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0655a5-88ad-4253-ab79-7320e83be7f7 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:00:17.190940 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0655a5-88ad-4253-ab79-7320e83be7f7 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:00:17.191077 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0655a5-88ad-4253-ab79-7320e83be7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:00:17.197576 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=70 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:00:17.210473 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-3f0655a5-88ad-4253-ab79-7320e83be7f7 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:00:17.211685 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-3f0655a5-88ad-4253-ab79-7320e83be7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:00:17.220615 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 730/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 12:00:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:00:17.258362 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6827ae5d-e010-41cf-badc-9df5e658430c None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:00:17.264403 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=73 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:00:17.270553 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6827ae5d-e010-41cf-badc-9df5e658430c None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:00:17.273982 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60162002-5ec6-4186-83aa-8ff00c48cfb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:00:17.274623 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60162002-5ec6-4186-83aa-8ff00c48cfb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:00:17.275625 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60162002-5ec6-4186-83aa-8ff00c48cfb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:00:17.276050 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60162002-5ec6-4186-83aa-8ff00c48cfb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:00:17.284837 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60162002-5ec6-4186-83aa-8ff00c48cfb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:00:17.286257 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60162002-5ec6-4186-83aa-8ff00c48cfb2 service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:00:17.295907 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 731/1461] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:00:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:00:19.581124 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c725124-b28d-4c46-822c-c0c84c386bde None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:00:19.581674 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c725124-b28d-4c46-822c-c0c84c386bde None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:00:19.581674 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c725124-b28d-4c46-822c-c0c84c386bde None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:00:19.583064 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 731/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 12:00:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:00:19.588497 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f407e-c9f9-40a2-a4ce-1230672b2ddf None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:00:19.588961 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f407e-c9f9-40a2-a4ce-1230672b2ddf None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:00:19.589046 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f407e-c9f9-40a2-a4ce-1230672b2ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:00:19.607444 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-449f407e-c9f9-40a2-a4ce-1230672b2ddf None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:00:19.608667 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-449f407e-c9f9-40a2-a4ce-1230672b2ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:00:19.616274 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 732/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 12:00:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:00:19.653991 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c725124-b28d-4c46-822c-c0c84c386bde None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:00:19.664701 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c725124-b28d-4c46-822c-c0c84c386bde None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:00:19.668691 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a3dc5-0c8f-493d-823b-57a286a4c439 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:00:19.669327 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a3dc5-0c8f-493d-823b-57a286a4c439 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:00:19.669610 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a3dc5-0c8f-493d-823b-57a286a4c439 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:00:19.669885 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a3dc5-0c8f-493d-823b-57a286a4c439 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:00:19.678638 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168a3dc5-0c8f-493d-823b-57a286a4c439 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:00:19.680057 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168a3dc5-0c8f-493d-823b-57a286a4c439 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:00:19.690023 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 732/1464] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:00:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:00:21.960840 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808e05b-a8fe-426f-aaa5-957c4f39229d None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:00:21.961366 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808e05b-a8fe-426f-aaa5-957c4f39229d None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:00:21.961366 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808e05b-a8fe-426f-aaa5-957c4f39229d None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:00:21.962702 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 733/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 12:00:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:00:21.968043 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a398da-57e4-475e-b267-6f9df456120c None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:00:21.968522 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a398da-57e4-475e-b267-6f9df456120c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:00:21.968645 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a398da-57e4-475e-b267-6f9df456120c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:00:21.987012 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-88a398da-57e4-475e-b267-6f9df456120c None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:00:21.988247 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-88a398da-57e4-475e-b267-6f9df456120c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:00:21.996831 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 733/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 12:00:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:00:22.032889 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e808e05b-a8fe-426f-aaa5-957c4f39229d None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:00:22.044194 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e808e05b-a8fe-426f-aaa5-957c4f39229d None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:00:22.047778 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18353a8b-5b02-44aa-92e4-67cfa79c6e35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:00:22.048442 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18353a8b-5b02-44aa-92e4-67cfa79c6e35 service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:00:22.048730 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18353a8b-5b02-44aa-92e4-67cfa79c6e35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:00:22.049006 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18353a8b-5b02-44aa-92e4-67cfa79c6e35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:00:22.058019 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18353a8b-5b02-44aa-92e4-67cfa79c6e35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:00:22.059451 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18353a8b-5b02-44aa-92e4-67cfa79c6e35 service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:00:22.069618 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 734/1467] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:00:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:00:24.335162 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6a95c-0a8a-4e69-8b12-129e24adb2cf None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:00:24.335756 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6a95c-0a8a-4e69-8b12-129e24adb2cf None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:00:24.335756 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6a95c-0a8a-4e69-8b12-129e24adb2cf None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:00:24.337136 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 734/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 12:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:00:24.342460 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c6b17-fa50-499d-8901-df9d76f79d8d None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:00:24.342850 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c6b17-fa50-499d-8901-df9d76f79d8d None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:00:24.343028 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c6b17-fa50-499d-8901-df9d76f79d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:00:24.360881 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-6b6c6b17-fa50-499d-8901-df9d76f79d8d None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:00:24.362070 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-6b6c6b17-fa50-499d-8901-df9d76f79d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:00:24.370415 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 735/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 12:00:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:00:24.407628 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb6a95c-0a8a-4e69-8b12-129e24adb2cf None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:00:24.418286 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb6a95c-0a8a-4e69-8b12-129e24adb2cf None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:00:24.421777 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d735c-1fe8-4427-a415-f473eeec9228 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:00:24.422410 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d735c-1fe8-4427-a415-f473eeec9228 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:00:24.422693 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d735c-1fe8-4427-a415-f473eeec9228 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:00:24.422968 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d735c-1fe8-4427-a415-f473eeec9228 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:00:24.432202 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740d735c-1fe8-4427-a415-f473eeec9228 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:00:24.433619 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740d735c-1fe8-4427-a415-f473eeec9228 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:00:24.442824 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 735/1470] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:00:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:00:34.355815 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=17 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:00:34.438720 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=17 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:00:56.365867 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6073cb-74e9-44ef-8be2-ff6f406aef94 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:00:56.366475 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6073cb-74e9-44ef-8be2-ff6f406aef94 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:00:56.366475 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6073cb-74e9-44ef-8be2-ff6f406aef94 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:00:56.367787 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 736/1471] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 12:00:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:00:56.373750 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ec414-d516-4623-b28b-b6b50e130029 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:00:56.374188 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ec414-d516-4623-b28b-b6b50e130029 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:00:56.374294 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ec414-d516-4623-b28b-b6b50e130029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:00:56.392574 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-6f6ec414-d516-4623-b28b-b6b50e130029 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:00:56.393774 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-6f6ec414-d516-4623-b28b-b6b50e130029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:00:56.401460 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 736/1472] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 12:00:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:00:56.448857 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92383cf-f5e7-42e3-be15-10911b697a0a None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:00:56.449146 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92383cf-f5e7-42e3-be15-10911b697a0a None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:00:56.449425 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92383cf-f5e7-42e3-be15-10911b697a0a None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:00:56.450815 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 737/1473] 10.222.0.39 () {54 vars in 962 bytes} [Wed Jun 8 12:00:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 08 12:00:56.455597 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d8923-522b-4c0c-b3a2-d335d14dc791 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:00:56.455887 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d8923-522b-4c0c-b3a2-d335d14dc791 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:00:56.456246 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d8923-522b-4c0c-b3a2-d335d14dc791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:00:56.474557 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-315d8923-522b-4c0c-b3a2-d335d14dc791 None None] MFA Rules not processed for user `2e2f8b5040a048c5bf4eef36f2ecd678`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:00:56.475730 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-315d8923-522b-4c0c-b3a2-d335d14dc791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:00:56.483077 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 737/1474] 10.222.0.39 () {58 vars in 1059 bytes} [Wed Jun 8 12:00:56 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:00:56.490105 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92383cf-f5e7-42e3-be15-10911b697a0a None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:00:56.501274 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92383cf-f5e7-42e3-be15-10911b697a0a None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:00:56.504776 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480029f-1fb9-40d7-a0f2-f43a724297b9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2f8b5040a048c5bf4eef36f2ecd678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:00:56.505410 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480029f-1fb9-40d7-a0f2-f43a724297b9 service glance] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:00:56.505693 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480029f-1fb9-40d7-a0f2-f43a724297b9 service glance] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:00:56.505971 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480029f-1fb9-40d7-a0f2-f43a724297b9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:00:56.514957 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3480029f-1fb9-40d7-a0f2-f43a724297b9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:00:56.516533 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3480029f-1fb9-40d7-a0f2-f43a724297b9 service glance] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:00:56.526296 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 738/1475] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:00:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 12:00:58.846817 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2b07d-0179-4f7a-ac2c-271814aed2ff None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:00:58.847337 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2b07d-0179-4f7a-ac2c-271814aed2ff None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:00:58.847337 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2b07d-0179-4f7a-ac2c-271814aed2ff None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:00:58.848988 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 738/1476] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 12:00:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:00:58.855573 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63cb19-1ff6-4685-9769-67025ceeb72f None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:00:58.856020 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63cb19-1ff6-4685-9769-67025ceeb72f None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:00:58.856131 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63cb19-1ff6-4685-9769-67025ceeb72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:00:58.873814 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-6f63cb19-1ff6-4685-9769-67025ceeb72f None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:00:58.875033 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-6f63cb19-1ff6-4685-9769-67025ceeb72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:00:58.882851 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 739/1477] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 12:00:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:00:58.908918 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff2b07d-0179-4f7a-ac2c-271814aed2ff None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:00:58.922266 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff2b07d-0179-4f7a-ac2c-271814aed2ff None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:00:58.926721 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4783f7b-0d5d-4a5f-b3f7-c96572655c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:00:58.927364 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4783f7b-0d5d-4a5f-b3f7-c96572655c9b admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:00:58.927647 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4783f7b-0d5d-4a5f-b3f7-c96572655c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:00:58.927919 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4783f7b-0d5d-4a5f-b3f7-c96572655c9b admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:00:58.928673 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4783f7b-0d5d-4a5f-b3f7-c96572655c9b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:00:58.930407 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: WARNING py.warnings [None req-d4783f7b-0d5d-4a5f-b3f7-c96572655c9b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 08 12:00:58.930407 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: warnings.warn(msg) Jun 08 12:00:58.930407 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: Jun 08 12:00:58.931818 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4783f7b-0d5d-4a5f-b3f7-c96572655c9b admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:00:58.950813 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 739/1478] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Jun 8 12:00:58 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:01:01.234077 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d03959-fd33-4891-9e0a-fbe12a95be74 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:01:01.234650 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d03959-fd33-4891-9e0a-fbe12a95be74 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:01:01.234650 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d03959-fd33-4891-9e0a-fbe12a95be74 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:01:01.236004 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 740/1479] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 12:01:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:01:01.241238 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53977887-e641-4279-9ee8-30211e4a54d3 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:01:01.241670 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53977887-e641-4279-9ee8-30211e4a54d3 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:01:01.241775 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53977887-e641-4279-9ee8-30211e4a54d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:01:01.261570 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-53977887-e641-4279-9ee8-30211e4a54d3 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:01:01.262690 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-53977887-e641-4279-9ee8-30211e4a54d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:01:01.270480 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 740/1480] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 12:01:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:01:01.313954 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d03959-fd33-4891-9e0a-fbe12a95be74 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:01:01.328702 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d03959-fd33-4891-9e0a-fbe12a95be74 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:01:01.334106 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2fcaa-43e3-4ec9-89c9-3099ec355b88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef7edb5e9ce49e6b098f48bf060b228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:01:01.334756 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2fcaa-43e3-4ec9-89c9-3099ec355b88 service nova] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:01:01.335043 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2fcaa-43e3-4ec9-89c9-3099ec355b88 service nova] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:01:01.335319 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2fcaa-43e3-4ec9-89c9-3099ec355b88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:01:01.344657 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f2fcaa-43e3-4ec9-89c9-3099ec355b88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:01:01.346267 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f2fcaa-43e3-4ec9-89c9-3099ec355b88 service nova] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:01:01.356640 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 741/1481] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:01:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:01:03.754509 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53758a-133f-4d5b-acf2-06a5909b02f4 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:01:03.755097 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53758a-133f-4d5b-acf2-06a5909b02f4 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:01:03.755097 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53758a-133f-4d5b-acf2-06a5909b02f4 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:01:03.756464 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 741/1482] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 12:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:01:03.762389 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1bb93-229f-4364-af1b-6c6390fa2fbb None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:01:03.762847 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1bb93-229f-4364-af1b-6c6390fa2fbb None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:01:03.762960 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1bb93-229f-4364-af1b-6c6390fa2fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:01:03.781847 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-98a1bb93-229f-4364-af1b-6c6390fa2fbb None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:01:03.783050 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-98a1bb93-229f-4364-af1b-6c6390fa2fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:01:03.790850 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 742/1483] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 12:01:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:01:03.826831 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53758a-133f-4d5b-acf2-06a5909b02f4 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:01:03.837932 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53758a-133f-4d5b-acf2-06a5909b02f4 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:01:03.841530 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939022bb-dcb1-42ea-ad87-93d81beef8f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:01:03.842198 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939022bb-dcb1-42ea-ad87-93d81beef8f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:01:03.842480 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939022bb-dcb1-42ea-ad87-93d81beef8f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:01:03.842755 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939022bb-dcb1-42ea-ad87-93d81beef8f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:01:03.851774 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939022bb-dcb1-42ea-ad87-93d81beef8f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:01:03.853208 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939022bb-dcb1-42ea-ad87-93d81beef8f6 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:01:03.862378 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 742/1484] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:01:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:01:06.180218 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf23ba9-d13f-4578-bdaa-7c7f2ed93ae4 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:01:06.180758 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf23ba9-d13f-4578-bdaa-7c7f2ed93ae4 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:01:06.180758 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf23ba9-d13f-4578-bdaa-7c7f2ed93ae4 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:01:06.182307 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 743/1485] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 12:01:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:01:06.187482 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf94d4b-ef16-4579-b969-e02daaba216a None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:01:06.187874 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf94d4b-ef16-4579-b969-e02daaba216a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:01:06.188026 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf94d4b-ef16-4579-b969-e02daaba216a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:01:06.206411 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-0bf94d4b-ef16-4579-b969-e02daaba216a None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:01:06.207591 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-0bf94d4b-ef16-4579-b969-e02daaba216a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:01:06.216422 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 743/1486] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 12:01:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:01:06.254714 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf23ba9-d13f-4578-bdaa-7c7f2ed93ae4 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:01:06.265957 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf23ba9-d13f-4578-bdaa-7c7f2ed93ae4 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:01:06.269442 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5377cd-b0c9-4834-9db5-cb67ce7c67e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:01:06.270072 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5377cd-b0c9-4834-9db5-cb67ce7c67e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:01:06.270356 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5377cd-b0c9-4834-9db5-cb67ce7c67e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:01:06.270632 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5377cd-b0c9-4834-9db5-cb67ce7c67e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:01:06.279368 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5377cd-b0c9-4834-9db5-cb67ce7c67e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:01:06.280825 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5377cd-b0c9-4834-9db5-cb67ce7c67e2 service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:01:06.290107 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 744/1487] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:01:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:01:08.725120 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032ed5a-e664-4540-8dd7-ae77bdbf79f1 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:01:08.725696 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032ed5a-e664-4540-8dd7-ae77bdbf79f1 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:01:08.725696 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032ed5a-e664-4540-8dd7-ae77bdbf79f1 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:01:08.727043 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 744/1488] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 12:01:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:01:08.732371 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516a95c-8a59-4146-ba1e-b7ecebb3e39c None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:01:08.732798 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516a95c-8a59-4146-ba1e-b7ecebb3e39c None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:01:08.732905 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516a95c-8a59-4146-ba1e-b7ecebb3e39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:01:08.750672 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-f516a95c-8a59-4146-ba1e-b7ecebb3e39c None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:01:08.751846 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-f516a95c-8a59-4146-ba1e-b7ecebb3e39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:01:08.760019 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 745/1489] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 12:01:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:01:08.800211 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2032ed5a-e664-4540-8dd7-ae77bdbf79f1 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:01:08.811803 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2032ed5a-e664-4540-8dd7-ae77bdbf79f1 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:01:08.815321 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71f6a8-6595-4412-af76-1881fb589eb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:01:08.815961 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71f6a8-6595-4412-af76-1881fb589eb7 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:01:08.816280 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71f6a8-6595-4412-af76-1881fb589eb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:01:08.816561 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71f6a8-6595-4412-af76-1881fb589eb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:01:08.826163 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c71f6a8-6595-4412-af76-1881fb589eb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:01:08.827594 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c71f6a8-6595-4412-af76-1881fb589eb7 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:01:08.836882 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 745/1490] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:01:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:01:11.272274 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284bc62-7419-4800-a987-fc6fe2264eaf None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:01:11.272836 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284bc62-7419-4800-a987-fc6fe2264eaf None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:01:11.272836 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284bc62-7419-4800-a987-fc6fe2264eaf None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:01:11.274180 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 746/1491] 10.222.0.39 () {54 vars in 926 bytes} [Wed Jun 8 12:01:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:01:11.279706 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3f14f-e300-493e-9462-0111940e9e7e None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:01:11.280194 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3f14f-e300-493e-9462-0111940e9e7e None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:01:11.280306 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3f14f-e300-493e-9462-0111940e9e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:01:11.298102 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-ddc3f14f-e300-493e-9462-0111940e9e7e None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:01:11.299277 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ddc3f14f-e300-493e-9462-0111940e9e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:01:11.306844 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 746/1492] 10.222.0.39 () {58 vars in 1023 bytes} [Wed Jun 8 12:01:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:01:11.346186 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c284bc62-7419-4800-a987-fc6fe2264eaf None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:01:11.357163 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c284bc62-7419-4800-a987-fc6fe2264eaf None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:01:11.360707 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06682ec-e0d2-4cc5-a105-934e1b297520 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:01:11.361350 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06682ec-e0d2-4cc5-a105-934e1b297520 service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:01:11.361632 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06682ec-e0d2-4cc5-a105-934e1b297520 service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:01:11.361907 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06682ec-e0d2-4cc5-a105-934e1b297520 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:01:11.370965 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06682ec-e0d2-4cc5-a105-934e1b297520 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:01:11.372423 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06682ec-e0d2-4cc5-a105-934e1b297520 service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:01:11.381677 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 747/1493] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:01:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:01:21.293129 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=33 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:01:21.377590 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=33 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:02:57.253601 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6b636-3631-4817-9654-3cfcce1223f4 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:02:57.254196 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6b636-3631-4817-9654-3cfcce1223f4 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:02:57.254196 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6b636-3631-4817-9654-3cfcce1223f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:02:57.272603 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-e5a6b636-3631-4817-9654-3cfcce1223f4 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:02:57.273797 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-e5a6b636-3631-4817-9654-3cfcce1223f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:02:57.281596 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 747/1494] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:02:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:02:57.289510 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107c8c3-5ee7-4099-a4c8-0e0c1d68d163 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:02:57.289992 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107c8c3-5ee7-4099-a4c8-0e0c1d68d163 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:02:57.290091 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107c8c3-5ee7-4099-a4c8-0e0c1d68d163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:02:57.307569 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-8107c8c3-5ee7-4099-a4c8-0e0c1d68d163 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:02:57.308991 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-8107c8c3-5ee7-4099-a4c8-0e0c1d68d163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:02:57.317427 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 748/1495] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:02:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:02:57.322341 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a6b636-3631-4817-9654-3cfcce1223f4 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:02:57.333345 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a6b636-3631-4817-9654-3cfcce1223f4 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:02:57.337758 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f0f11-4e2a-45b4-ada2-d8afb660c94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:02:57.338452 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f0f11-4e2a-45b4-ada2-d8afb660c94e admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:02:57.338736 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f0f11-4e2a-45b4-ada2-d8afb660c94e admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:02:57.339014 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f0f11-4e2a-45b4-ada2-d8afb660c94e admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:02:57.339743 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f0f11-4e2a-45b4-ada2-d8afb660c94e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:02:57.340071 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f0f11-4e2a-45b4-ada2-d8afb660c94e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:02:57.341123 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: WARNING py.warnings [None req-928f0f11-4e2a-45b4-ada2-d8afb660c94e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 08 12:02:57.341123 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: warnings.warn(msg) Jun 08 12:02:57.341123 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: Jun 08 12:02:57.342219 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f0f11-4e2a-45b4-ada2-d8afb660c94e admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:02:57.354109 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 748/1496] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:02:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:02:57.362481 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107c8c3-5ee7-4099-a4c8-0e0c1d68d163 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:02:57.372018 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107c8c3-5ee7-4099-a4c8-0e0c1d68d163 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:02:57.377900 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a723c-0283-4ede-acb7-fdb576abf36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:02:57.378410 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a723c-0283-4ede-acb7-fdb576abf36b admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:02:57.378674 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a723c-0283-4ede-acb7-fdb576abf36b admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:02:57.378948 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a723c-0283-4ede-acb7-fdb576abf36b admin admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:02:57.379647 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a723c-0283-4ede-acb7-fdb576abf36b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:02:57.381438 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: WARNING py.warnings [None req-e86a723c-0283-4ede-acb7-fdb576abf36b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 08 12:02:57.381438 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: warnings.warn(msg) Jun 08 12:02:57.381438 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: Jun 08 12:02:57.382766 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a723c-0283-4ede-acb7-fdb576abf36b admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:02:57.422277 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 749/1497] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:02:57 2022] POST /identity/v3/projects => generated 379 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:02:57.426651 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f0f11-4e2a-45b4-ada2-d8afb660c94e admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:02:57.436875 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f0f11-4e2a-45b4-ada2-d8afb660c94e admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:02:57.490230 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f8f64-ddb3-4e89-89ea-c729228ebfce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:02:57.490889 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f8f64-ddb3-4e89-89ea-c729228ebfce admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:02:57.491172 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f8f64-ddb3-4e89-89ea-c729228ebfce admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:02:57.491443 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f8f64-ddb3-4e89-89ea-c729228ebfce admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:02:57.492129 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283f8f64-ddb3-4e89-89ea-c729228ebfce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:02:57.493161 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: WARNING py.warnings [None req-283f8f64-ddb3-4e89-89ea-c729228ebfce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 08 12:02:57.493161 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: warnings.warn(msg) Jun 08 12:02:57.493161 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: Jun 08 12:02:57.494350 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283f8f64-ddb3-4e89-89ea-c729228ebfce admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:02:57.514508 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 749/1498] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:02:57 2022] POST /identity/v3/users => generated 290 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:02:57.518589 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a723c-0283-4ede-acb7-fdb576abf36b admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:02:57.528438 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a723c-0283-4ede-acb7-fdb576abf36b admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:02:57.533107 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dac0fd-f099-4c15-a634-f5d5f67217d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:02:57.533787 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dac0fd-f099-4c15-a634-f5d5f67217d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:02:57.534067 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dac0fd-f099-4c15-a634-f5d5f67217d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:02:57.534339 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dac0fd-f099-4c15-a634-f5d5f67217d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:02:57.535080 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dac0fd-f099-4c15-a634-f5d5f67217d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:02:57.536082 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: WARNING py.warnings [None req-58dac0fd-f099-4c15-a634-f5d5f67217d3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 08 12:02:57.536082 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: warnings.warn(msg) Jun 08 12:02:57.536082 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: Jun 08 12:02:57.536979 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dac0fd-f099-4c15-a634-f5d5f67217d3 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:02:57.550300 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 750/1499] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:02:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:02:57.554183 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f8f64-ddb3-4e89-89ea-c729228ebfce admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:02:57.564602 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f8f64-ddb3-4e89-89ea-c729228ebfce admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:02:57.569149 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a4bd5-a503-4b3a-9347-8a8d4352faf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:02:57.569806 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a4bd5-a503-4b3a-9347-8a8d4352faf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:02:57.570095 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a4bd5-a503-4b3a-9347-8a8d4352faf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:02:57.570373 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a4bd5-a503-4b3a-9347-8a8d4352faf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:02:57.571132 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07a4bd5-a503-4b3a-9347-8a8d4352faf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:02:57.572148 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: WARNING py.warnings [None req-e07a4bd5-a503-4b3a-9347-8a8d4352faf1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 08 12:02:57.572148 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: warnings.warn(msg) Jun 08 12:02:57.572148 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: Jun 08 12:02:57.573106 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07a4bd5-a503-4b3a-9347-8a8d4352faf1 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:02:57.586688 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 750/1500] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:02:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:02:57.594139 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dac0fd-f099-4c15-a634-f5d5f67217d3 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:02:57.607649 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dac0fd-f099-4c15-a634-f5d5f67217d3 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:02:57.612419 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d4ed2-4551-4de7-b9e3-b9808c2f320f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:02:57.613385 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d4ed2-4551-4de7-b9e3-b9808c2f320f admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:02:57.613676 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d4ed2-4551-4de7-b9e3-b9808c2f320f admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:02:57.613962 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d4ed2-4551-4de7-b9e3-b9808c2f320f admin admin] PATH_INFO: `/v3/projects/b892ff44dcf94239b5d35aa42e3b70e6/users/47fd48a84c9d4612a3ca092531a2d086/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:02:57.630896 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d4ed2-4551-4de7-b9e3-b9808c2f320f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b892ff44dcf94239b5d35aa42e3b70e6, user_id=47fd48a84c9d4612a3ca092531a2d086, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:02:57.631948 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: WARNING py.warnings [None req-a64d4ed2-4551-4de7-b9e3-b9808c2f320f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 08 12:02:57.631948 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: warnings.warn(msg) Jun 08 12:02:57.631948 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: Jun 08 12:02:57.633929 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d4ed2-4551-4de7-b9e3-b9808c2f320f admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:02:57.646775 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 751/1501] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:02:57 2022] PUT /identity/v3/projects/b892ff44dcf94239b5d35aa42e3b70e6/users/47fd48a84c9d4612a3ca092531a2d086/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:02:57.659116 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fec81-fcf8-4425-932e-f4fe555eeaa8 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:02:57.659410 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fec81-fcf8-4425-932e-f4fe555eeaa8 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:02:57.659689 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fec81-fcf8-4425-932e-f4fe555eeaa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:02:57.693112 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-876fec81-fcf8-4425-932e-f4fe555eeaa8 None None] MFA Rules not processed for user `47fd48a84c9d4612a3ca092531a2d086`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:02:57.696759 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-876fec81-fcf8-4425-932e-f4fe555eeaa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:02:57.765751 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 751/1502] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:02:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:02:57.778887 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe60cd-270d-47fa-80fa-eccf750dea65 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:02:57.779919 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe60cd-270d-47fa-80fa-eccf750dea65 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:02:57.780314 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe60cd-270d-47fa-80fa-eccf750dea65 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:02:57.781677 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 752/1503] 10.222.0.39 () {54 vars in 963 bytes} [Wed Jun 8 12:02:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:02:57.786299 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9fd30-9d1c-4184-9f56-d691e615020d None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:02:57.786591 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9fd30-9d1c-4184-9f56-d691e615020d None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:02:57.786876 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9fd30-9d1c-4184-9f56-d691e615020d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:02:57.804249 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-4db9fd30-9d1c-4184-9f56-d691e615020d None None] MFA Rules not processed for user `a2d235956e984676be738414b948bde3`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:02:57.805448 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-4db9fd30-9d1c-4184-9f56-d691e615020d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:02:57.848247 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:02:57.856930 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 752/1504] 10.222.0.39 () {58 vars in 1060 bytes} [Wed Jun 8 12:02:57 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:02:57.864555 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe60cd-270d-47fa-80fa-eccf750dea65 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:02:57.875191 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe60cd-270d-47fa-80fa-eccf750dea65 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:02:57.878645 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d0ec6-340f-49cb-9b78-501bc19db357 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:02:57.879273 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d0ec6-340f-49cb-9b78-501bc19db357 service cinder] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:02:57.879556 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d0ec6-340f-49cb-9b78-501bc19db357 service cinder] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:02:57.879829 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d0ec6-340f-49cb-9b78-501bc19db357 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:02:57.887849 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93d0ec6-340f-49cb-9b78-501bc19db357 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:02:57.889916 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93d0ec6-340f-49cb-9b78-501bc19db357 service cinder] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:02:57.898931 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 753/1505] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:02:57 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:02:57.941280 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9192b31-d201-4b15-82cd-7ae471d8e660 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:02:57.941586 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9192b31-d201-4b15-82cd-7ae471d8e660 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:02:57.941867 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9192b31-d201-4b15-82cd-7ae471d8e660 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:02:57.943142 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 753/1506] 10.222.0.39 () {52 vars in 829 bytes} [Wed Jun 8 12:02:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:02:57.946750 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d0ec6-340f-49cb-9b78-501bc19db357 service cinder] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:02:58.011243 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d0ec6-340f-49cb-9b78-501bc19db357 service cinder] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:02:58.016845 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e4d6c-5298-4ca1-a329-24c975a3b30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:02:58.017879 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e4d6c-5298-4ca1-a329-24c975a3b30e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:02:58.018154 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e4d6c-5298-4ca1-a329-24c975a3b30e admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:02:58.018427 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e4d6c-5298-4ca1-a329-24c975a3b30e admin admin] PATH_INFO: `/v3/users/47fd48a84c9d4612a3ca092531a2d086` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:02:58.019614 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150e4d6c-5298-4ca1-a329-24c975a3b30e admin admin] RBAC: Authorizing `identity:delete_user(user_id=47fd48a84c9d4612a3ca092531a2d086)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:02:58.020674 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: WARNING py.warnings [None req-150e4d6c-5298-4ca1-a329-24c975a3b30e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 08 12:02:58.020674 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: warnings.warn(msg) Jun 08 12:02:58.020674 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: Jun 08 12:02:58.021969 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150e4d6c-5298-4ca1-a329-24c975a3b30e admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:02:58.088415 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-150e4d6c-5298-4ca1-a329-24c975a3b30e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47fd48a84c9d4612a3ca092531a2d086'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:02:58.100652 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-150e4d6c-5298-4ca1-a329-24c975a3b30e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47fd48a84c9d4612a3ca092531a2d086'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:02:58.101359 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-150e4d6c-5298-4ca1-a329-24c975a3b30e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47fd48a84c9d4612a3ca092531a2d086'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:02:58.101975 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-150e4d6c-5298-4ca1-a329-24c975a3b30e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47fd48a84c9d4612a3ca092531a2d086'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:02:58.119967 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-150e4d6c-5298-4ca1-a329-24c975a3b30e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47fd48a84c9d4612a3ca092531a2d086'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:02:58.124938 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:02:58.138871 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 754/1507] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:02:57 2022] DELETE /identity/v3/users/47fd48a84c9d4612a3ca092531a2d086 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:02:58.143380 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe96af-de0c-4c4c-8c72-5ea6e80d904b None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:02:58.143757 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe96af-de0c-4c4c-8c72-5ea6e80d904b None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:02:58.144068 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe96af-de0c-4c4c-8c72-5ea6e80d904b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:02:58.161856 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-eabe96af-de0c-4c4c-8c72-5ea6e80d904b None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:02:58.163049 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-eabe96af-de0c-4c4c-8c72-5ea6e80d904b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:02:58.220480 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 754/1508] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:02:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:02:58.236436 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e4d6c-5298-4ca1-a329-24c975a3b30e admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:02:58.237825 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-150e4d6c-5298-4ca1-a329-24c975a3b30e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:02:58.300553 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e4d6c-5298-4ca1-a329-24c975a3b30e admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:02:58.300553 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d1fd9d-5234-41b0-8c4c-e580c55e8589 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:02:58.301343 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1fd9d-5234-41b0-8c4c-e580c55e8589 service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:02:58.301343 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1fd9d-5234-41b0-8c4c-e580c55e8589 service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:02:58.301516 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1fd9d-5234-41b0-8c4c-e580c55e8589 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:02:58.311535 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d1fd9d-5234-41b0-8c4c-e580c55e8589 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:02:58.313007 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d1fd9d-5234-41b0-8c4c-e580c55e8589 service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:02:58.322583 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 755/1509] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:02:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:02:58.673115 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe96af-de0c-4c4c-8c72-5ea6e80d904b None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:02:58.674677 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-eabe96af-de0c-4c4c-8c72-5ea6e80d904b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:02:58.687295 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe96af-de0c-4c4c-8c72-5ea6e80d904b None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:02:58.691797 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013fdb11-cf7a-48a4-9fd2-ebc0161426da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:02:58.692692 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013fdb11-cf7a-48a4-9fd2-ebc0161426da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:02:58.697719 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013fdb11-cf7a-48a4-9fd2-ebc0161426da admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:02:58.698009 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013fdb11-cf7a-48a4-9fd2-ebc0161426da admin admin] PATH_INFO: `/v3/projects/b892ff44dcf94239b5d35aa42e3b70e6` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:02:58.699239 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013fdb11-cf7a-48a4-9fd2-ebc0161426da admin admin] RBAC: Authorizing `identity:delete_project(project_id=b892ff44dcf94239b5d35aa42e3b70e6)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:02:58.700328 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: WARNING py.warnings [None req-013fdb11-cf7a-48a4-9fd2-ebc0161426da admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 08 12:02:58.700328 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: warnings.warn(msg) Jun 08 12:02:58.700328 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: Jun 08 12:02:58.702624 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013fdb11-cf7a-48a4-9fd2-ebc0161426da admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:02:58.764989 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-013fdb11-cf7a-48a4-9fd2-ebc0161426da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b892ff44dcf94239b5d35aa42e3b70e6', 'request_id': 'req-013fdb11-cf7a-48a4-9fd2-ebc0161426da'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:02:58.774625 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-013fdb11-cf7a-48a4-9fd2-ebc0161426da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b892ff44dcf94239b5d35aa42e3b70e6', 'request_id': 'req-013fdb11-cf7a-48a4-9fd2-ebc0161426da'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:02:58.780947 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-013fdb11-cf7a-48a4-9fd2-ebc0161426da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b892ff44dcf94239b5d35aa42e3b70e6', 'request_id': 'req-013fdb11-cf7a-48a4-9fd2-ebc0161426da'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:02:58.799381 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-013fdb11-cf7a-48a4-9fd2-ebc0161426da admin admin] The token cache is being invalidate because project b892ff44dcf94239b5d35aa42e3b70e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:02:58.799672 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-013fdb11-cf7a-48a4-9fd2-ebc0161426da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:02:58.800351 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-013fdb11-cf7a-48a4-9fd2-ebc0161426da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:02:58.801997 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 755/1510] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:02:58 2022] DELETE /identity/v3/projects/b892ff44dcf94239b5d35aa42e3b70e6 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:03:08.318250 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:03:08.796300 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:04:35.322097 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f1a6e-3054-4d98-950d-0c8473e130cc None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:04:35.322687 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f1a6e-3054-4d98-950d-0c8473e130cc None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:04:35.322687 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f1a6e-3054-4d98-950d-0c8473e130cc None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:04:35.324080 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 756/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 8 12:04:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:04:35.328908 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf98a37-6170-4f25-9132-e1b0ffaef834 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:04:35.329370 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf98a37-6170-4f25-9132-e1b0ffaef834 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:04:35.329477 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf98a37-6170-4f25-9132-e1b0ffaef834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:04:35.347058 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-0cf98a37-6170-4f25-9132-e1b0ffaef834 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:04:35.348322 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-0cf98a37-6170-4f25-9132-e1b0ffaef834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:04:35.407699 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 756/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 8 12:04:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:04:35.577055 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f1a6e-3054-4d98-950d-0c8473e130cc None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:04:35.578769 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-4f8f1a6e-3054-4d98-950d-0c8473e130cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:04:35.652701 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f1a6e-3054-4d98-950d-0c8473e130cc None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:04:35.658085 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49beed4-839b-4860-aed8-d1e936a46638 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef7edb5e9ce49e6b098f48bf060b228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:04:35.658674 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49beed4-839b-4860-aed8-d1e936a46638 service nova] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:04:35.658958 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49beed4-839b-4860-aed8-d1e936a46638 service nova] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:04:35.659235 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49beed4-839b-4860-aed8-d1e936a46638 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:04:35.667173 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49beed4-839b-4860-aed8-d1e936a46638 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:04:35.669484 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49beed4-839b-4860-aed8-d1e936a46638 service nova] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:04:35.678748 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 757/1513] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:04:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:04:36.554063 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a26a60-9928-4733-bf35-f3b8fe5b384c None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:04:36.554646 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a26a60-9928-4733-bf35-f3b8fe5b384c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:04:36.554646 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a26a60-9928-4733-bf35-f3b8fe5b384c None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:04:36.556033 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 757/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 8 12:04:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:04:36.560873 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f1d07-3deb-47de-a5a9-de210ead2054 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:04:36.561288 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f1d07-3deb-47de-a5a9-de210ead2054 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:04:36.561427 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f1d07-3deb-47de-a5a9-de210ead2054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:04:36.579511 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-3e9f1d07-3deb-47de-a5a9-de210ead2054 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:04:36.580740 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-3e9f1d07-3deb-47de-a5a9-de210ead2054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:04:36.588398 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 758/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 8 12:04:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:04:36.739868 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a26a60-9928-4733-bf35-f3b8fe5b384c None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:04:36.755439 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a26a60-9928-4733-bf35-f3b8fe5b384c None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:04:36.760784 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3050a-2c81-40a9-b47e-193a297fdbc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef7edb5e9ce49e6b098f48bf060b228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:04:36.762064 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3050a-2c81-40a9-b47e-193a297fdbc6 service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:04:36.762472 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3050a-2c81-40a9-b47e-193a297fdbc6 service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:04:36.762916 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3050a-2c81-40a9-b47e-193a297fdbc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:04:36.772719 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c3050a-2c81-40a9-b47e-193a297fdbc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:04:36.774354 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c3050a-2c81-40a9-b47e-193a297fdbc6 service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:04:36.784832 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 758/1516] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:04:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:04:37.134042 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0196c-c94f-47db-9958-7dc495052af9 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:04:37.134338 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0196c-c94f-47db-9958-7dc495052af9 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:04:37.134620 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0196c-c94f-47db-9958-7dc495052af9 None None] PATH_INFO: `/v3` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:04:37.135935 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 759/1517] 10.222.0.17 () {54 vars in 925 bytes} [Wed Jun 8 12:04:37 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:04:37.141846 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81f08e-d27a-45c1-907a-7d567315c72e None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:04:37.142138 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81f08e-d27a-45c1-907a-7d567315c72e None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:04:37.142436 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81f08e-d27a-45c1-907a-7d567315c72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:04:37.160502 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-bd81f08e-d27a-45c1-907a-7d567315c72e None None] MFA Rules not processed for user `e9009560a846414b849d42efa8625ff5`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:04:37.161675 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-bd81f08e-d27a-45c1-907a-7d567315c72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:04:37.222497 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 759/1518] 10.222.0.17 () {58 vars in 1015 bytes} [Wed Jun 8 12:04:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:04:41.270682 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb3019-9e1d-4b64-888b-249c9f79c239 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:04:41.271224 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb3019-9e1d-4b64-888b-249c9f79c239 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:04:41.271224 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb3019-9e1d-4b64-888b-249c9f79c239 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:04:41.272543 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 760/1519] 10.222.0.39 () {54 vars in 960 bytes} [Wed Jun 8 12:04:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:04:41.278325 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53b322-62f8-472c-a908-1d1a7f6399df None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:04:41.278819 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53b322-62f8-472c-a908-1d1a7f6399df None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:04:41.278934 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53b322-62f8-472c-a908-1d1a7f6399df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:04:41.296742 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-9a53b322-62f8-472c-a908-1d1a7f6399df None None] MFA Rules not processed for user `e9009560a846414b849d42efa8625ff5`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:04:41.297929 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-9a53b322-62f8-472c-a908-1d1a7f6399df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:04:41.306290 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 760/1520] 10.222.0.39 () {58 vars in 1057 bytes} [Wed Jun 8 12:04:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:04:41.314122 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb3019-9e1d-4b64-888b-249c9f79c239 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:04:41.327710 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb3019-9e1d-4b64-888b-249c9f79c239 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:04:41.332610 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1e8dc-43df-454a-b64c-2f262a3409c5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9009560a846414b849d42efa8625ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:04:41.333353 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1e8dc-43df-454a-b64c-2f262a3409c5 service placement] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:04:41.333639 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1e8dc-43df-454a-b64c-2f262a3409c5 service placement] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:04:41.333911 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1e8dc-43df-454a-b64c-2f262a3409c5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:04:41.342747 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f1e8dc-43df-454a-b64c-2f262a3409c5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:04:41.344408 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f1e8dc-43df-454a-b64c-2f262a3409c5 service placement] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:04:41.353831 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 761/1521] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:04:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:04:48.044132 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b669cb-38ea-48a5-92bc-d67f6ac5e029 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:04:48.044737 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b669cb-38ea-48a5-92bc-d67f6ac5e029 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:04:48.044737 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b669cb-38ea-48a5-92bc-d67f6ac5e029 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:04:48.046003 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 761/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 8 12:04:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:04:48.050774 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112950f-99ea-49eb-b8e6-092e388b3f6a None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:04:48.051225 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112950f-99ea-49eb-b8e6-092e388b3f6a None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:04:48.051332 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112950f-99ea-49eb-b8e6-092e388b3f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:04:48.069490 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-2112950f-99ea-49eb-b8e6-092e388b3f6a None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:04:48.070684 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-2112950f-99ea-49eb-b8e6-092e388b3f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:04:48.078570 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 762/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 8 12:04:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:04:48.235866 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b669cb-38ea-48a5-92bc-d67f6ac5e029 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:04:48.250880 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b669cb-38ea-48a5-92bc-d67f6ac5e029 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:04:48.256154 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2d85b7-c58c-451f-9a3f-add1f2fc859e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef7edb5e9ce49e6b098f48bf060b228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:04:48.256812 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d85b7-c58c-451f-9a3f-add1f2fc859e service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:04:48.257093 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d85b7-c58c-451f-9a3f-add1f2fc859e service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:04:48.257389 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d85b7-c58c-451f-9a3f-add1f2fc859e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:04:48.265464 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2d85b7-c58c-451f-9a3f-add1f2fc859e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:04:48.267046 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2d85b7-c58c-451f-9a3f-add1f2fc859e service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:04:48.276244 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 762/1524] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:04:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:04:49.158205 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311e341-d274-49e3-979f-190020c8f1b4 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:04:49.158682 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311e341-d274-49e3-979f-190020c8f1b4 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:04:49.158787 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311e341-d274-49e3-979f-190020c8f1b4 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:04:49.160151 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 763/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 8 12:04:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:04:49.165139 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0f308-731e-4859-83bf-dbc20ad8ac72 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:04:49.165573 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0f308-731e-4859-83bf-dbc20ad8ac72 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:04:49.165702 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0f308-731e-4859-83bf-dbc20ad8ac72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:04:49.184131 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-ddb0f308-731e-4859-83bf-dbc20ad8ac72 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:04:49.185374 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ddb0f308-731e-4859-83bf-dbc20ad8ac72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:04:49.193014 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 763/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 8 12:04:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:04:49.346064 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311e341-d274-49e3-979f-190020c8f1b4 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:04:49.360751 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311e341-d274-49e3-979f-190020c8f1b4 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:04:49.366156 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38edc8e2-98d1-4512-a191-1ed15d915a2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef7edb5e9ce49e6b098f48bf060b228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:04:49.366816 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38edc8e2-98d1-4512-a191-1ed15d915a2e service nova] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:04:49.367102 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38edc8e2-98d1-4512-a191-1ed15d915a2e service nova] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:04:49.367379 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38edc8e2-98d1-4512-a191-1ed15d915a2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:04:49.376222 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38edc8e2-98d1-4512-a191-1ed15d915a2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:04:49.377815 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38edc8e2-98d1-4512-a191-1ed15d915a2e service nova] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:04:49.387910 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 764/1527] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:04:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:04:53.405840 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df989625-15e0-4ad6-bd27-6efbf69fcc94 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:04:53.406372 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df989625-15e0-4ad6-bd27-6efbf69fcc94 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:04:53.406372 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df989625-15e0-4ad6-bd27-6efbf69fcc94 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:04:53.407676 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 764/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 12:04:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:04:53.413010 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd235b2-c0dc-4fcf-9cd7-21c4e179fcee None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:04:53.413469 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd235b2-c0dc-4fcf-9cd7-21c4e179fcee None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:04:53.413575 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd235b2-c0dc-4fcf-9cd7-21c4e179fcee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:04:53.431796 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-7bd235b2-c0dc-4fcf-9cd7-21c4e179fcee None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:04:53.433678 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-7bd235b2-c0dc-4fcf-9cd7-21c4e179fcee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:04:53.441418 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 765/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 12:04:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:04:53.477006 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df989625-15e0-4ad6-bd27-6efbf69fcc94 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:04:53.478718 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-df989625-15e0-4ad6-bd27-6efbf69fcc94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:04:53.535790 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df989625-15e0-4ad6-bd27-6efbf69fcc94 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:04:53.539494 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0479367-8e1e-4fb8-9391-8355c5226bb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:04:53.540384 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0479367-8e1e-4fb8-9391-8355c5226bb4 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:04:53.540666 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0479367-8e1e-4fb8-9391-8355c5226bb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:04:53.541017 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0479367-8e1e-4fb8-9391-8355c5226bb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:04:53.551759 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0479367-8e1e-4fb8-9391-8355c5226bb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:04:53.553270 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0479367-8e1e-4fb8-9391-8355c5226bb4 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:04:53.558940 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:04:53.563960 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 765/1530] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:04:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:04:55.778341 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7bd911-f154-4b4b-af78-a182ea62670e None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:04:55.778875 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7bd911-f154-4b4b-af78-a182ea62670e None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:04:55.779007 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7bd911-f154-4b4b-af78-a182ea62670e None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:04:55.780371 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 766/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 12:04:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:04:55.785820 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c4af2-b68b-4357-99bc-795a5a3e9175 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:04:55.786242 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c4af2-b68b-4357-99bc-795a5a3e9175 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:04:55.786379 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c4af2-b68b-4357-99bc-795a5a3e9175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:04:55.805072 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-5d9c4af2-b68b-4357-99bc-795a5a3e9175 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:04:55.806276 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-5d9c4af2-b68b-4357-99bc-795a5a3e9175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:04:55.814081 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 766/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 12:04:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:04:55.849708 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7bd911-f154-4b4b-af78-a182ea62670e None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:04:55.861203 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7bd911-f154-4b4b-af78-a182ea62670e None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:04:55.864641 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b459e132-b4bd-40cc-810a-02d9c9f1dd20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:04:55.865276 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459e132-b4bd-40cc-810a-02d9c9f1dd20 service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:04:55.865557 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459e132-b4bd-40cc-810a-02d9c9f1dd20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:04:55.865832 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459e132-b4bd-40cc-810a-02d9c9f1dd20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:04:55.874638 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b459e132-b4bd-40cc-810a-02d9c9f1dd20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:04:55.876055 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b459e132-b4bd-40cc-810a-02d9c9f1dd20 service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:04:55.885242 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 767/1533] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:04:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:04:59.605970 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38151323-85b8-49e4-aa62-fb29ddcbf265 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:04:59.606391 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38151323-85b8-49e4-aa62-fb29ddcbf265 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:04:59.606516 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38151323-85b8-49e4-aa62-fb29ddcbf265 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:04:59.607889 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 767/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 12:04:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:04:59.613389 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc84e82-4c94-40bb-99d7-69b9f67fdc44 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:04:59.613796 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc84e82-4c94-40bb-99d7-69b9f67fdc44 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:04:59.613948 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc84e82-4c94-40bb-99d7-69b9f67fdc44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:04:59.620729 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=62 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:04:59.633290 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-cdc84e82-4c94-40bb-99d7-69b9f67fdc44 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:04:59.634489 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-cdc84e82-4c94-40bb-99d7-69b9f67fdc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:04:59.642619 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 768/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 12:04:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:04:59.918302 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38151323-85b8-49e4-aa62-fb29ddcbf265 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:04:59.919974 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-38151323-85b8-49e4-aa62-fb29ddcbf265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:04:59.977653 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38151323-85b8-49e4-aa62-fb29ddcbf265 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:04:59.983765 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da98065-1d97-4685-b9c6-a78bf931b740 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:04:59.984454 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da98065-1d97-4685-b9c6-a78bf931b740 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:04:59.984740 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da98065-1d97-4685-b9c6-a78bf931b740 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:04:59.985018 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da98065-1d97-4685-b9c6-a78bf931b740 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:04:59.994116 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da98065-1d97-4685-b9c6-a78bf931b740 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:04:59.995718 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da98065-1d97-4685-b9c6-a78bf931b740 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:05:00.005031 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 768/1536] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:04:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:05:02.266921 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97ba1f-dcd3-40fe-b862-fc0ee2eea287 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:05:02.267469 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97ba1f-dcd3-40fe-b862-fc0ee2eea287 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:05:02.267469 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97ba1f-dcd3-40fe-b862-fc0ee2eea287 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:05:02.268917 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 769/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 8 12:05:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:05:02.274248 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba03a02-bc4c-4ddb-86cd-47822c922cf8 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:05:02.274670 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba03a02-bc4c-4ddb-86cd-47822c922cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:05:02.274808 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba03a02-bc4c-4ddb-86cd-47822c922cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:05:02.292699 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-9ba03a02-bc4c-4ddb-86cd-47822c922cf8 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:05:02.293895 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-9ba03a02-bc4c-4ddb-86cd-47822c922cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:05:02.301633 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 769/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 8 12:05:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:05:02.582589 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf97ba1f-dcd3-40fe-b862-fc0ee2eea287 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:05:02.584497 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-cf97ba1f-dcd3-40fe-b862-fc0ee2eea287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:05:02.597730 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf97ba1f-dcd3-40fe-b862-fc0ee2eea287 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:05:02.601327 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d312e19-2af7-40bb-80d8-8d870dc67ea3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:05:02.601971 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d312e19-2af7-40bb-80d8-8d870dc67ea3 service cinder] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:05:02.602258 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d312e19-2af7-40bb-80d8-8d870dc67ea3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:05:02.602539 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d312e19-2af7-40bb-80d8-8d870dc67ea3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:05:02.612909 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d312e19-2af7-40bb-80d8-8d870dc67ea3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:05:02.614415 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d312e19-2af7-40bb-80d8-8d870dc67ea3 service cinder] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:05:02.624630 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 770/1539] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:05:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 12:05:12.287318 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=32 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:05:12.619924 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=8 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:06:31.576316 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97d850-5ebe-47ba-a53e-2ae2071e1341 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:31.576914 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97d850-5ebe-47ba-a53e-2ae2071e1341 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:31.576914 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97d850-5ebe-47ba-a53e-2ae2071e1341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:31.607457 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-ef97d850-5ebe-47ba-a53e-2ae2071e1341 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:31.608844 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ef97d850-5ebe-47ba-a53e-2ae2071e1341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:31.614342 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce30e81-3ba5-45f2-a907-1ab9ace8368f None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:31.615308 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce30e81-3ba5-45f2-a907-1ab9ace8368f None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:31.615846 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce30e81-3ba5-45f2-a907-1ab9ace8368f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:31.627958 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 770/1540] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:06:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:06:31.645759 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-3ce30e81-3ba5-45f2-a907-1ab9ace8368f None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:31.647341 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-3ce30e81-3ba5-45f2-a907-1ab9ace8368f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:31.653059 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaed12f-b5d2-4304-8569-663a8ca1a1ac None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:31.653348 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaed12f-b5d2-4304-8569-663a8ca1a1ac None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:31.653625 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaed12f-b5d2-4304-8569-663a8ca1a1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:31.661337 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 771/1541] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:06:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:06:31.670970 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba7e30-679e-40c8-8e79-e3b14818ed74 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:31.671593 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba7e30-679e-40c8-8e79-e3b14818ed74 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:31.672118 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba7e30-679e-40c8-8e79-e3b14818ed74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:31.688193 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-beaed12f-b5d2-4304-8569-663a8ca1a1ac None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:31.688193 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-beaed12f-b5d2-4304-8569-663a8ca1a1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:31.699385 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 771/1542] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:06:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:06:31.700860 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7a7c1-1158-47e6-9963-7c8078c6438c None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:31.701151 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7a7c1-1158-47e6-9963-7c8078c6438c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:31.701429 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7a7c1-1158-47e6-9963-7c8078c6438c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:31.702159 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-05ba7e30-679e-40c8-8e79-e3b14818ed74 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:31.703717 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-05ba7e30-679e-40c8-8e79-e3b14818ed74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:31.716795 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 772/1543] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:06:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:06:31.717952 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba7e30-679e-40c8-8e79-e3b14818ed74 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:31.733185 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-2fc7a7c1-1158-47e6-9963-7c8078c6438c None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:31.734549 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-2fc7a7c1-1158-47e6-9963-7c8078c6438c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:31.734933 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba7e30-679e-40c8-8e79-e3b14818ed74 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:31.740203 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9816d0b-6da4-40fe-87d8-c53817c23c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:31.741126 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9816d0b-6da4-40fe-87d8-c53817c23c3b admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:31.741625 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9816d0b-6da4-40fe-87d8-c53817c23c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:31.746147 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9816d0b-6da4-40fe-87d8-c53817c23c3b admin admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:31.747425 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9816d0b-6da4-40fe-87d8-c53817c23c3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:06:31.747977 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9816d0b-6da4-40fe-87d8-c53817c23c3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:31.749382 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: WARNING py.warnings [None req-c9816d0b-6da4-40fe-87d8-c53817c23c3b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 08 12:06:31.749382 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: warnings.warn(msg) Jun 08 12:06:31.749382 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: Jun 08 12:06:31.750731 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9816d0b-6da4-40fe-87d8-c53817c23c3b admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:31.757203 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 772/1544] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:06:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:06:31.764315 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc7a7c1-1158-47e6-9963-7c8078c6438c None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:31.771823 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 773/1545] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:06:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:06:31.772910 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc7a7c1-1158-47e6-9963-7c8078c6438c None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:31.773760 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781c990-60e1-41ef-9889-f146cc17f610 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:31.774308 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781c990-60e1-41ef-9889-f146cc17f610 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:31.775328 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781c990-60e1-41ef-9889-f146cc17f610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:31.788882 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84503cf-b176-4099-a2c7-9feb34ab4987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:31.789573 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84503cf-b176-4099-a2c7-9feb34ab4987 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:31.789857 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84503cf-b176-4099-a2c7-9feb34ab4987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:31.790198 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84503cf-b176-4099-a2c7-9feb34ab4987 admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:31.790943 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84503cf-b176-4099-a2c7-9feb34ab4987 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:06:31.791351 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84503cf-b176-4099-a2c7-9feb34ab4987 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:31.793206 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84503cf-b176-4099-a2c7-9feb34ab4987 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:31.803577 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-3781c990-60e1-41ef-9889-f146cc17f610 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:31.805312 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-3781c990-60e1-41ef-9889-f146cc17f610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:31.807548 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 773/1546] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:06:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:06:31.808934 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b6861-2f30-497d-a270-587428694bd3 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:31.809231 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b6861-2f30-497d-a270-587428694bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:31.809544 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b6861-2f30-497d-a270-587428694bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:31.818395 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 774/1547] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:06:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:06:31.820470 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c88c00-fa08-4572-9553-64535056aa00 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:31.820761 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c88c00-fa08-4572-9553-64535056aa00 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:31.821038 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c88c00-fa08-4572-9553-64535056aa00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:31.829541 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-7c8b6861-2f30-497d-a270-587428694bd3 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:31.830756 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-7c8b6861-2f30-497d-a270-587428694bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:31.839918 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 774/1548] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:06:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:06:31.841309 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5b741-ad27-4c44-a808-f6ea3e26680b None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:31.841602 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5b741-ad27-4c44-a808-f6ea3e26680b None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:31.841880 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5b741-ad27-4c44-a808-f6ea3e26680b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:31.849330 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-e1c88c00-fa08-4572-9553-64535056aa00 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:31.850841 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-e1c88c00-fa08-4572-9553-64535056aa00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:31.859852 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 775/1549] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:06:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:06:31.860924 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c88c00-fa08-4572-9553-64535056aa00 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:31.869268 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-0cb5b741-ad27-4c44-a808-f6ea3e26680b None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:31.870500 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-0cb5b741-ad27-4c44-a808-f6ea3e26680b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:31.872442 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c88c00-fa08-4572-9553-64535056aa00 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:31.878152 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5fb6ea-8257-4098-8a43-643262d471bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:31.879115 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fb6ea-8257-4098-8a43-643262d471bc admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:31.879639 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fb6ea-8257-4098-8a43-643262d471bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:31.880229 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fb6ea-8257-4098-8a43-643262d471bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:31.881142 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5fb6ea-8257-4098-8a43-643262d471bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:31.882068 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 775/1550] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:06:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:06:31.882871 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5b741-ad27-4c44-a808-f6ea3e26680b None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:31.883909 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5fb6ea-8257-4098-8a43-643262d471bc admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:31.895866 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5b741-ad27-4c44-a808-f6ea3e26680b None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:31.902478 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97de15-6359-4de6-ac8d-21113fff24b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:31.903567 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97de15-6359-4de6-ac8d-21113fff24b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:31.903913 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97de15-6359-4de6-ac8d-21113fff24b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:31.904368 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97de15-6359-4de6-ac8d-21113fff24b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:31.905426 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb97de15-6359-4de6-ac8d-21113fff24b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:31.907173 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: WARNING py.warnings [None req-fb97de15-6359-4de6-ac8d-21113fff24b1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 08 12:06:31.907173 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: warnings.warn(msg) Jun 08 12:06:31.907173 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: Jun 08 12:06:31.909317 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb97de15-6359-4de6-ac8d-21113fff24b1 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:31.916975 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 776/1551] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:06:31 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:06:31.918618 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec6ece-e94d-4190-b3de-8facab345830 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:31.919143 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec6ece-e94d-4190-b3de-8facab345830 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:31.919596 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec6ece-e94d-4190-b3de-8facab345830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:31.939142 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-76ec6ece-e94d-4190-b3de-8facab345830 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:31.940645 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-76ec6ece-e94d-4190-b3de-8facab345830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:31.944356 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 776/1552] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:06:31 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:06:31.944356 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97de15-6359-4de6-ac8d-21113fff24b1 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:32.006644 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97de15-6359-4de6-ac8d-21113fff24b1 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:32.008660 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 777/1553] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:06:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:06:32.010971 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7484d-67a7-4e8a-997c-85c1a2a5541f None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:32.011261 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7484d-67a7-4e8a-997c-85c1a2a5541f None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:32.011534 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7484d-67a7-4e8a-997c-85c1a2a5541f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:32.015252 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc7600-ad31-4bf6-ba9a-f652026e8bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:32.015919 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc7600-ad31-4bf6-ba9a-f652026e8bec admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:32.016225 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc7600-ad31-4bf6-ba9a-f652026e8bec admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:32.016501 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc7600-ad31-4bf6-ba9a-f652026e8bec admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:32.017226 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebc7600-ad31-4bf6-ba9a-f652026e8bec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:06:32.017537 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebc7600-ad31-4bf6-ba9a-f652026e8bec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:32.019144 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebc7600-ad31-4bf6-ba9a-f652026e8bec admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:32.030410 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-9cc7484d-67a7-4e8a-997c-85c1a2a5541f None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:32.031240 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 777/1554] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:06:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:06:32.031602 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-9cc7484d-67a7-4e8a-997c-85c1a2a5541f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:32.032511 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84490fd-1e74-4a91-871e-14a42c0c7969 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:32.032799 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84490fd-1e74-4a91-871e-14a42c0c7969 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:32.033075 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84490fd-1e74-4a91-871e-14a42c0c7969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:32.039312 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 778/1555] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:06:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:06:32.043136 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573e102-e2ca-4b5f-abf5-6d320eb4fa6f None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:32.043136 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573e102-e2ca-4b5f-abf5-6d320eb4fa6f None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:32.043136 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573e102-e2ca-4b5f-abf5-6d320eb4fa6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:32.051249 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-f84490fd-1e74-4a91-871e-14a42c0c7969 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:32.052471 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f84490fd-1e74-4a91-871e-14a42c0c7969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:32.059111 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-4573e102-e2ca-4b5f-abf5-6d320eb4fa6f None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:32.060280 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-4573e102-e2ca-4b5f-abf5-6d320eb4fa6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:32.060542 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 778/1556] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:06:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:06:32.061757 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ebeeb6-30dd-48a4-be2f-7b627408b667 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:32.062057 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ebeeb6-30dd-48a4-be2f-7b627408b667 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:32.062374 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ebeeb6-30dd-48a4-be2f-7b627408b667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:32.068121 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 779/1557] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:06:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:06:32.070415 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4573e102-e2ca-4b5f-abf5-6d320eb4fa6f None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:32.081253 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4573e102-e2ca-4b5f-abf5-6d320eb4fa6f None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:32.081653 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-52ebeeb6-30dd-48a4-be2f-7b627408b667 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:32.082902 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-52ebeeb6-30dd-48a4-be2f-7b627408b667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:32.085650 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f6789-a176-43ae-90e7-c7f3ff64d8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:32.086308 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f6789-a176-43ae-90e7-c7f3ff64d8a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:32.086587 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f6789-a176-43ae-90e7-c7f3ff64d8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:32.086920 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f6789-a176-43ae-90e7-c7f3ff64d8a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:32.088019 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738f6789-a176-43ae-90e7-c7f3ff64d8a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:32.089151 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: WARNING py.warnings [None req-738f6789-a176-43ae-90e7-c7f3ff64d8a2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 08 12:06:32.089151 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: warnings.warn(msg) Jun 08 12:06:32.089151 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: Jun 08 12:06:32.090288 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738f6789-a176-43ae-90e7-c7f3ff64d8a2 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:32.091244 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 779/1558] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:06:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:06:32.091807 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ebeeb6-30dd-48a4-be2f-7b627408b667 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:32.101730 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ebeeb6-30dd-48a4-be2f-7b627408b667 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:32.107941 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabbe030-1a74-4383-a9fc-adaa821e1eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:32.108929 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabbe030-1a74-4383-a9fc-adaa821e1eba admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:32.109215 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabbe030-1a74-4383-a9fc-adaa821e1eba admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:32.109493 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabbe030-1a74-4383-a9fc-adaa821e1eba admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:32.110184 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabbe030-1a74-4383-a9fc-adaa821e1eba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:32.112102 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabbe030-1a74-4383-a9fc-adaa821e1eba admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:32.113314 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 780/1559] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:06:32 2022] POST /identity/v3/users => generated 289 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:06:32.114241 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f6789-a176-43ae-90e7-c7f3ff64d8a2 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:32.124246 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f6789-a176-43ae-90e7-c7f3ff64d8a2 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:32.129135 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b369b88a-d0b9-4458-80a6-35d12f832551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:32.129788 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b369b88a-d0b9-4458-80a6-35d12f832551 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:32.130073 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b369b88a-d0b9-4458-80a6-35d12f832551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:32.130346 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b369b88a-d0b9-4458-80a6-35d12f832551 admin admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:32.131057 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b369b88a-d0b9-4458-80a6-35d12f832551 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:06:32.131364 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b369b88a-d0b9-4458-80a6-35d12f832551 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:32.132607 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 780/1560] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:06:32 2022] POST /identity/v3/users => generated 288 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:06:32.133004 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b369b88a-d0b9-4458-80a6-35d12f832551 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:32.133429 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabbe030-1a74-4383-a9fc-adaa821e1eba admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:32.143748 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabbe030-1a74-4383-a9fc-adaa821e1eba admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:32.152368 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 781/1561] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:06:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:06:32.152368 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b369b88a-d0b9-4458-80a6-35d12f832551 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:32.154719 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a958c1b1-77fb-421a-a5ed-d837dc6a3633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:32.155451 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958c1b1-77fb-421a-a5ed-d837dc6a3633 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:32.155843 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958c1b1-77fb-421a-a5ed-d837dc6a3633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:32.156150 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958c1b1-77fb-421a-a5ed-d837dc6a3633 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:32.156906 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a958c1b1-77fb-421a-a5ed-d837dc6a3633 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:32.158798 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a958c1b1-77fb-421a-a5ed-d837dc6a3633 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:32.161229 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b369b88a-d0b9-4458-80a6-35d12f832551 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:32.166489 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f4e87-b732-4ce9-bb88-aad88896dbdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:32.167138 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f4e87-b732-4ce9-bb88-aad88896dbdd admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:32.167421 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f4e87-b732-4ce9-bb88-aad88896dbdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:32.167696 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f4e87-b732-4ce9-bb88-aad88896dbdd admin admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:32.168448 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872f4e87-b732-4ce9-bb88-aad88896dbdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:06:32.168754 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872f4e87-b732-4ce9-bb88-aad88896dbdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:32.170339 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872f4e87-b732-4ce9-bb88-aad88896dbdd admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:32.184985 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 782/1562] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:06:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:06:32.185892 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f4e87-b732-4ce9-bb88-aad88896dbdd admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:32.192337 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 781/1563] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:06:32 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:06:32.193812 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e47e7-77c8-4e41-965b-aad5a688ec50 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:32.194282 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e47e7-77c8-4e41-965b-aad5a688ec50 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:32.194558 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e47e7-77c8-4e41-965b-aad5a688ec50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:32.199621 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f4e87-b732-4ce9-bb88-aad88896dbdd admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:32.212573 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-5c2e47e7-77c8-4e41-965b-aad5a688ec50 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:32.214405 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-5c2e47e7-77c8-4e41-965b-aad5a688ec50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:32.245694 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:06:32.248192 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:06:32.263524 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7fe6ad-0ebf-44e8-aff8-0d754850d132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:32.264256 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7fe6ad-0ebf-44e8-aff8-0d754850d132 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:32.264570 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7fe6ad-0ebf-44e8-aff8-0d754850d132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:32.264846 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7fe6ad-0ebf-44e8-aff8-0d754850d132 admin admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:32.265573 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7fe6ad-0ebf-44e8-aff8-0d754850d132 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:06:32.265884 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7fe6ad-0ebf-44e8-aff8-0d754850d132 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:32.267488 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7fe6ad-0ebf-44e8-aff8-0d754850d132 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:32.279980 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 783/1564] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:06:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:06:32.280869 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3564f3-8e7f-4cbb-9099-8efca49b514a None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:32.284881 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3564f3-8e7f-4cbb-9099-8efca49b514a None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:32.285032 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 782/1565] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:06:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:06:32.285158 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3564f3-8e7f-4cbb-9099-8efca49b514a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:32.285260 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e47e7-77c8-4e41-965b-aad5a688ec50 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:32.296662 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e47e7-77c8-4e41-965b-aad5a688ec50 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:32.301293 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94edb7e8-fdae-4d34-b781-7e29523a91d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:32.301953 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94edb7e8-fdae-4d34-b781-7e29523a91d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:32.302069 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-9f3564f3-8e7f-4cbb-9099-8efca49b514a None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:32.302232 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94edb7e8-fdae-4d34-b781-7e29523a91d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:32.302503 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94edb7e8-fdae-4d34-b781-7e29523a91d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:32.303227 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94edb7e8-fdae-4d34-b781-7e29523a91d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:32.303338 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-9f3564f3-8e7f-4cbb-9099-8efca49b514a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:32.304993 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94edb7e8-fdae-4d34-b781-7e29523a91d3 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:32.311947 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 784/1566] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:06:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:06:32.312780 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3564f3-8e7f-4cbb-9099-8efca49b514a None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:32.318844 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 783/1567] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:06:32.318844 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94edb7e8-fdae-4d34-b781-7e29523a91d3 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:32.322512 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3564f3-8e7f-4cbb-9099-8efca49b514a None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:32.327049 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32650e4-78e4-4186-87d5-7d55177b1095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:32.327705 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32650e4-78e4-4186-87d5-7d55177b1095 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:32.327989 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32650e4-78e4-4186-87d5-7d55177b1095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:32.328306 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32650e4-78e4-4186-87d5-7d55177b1095 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:32.328453 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94edb7e8-fdae-4d34-b781-7e29523a91d3 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:32.329081 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32650e4-78e4-4186-87d5-7d55177b1095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:32.330663 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32650e4-78e4-4186-87d5-7d55177b1095 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:32.333552 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118fd42f-1472-4c1a-b07d-9c104f96c8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:32.334161 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118fd42f-1472-4c1a-b07d-9c104f96c8fe admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:32.334443 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118fd42f-1472-4c1a-b07d-9c104f96c8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:32.334718 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118fd42f-1472-4c1a-b07d-9c104f96c8fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:32.335420 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118fd42f-1472-4c1a-b07d-9c104f96c8fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:32.337368 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118fd42f-1472-4c1a-b07d-9c104f96c8fe admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:32.340601 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 785/1568] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:06:32.341381 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32650e4-78e4-4186-87d5-7d55177b1095 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:32.350537 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32650e4-78e4-4186-87d5-7d55177b1095 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:32.355836 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad2eac-9c8f-4bbd-a29f-8123c983f95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:32.356479 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad2eac-9c8f-4bbd-a29f-8123c983f95e admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:32.356761 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad2eac-9c8f-4bbd-a29f-8123c983f95e admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:32.357043 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad2eac-9c8f-4bbd-a29f-8123c983f95e admin admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:32.357750 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad2eac-9c8f-4bbd-a29f-8123c983f95e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:32.360040 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad2eac-9c8f-4bbd-a29f-8123c983f95e admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:32.368934 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 784/1569] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:06:32 2022] POST /identity/v3/projects => generated 391 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:06:32.369923 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118fd42f-1472-4c1a-b07d-9c104f96c8fe admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:32.391477 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 786/1570] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:06:32 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:06:32.392299 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad2eac-9c8f-4bbd-a29f-8123c983f95e admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:32.434402 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118fd42f-1472-4c1a-b07d-9c104f96c8fe admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:32.458691 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad2eac-9c8f-4bbd-a29f-8123c983f95e admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:32.463532 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc316a4a-6bec-4250-8640-e4b3450a77ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:32.464229 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc316a4a-6bec-4250-8640-e4b3450a77ac admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:32.464522 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc316a4a-6bec-4250-8640-e4b3450a77ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:32.464804 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc316a4a-6bec-4250-8640-e4b3450a77ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:32.465535 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc316a4a-6bec-4250-8640-e4b3450a77ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:06:32.465846 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc316a4a-6bec-4250-8640-e4b3450a77ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:32.467456 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc316a4a-6bec-4250-8640-e4b3450a77ac admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:32.479195 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 787/1571] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:06:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:06:32.480372 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc316a4a-6bec-4250-8640-e4b3450a77ac admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:32.489689 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc316a4a-6bec-4250-8640-e4b3450a77ac admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:32.492125 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe413d1-acbe-48c5-bf37-0a16ece83052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:32.492838 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe413d1-acbe-48c5-bf37-0a16ece83052 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:32.493635 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe413d1-acbe-48c5-bf37-0a16ece83052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:32.493906 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe413d1-acbe-48c5-bf37-0a16ece83052 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:32.494594 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe413d1-acbe-48c5-bf37-0a16ece83052 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:32.495138 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c13af-01b8-4f14-86e8-397d95812a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:32.495779 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c13af-01b8-4f14-86e8-397d95812a96 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:32.496063 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c13af-01b8-4f14-86e8-397d95812a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:32.496373 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c13af-01b8-4f14-86e8-397d95812a96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:32.496544 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe413d1-acbe-48c5-bf37-0a16ece83052 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:32.497049 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25c13af-01b8-4f14-86e8-397d95812a96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:32.499051 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25c13af-01b8-4f14-86e8-397d95812a96 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:32.525483 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 785/1572] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:06:32 2022] POST /identity/v3/users => generated 287 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:06:32.525675 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe413d1-acbe-48c5-bf37-0a16ece83052 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:32.531496 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 788/1573] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:06:32 2022] POST /identity/v3/projects => generated 403 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:06:32.532376 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c13af-01b8-4f14-86e8-397d95812a96 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:32.541536 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe413d1-acbe-48c5-bf37-0a16ece83052 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:32.574573 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:06:32.605597 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d037e5-c96b-4871-b2c0-3b1b92cabd20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:32.606211 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c13af-01b8-4f14-86e8-397d95812a96 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:32.606320 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d037e5-c96b-4871-b2c0-3b1b92cabd20 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:32.606545 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d037e5-c96b-4871-b2c0-3b1b92cabd20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:32.606819 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d037e5-c96b-4871-b2c0-3b1b92cabd20 admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:32.607541 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d037e5-c96b-4871-b2c0-3b1b92cabd20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:06:32.607849 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d037e5-c96b-4871-b2c0-3b1b92cabd20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:32.609519 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d037e5-c96b-4871-b2c0-3b1b92cabd20 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:32.610439 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3286bd0a-4865-4d6b-9323-b1b56f541278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:32.611105 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286bd0a-4865-4d6b-9323-b1b56f541278 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:32.611386 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286bd0a-4865-4d6b-9323-b1b56f541278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:32.611663 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286bd0a-4865-4d6b-9323-b1b56f541278 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:32.612413 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3286bd0a-4865-4d6b-9323-b1b56f541278 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:32.614040 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3286bd0a-4865-4d6b-9323-b1b56f541278 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:32.621899 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 786/1574] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:06:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:06:32.622751 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d037e5-c96b-4871-b2c0-3b1b92cabd20 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:32.624187 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 789/1575] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:06:32.624992 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3286bd0a-4865-4d6b-9323-b1b56f541278 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:32.630962 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:06:32.635069 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3286bd0a-4865-4d6b-9323-b1b56f541278 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:32.637145 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d037e5-c96b-4871-b2c0-3b1b92cabd20 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:32.642097 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bcbc30-706b-4342-b05f-9515e44023a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:32.642239 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7647603-52d1-4b12-b699-75608f2c643d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:32.642763 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bcbc30-706b-4342-b05f-9515e44023a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:32.643046 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bcbc30-706b-4342-b05f-9515e44023a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:32.643163 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7647603-52d1-4b12-b699-75608f2c643d admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:32.643320 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bcbc30-706b-4342-b05f-9515e44023a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:32.643432 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7647603-52d1-4b12-b699-75608f2c643d admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:32.643691 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7647603-52d1-4b12-b699-75608f2c643d admin admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:32.644035 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bcbc30-706b-4342-b05f-9515e44023a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:32.644418 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7647603-52d1-4b12-b699-75608f2c643d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:32.645659 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bcbc30-706b-4342-b05f-9515e44023a4 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:32.646335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7647603-52d1-4b12-b699-75608f2c643d admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:32.657656 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 787/1576] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:06:32.661769 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bcbc30-706b-4342-b05f-9515e44023a4 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:32.669991 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 790/1577] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:06:32 2022] POST /identity/v3/users => generated 296 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:06:32.670752 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7647603-52d1-4b12-b699-75608f2c643d admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:32.675134 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bcbc30-706b-4342-b05f-9515e44023a4 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:32.679612 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b07ce79-1bc7-45e0-a62f-68b7a9aa5097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:32.680304 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07ce79-1bc7-45e0-a62f-68b7a9aa5097 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:32.680422 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7647603-52d1-4b12-b699-75608f2c643d admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:32.680702 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07ce79-1bc7-45e0-a62f-68b7a9aa5097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:32.680988 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07ce79-1bc7-45e0-a62f-68b7a9aa5097 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:32.681778 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b07ce79-1bc7-45e0-a62f-68b7a9aa5097 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:32.683678 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b07ce79-1bc7-45e0-a62f-68b7a9aa5097 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:32.685125 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca9802-b273-4935-80b0-5bdbefaf33e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:32.685825 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca9802-b273-4935-80b0-5bdbefaf33e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:32.686186 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca9802-b273-4935-80b0-5bdbefaf33e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:32.686536 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca9802-b273-4935-80b0-5bdbefaf33e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:32.687280 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca9802-b273-4935-80b0-5bdbefaf33e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:32.689279 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca9802-b273-4935-80b0-5bdbefaf33e8 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:32.705100 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 788/1578] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:06:32 2022] POST /identity/v3/users => generated 293 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:06:32.705914 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b07ce79-1bc7-45e0-a62f-68b7a9aa5097 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:32.716565 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b07ce79-1bc7-45e0-a62f-68b7a9aa5097 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:32.720591 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 791/1579] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:06:32 2022] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:06:32.720591 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca9802-b273-4935-80b0-5bdbefaf33e8 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:32.778153 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b7fc86-38c7-48e6-90ed-7e7520cb1177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:32.778826 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7fc86-38c7-48e6-90ed-7e7520cb1177 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:32.779103 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7fc86-38c7-48e6-90ed-7e7520cb1177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:32.779444 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7fc86-38c7-48e6-90ed-7e7520cb1177 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:32.780097 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b7fc86-38c7-48e6-90ed-7e7520cb1177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:32.781721 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b7fc86-38c7-48e6-90ed-7e7520cb1177 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:32.787094 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca9802-b273-4935-80b0-5bdbefaf33e8 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:32.795048 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 789/1580] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:06:32.795202 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c6d55-ada2-4420-ad05-2393092387cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:32.795202 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c6d55-ada2-4420-ad05-2393092387cb admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:32.795423 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b7fc86-38c7-48e6-90ed-7e7520cb1177 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:32.795522 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c6d55-ada2-4420-ad05-2393092387cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:32.795522 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c6d55-ada2-4420-ad05-2393092387cb admin admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:32.795522 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c6d55-ada2-4420-ad05-2393092387cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:32.796032 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c6d55-ada2-4420-ad05-2393092387cb admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:32.804757 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b7fc86-38c7-48e6-90ed-7e7520cb1177 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:32.811435 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f333ce21-0571-4c37-9fb4-0d81e48f157b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:32.812476 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333ce21-0571-4c37-9fb4-0d81e48f157b admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:32.812758 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333ce21-0571-4c37-9fb4-0d81e48f157b admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:32.813031 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333ce21-0571-4c37-9fb4-0d81e48f157b admin admin] PATH_INFO: `/v3/projects/d57cfed8817e4ff9970a29b9cfbc8e11/users/ed8d512bc7984e959510e80687f9ba74/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:32.817197 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 792/1581] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:06:32 2022] POST /identity/v3/users => generated 302 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:06:32.818087 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c6d55-ada2-4420-ad05-2393092387cb admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:32.827965 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c6d55-ada2-4420-ad05-2393092387cb admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:32.829367 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f333ce21-0571-4c37-9fb4-0d81e48f157b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d57cfed8817e4ff9970a29b9cfbc8e11, user_id=ed8d512bc7984e959510e80687f9ba74, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:32.830422 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: WARNING py.warnings [None req-f333ce21-0571-4c37-9fb4-0d81e48f157b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 08 12:06:32.830422 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: warnings.warn(msg) Jun 08 12:06:32.830422 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: Jun 08 12:06:32.832581 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f333ce21-0571-4c37-9fb4-0d81e48f157b admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:32.832869 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4268d74c-e638-4633-bba2-1a80c3bcae0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:32.833533 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268d74c-e638-4633-bba2-1a80c3bcae0c admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:32.833815 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268d74c-e638-4633-bba2-1a80c3bcae0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:32.834091 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268d74c-e638-4633-bba2-1a80c3bcae0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:32.834779 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4268d74c-e638-4633-bba2-1a80c3bcae0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:32.836729 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4268d74c-e638-4633-bba2-1a80c3bcae0c admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:32.847053 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 790/1582] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:06:32 2022] PUT /identity/v3/projects/d57cfed8817e4ff9970a29b9cfbc8e11/users/ed8d512bc7984e959510e80687f9ba74/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:06:32.847787 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f333ce21-0571-4c37-9fb4-0d81e48f157b admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:32.870754 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 793/1583] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:06:32 2022] POST /identity/v3/projects => generated 389 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:06:32.871719 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4268d74c-e638-4633-bba2-1a80c3bcae0c admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:32.920424 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f333ce21-0571-4c37-9fb4-0d81e48f157b admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:32.933283 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4268d74c-e638-4633-bba2-1a80c3bcae0c admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:32.937840 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463f8d0-de66-4e58-82c5-39d6a1d94399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:32.938512 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463f8d0-de66-4e58-82c5-39d6a1d94399 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:32.938798 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463f8d0-de66-4e58-82c5-39d6a1d94399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:32.939071 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463f8d0-de66-4e58-82c5-39d6a1d94399 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:32.939792 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463f8d0-de66-4e58-82c5-39d6a1d94399 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:32.940186 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:06:32.941466 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463f8d0-de66-4e58-82c5-39d6a1d94399 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:32.952282 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 794/1584] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:06:32.953164 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463f8d0-de66-4e58-82c5-39d6a1d94399 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:32.962638 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463f8d0-de66-4e58-82c5-39d6a1d94399 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:32.967156 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53eba69-cf8c-4867-9f09-9a7d6a2ad9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:32.967798 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53eba69-cf8c-4867-9f09-9a7d6a2ad9f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:32.968080 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53eba69-cf8c-4867-9f09-9a7d6a2ad9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:32.968397 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53eba69-cf8c-4867-9f09-9a7d6a2ad9f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:32.969110 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53eba69-cf8c-4867-9f09-9a7d6a2ad9f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:32.970683 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53eba69-cf8c-4867-9f09-9a7d6a2ad9f6 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:32.984089 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 795/1585] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:06:32.984089 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53eba69-cf8c-4867-9f09-9a7d6a2ad9f6 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:32.984370 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d75a6-6673-453e-a3ef-b22a357c5695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:32.984370 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d75a6-6673-453e-a3ef-b22a357c5695 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:32.984560 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d75a6-6673-453e-a3ef-b22a357c5695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:32.984822 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d75a6-6673-453e-a3ef-b22a357c5695 admin admin] PATH_INFO: `/v3/projects/bf5c685a584b4312b641f90787527f6a/users/f3d3e9767e814d0d995be5c660c36fc7/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:32.991123 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53eba69-cf8c-4867-9f09-9a7d6a2ad9f6 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:32.997220 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa2977-11a1-45f6-b509-8c4fdac85962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:32.997879 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa2977-11a1-45f6-b509-8c4fdac85962 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:32.998161 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa2977-11a1-45f6-b509-8c4fdac85962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:32.998436 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa2977-11a1-45f6-b509-8c4fdac85962 admin admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:32.999125 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa2977-11a1-45f6-b509-8c4fdac85962 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:32.999706 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9d75a6-6673-453e-a3ef-b22a357c5695 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf5c685a584b4312b641f90787527f6a, user_id=f3d3e9767e814d0d995be5c660c36fc7, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:33.001077 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa2977-11a1-45f6-b509-8c4fdac85962 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:33.002372 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9d75a6-6673-453e-a3ef-b22a357c5695 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:33.017454 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 791/1586] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:06:32 2022] PUT /identity/v3/projects/bf5c685a584b4312b641f90787527f6a/users/f3d3e9767e814d0d995be5c660c36fc7/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:06:33.018264 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d75a6-6673-453e-a3ef-b22a357c5695 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:33.018779 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:06:33.027217 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 796/1587] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:06:32 2022] POST /identity/v3/users => generated 284 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:06:33.029122 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa2977-11a1-45f6-b509-8c4fdac85962 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:33.039140 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa2977-11a1-45f6-b509-8c4fdac85962 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:33.083653 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d75a6-6673-453e-a3ef-b22a357c5695 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:33.088565 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b900789-56f6-419a-b74c-133956cf07b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:33.089231 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b900789-56f6-419a-b74c-133956cf07b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:33.089513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b900789-56f6-419a-b74c-133956cf07b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:33.089789 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b900789-56f6-419a-b74c-133956cf07b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:33.090506 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b900789-56f6-419a-b74c-133956cf07b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:33.092102 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b900789-56f6-419a-b74c-133956cf07b9 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:33.096637 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88b3a3-5021-4d1a-b012-5f7375454fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:33.097385 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88b3a3-5021-4d1a-b012-5f7375454fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:33.097599 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88b3a3-5021-4d1a-b012-5f7375454fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:33.097878 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88b3a3-5021-4d1a-b012-5f7375454fc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:33.098631 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f88b3a3-5021-4d1a-b012-5f7375454fc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:33.100237 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f88b3a3-5021-4d1a-b012-5f7375454fc2 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:33.102149 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 792/1588] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:06:33.103885 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668941fa-e3b6-477e-ad68-06acde6f7b08 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:33.104193 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668941fa-e3b6-477e-ad68-06acde6f7b08 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:33.104761 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668941fa-e3b6-477e-ad68-06acde6f7b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:33.114480 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 797/1589] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:06:33.115640 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88b3a3-5021-4d1a-b012-5f7375454fc2 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:33.122151 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-668941fa-e3b6-477e-ad68-06acde6f7b08 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:33.123343 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-668941fa-e3b6-477e-ad68-06acde6f7b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:33.126544 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88b3a3-5021-4d1a-b012-5f7375454fc2 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:33.130810 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 793/1590] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:06:33.130981 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87485256-1bce-44c3-b6b2-4ed518ce1ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:33.131600 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668941fa-e3b6-477e-ad68-06acde6f7b08 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:33.131767 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87485256-1bce-44c3-b6b2-4ed518ce1ad2 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:33.132047 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87485256-1bce-44c3-b6b2-4ed518ce1ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:33.132358 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87485256-1bce-44c3-b6b2-4ed518ce1ad2 admin admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:33.133038 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87485256-1bce-44c3-b6b2-4ed518ce1ad2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:33.135610 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87485256-1bce-44c3-b6b2-4ed518ce1ad2 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:33.143471 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668941fa-e3b6-477e-ad68-06acde6f7b08 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:33.148736 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a3251e-9da4-47a7-a723-ba10aeecf963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:33.149937 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3251e-9da4-47a7-a723-ba10aeecf963 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:33.150287 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3251e-9da4-47a7-a723-ba10aeecf963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:33.150496 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3251e-9da4-47a7-a723-ba10aeecf963 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:33.151289 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a3251e-9da4-47a7-a723-ba10aeecf963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:33.152916 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a3251e-9da4-47a7-a723-ba10aeecf963 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:33.160961 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 798/1591] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:06:33 2022] POST /identity/v3/users => generated 295 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:06:33.160961 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87485256-1bce-44c3-b6b2-4ed518ce1ad2 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:33.170430 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 794/1592] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:06:33.171872 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a570da2-84f5-4e5a-99d7-2c6e3ab9f18a None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:33.172198 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a570da2-84f5-4e5a-99d7-2c6e3ab9f18a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:33.174768 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a570da2-84f5-4e5a-99d7-2c6e3ab9f18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:33.182615 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87485256-1bce-44c3-b6b2-4ed518ce1ad2 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:33.187867 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c8ea20-99d1-491f-8b21-5cf0101b7ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:33.188765 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8ea20-99d1-491f-8b21-5cf0101b7ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:33.189049 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8ea20-99d1-491f-8b21-5cf0101b7ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:33.189310 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8ea20-99d1-491f-8b21-5cf0101b7ca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:33.190065 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c8ea20-99d1-491f-8b21-5cf0101b7ca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:33.192347 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c8ea20-99d1-491f-8b21-5cf0101b7ca3 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:33.203334 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-8a570da2-84f5-4e5a-99d7-2c6e3ab9f18a None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:33.203334 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-8a570da2-84f5-4e5a-99d7-2c6e3ab9f18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:33.208544 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 799/1593] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:06:33.209407 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c8ea20-99d1-491f-8b21-5cf0101b7ca3 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:33.211627 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 795/1594] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:06:33.213361 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a570da2-84f5-4e5a-99d7-2c6e3ab9f18a None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:33.224510 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c8ea20-99d1-491f-8b21-5cf0101b7ca3 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:33.231257 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a570da2-84f5-4e5a-99d7-2c6e3ab9f18a None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:33.231839 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12868172-f701-4474-8ce3-8edb96f9e9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:33.232542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12868172-f701-4474-8ce3-8edb96f9e9e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:33.232830 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12868172-f701-4474-8ce3-8edb96f9e9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:33.233156 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12868172-f701-4474-8ce3-8edb96f9e9e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:33.233822 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12868172-f701-4474-8ce3-8edb96f9e9e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:33.235417 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12868172-f701-4474-8ce3-8edb96f9e9e5 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:33.236211 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc28073-bcad-42e9-855e-da9f24654f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:33.237107 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc28073-bcad-42e9-855e-da9f24654f8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:33.237388 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc28073-bcad-42e9-855e-da9f24654f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:33.237663 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc28073-bcad-42e9-855e-da9f24654f8a admin admin] PATH_INFO: `/v3/projects/ab06967b11ad40979c5b136d6acf64b5/users/a56c1d1321064f378f09730b3d6bbf8a/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:33.246700 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 800/1595] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:06:33.247837 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12868172-f701-4474-8ce3-8edb96f9e9e5 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:33.257543 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc28073-bcad-42e9-855e-da9f24654f8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab06967b11ad40979c5b136d6acf64b5, user_id=a56c1d1321064f378f09730b3d6bbf8a, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:33.258768 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12868172-f701-4474-8ce3-8edb96f9e9e5 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:33.260819 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc28073-bcad-42e9-855e-da9f24654f8a admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:33.264032 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc6090-ccfb-478f-934a-40d90f2e4000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:33.264664 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc6090-ccfb-478f-934a-40d90f2e4000 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:33.264807 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc6090-ccfb-478f-934a-40d90f2e4000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:33.265008 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc6090-ccfb-478f-934a-40d90f2e4000 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:33.265872 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc6090-ccfb-478f-934a-40d90f2e4000 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:33.268097 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc6090-ccfb-478f-934a-40d90f2e4000 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:33.283021 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 796/1596] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:06:33 2022] PUT /identity/v3/projects/ab06967b11ad40979c5b136d6acf64b5/users/a56c1d1321064f378f09730b3d6bbf8a/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:06:33.288423 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc28073-bcad-42e9-855e-da9f24654f8a admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:33.288544 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 801/1597] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:06:33.288544 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc6090-ccfb-478f-934a-40d90f2e4000 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:33.296947 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc6090-ccfb-478f-934a-40d90f2e4000 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:33.353915 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc28073-bcad-42e9-855e-da9f24654f8a admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:33.357859 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264a517-dca5-43b4-9c80-badf7fa86921 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:33.358514 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264a517-dca5-43b4-9c80-badf7fa86921 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:33.358799 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264a517-dca5-43b4-9c80-badf7fa86921 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:33.359064 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264a517-dca5-43b4-9c80-badf7fa86921 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:33.360210 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1cb4e-05ec-4d71-b232-57022e07e5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:33.360983 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1cb4e-05ec-4d71-b232-57022e07e5f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:33.361276 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1cb4e-05ec-4d71-b232-57022e07e5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:33.361557 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1cb4e-05ec-4d71-b232-57022e07e5f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:33.362287 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba1cb4e-05ec-4d71-b232-57022e07e5f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:33.363919 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba1cb4e-05ec-4d71-b232-57022e07e5f2 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:33.366516 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:06:33.370233 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3264a517-dca5-43b4-9c80-badf7fa86921 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:33.372016 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3264a517-dca5-43b4-9c80-badf7fa86921 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:33.376332 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 802/1598] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:06:33.377376 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1cb4e-05ec-4d71-b232-57022e07e5f2 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:33.388375 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 797/1599] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:06:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:06:33.389302 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264a517-dca5-43b4-9c80-badf7fa86921 service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:33.389429 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1cb4e-05ec-4d71-b232-57022e07e5f2 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:33.398750 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a7ab1-d47c-4a20-9e54-3f5a860e8d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:33.400589 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a7ab1-d47c-4a20-9e54-3f5a860e8d68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:33.401282 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a7ab1-d47c-4a20-9e54-3f5a860e8d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:33.401637 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a7ab1-d47c-4a20-9e54-3f5a860e8d68 admin admin] PATH_INFO: `/v3/projects/ee3ef48b254d48d9a017d48f11541087/users/ac2ba7b98bfd40a49cf11263d9739e68/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:33.408964 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264a517-dca5-43b4-9c80-badf7fa86921 service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:33.416388 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23fd20e-f442-42db-80ac-91177e940991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:33.417319 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23fd20e-f442-42db-80ac-91177e940991 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:33.417682 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23fd20e-f442-42db-80ac-91177e940991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:33.417961 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23fd20e-f442-42db-80ac-91177e940991 admin admin] PATH_INFO: `/v3/projects/633d5edd24014c5eab3f0907135d8d4b/users/38475bbe086b451fb78750ce6606dfa0/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:33.422920 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061a7ab1-d47c-4a20-9e54-3f5a860e8d68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee3ef48b254d48d9a017d48f11541087, user_id=ac2ba7b98bfd40a49cf11263d9739e68, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:33.425911 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061a7ab1-d47c-4a20-9e54-3f5a860e8d68 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:33.434928 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23fd20e-f442-42db-80ac-91177e940991 admin admin] RBAC: Authorizing `identity:create_grant(project_id=633d5edd24014c5eab3f0907135d8d4b, user_id=38475bbe086b451fb78750ce6606dfa0, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:33.438166 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23fd20e-f442-42db-80ac-91177e940991 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:33.443396 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 803/1600] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:06:33 2022] PUT /identity/v3/projects/ee3ef48b254d48d9a017d48f11541087/users/ac2ba7b98bfd40a49cf11263d9739e68/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:06:33.444370 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a7ab1-d47c-4a20-9e54-3f5a860e8d68 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:33.460791 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 798/1601] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:06:33 2022] PUT /identity/v3/projects/633d5edd24014c5eab3f0907135d8d4b/users/38475bbe086b451fb78750ce6606dfa0/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:06:33.465176 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23fd20e-f442-42db-80ac-91177e940991 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:33.470610 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:06:33.530969 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a7ab1-d47c-4a20-9e54-3f5a860e8d68 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:33.562952 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23fd20e-f442-42db-80ac-91177e940991 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:33.570153 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f4f83-7805-402d-8c50-f10712b0746d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:33.570843 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f4f83-7805-402d-8c50-f10712b0746d admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:33.571131 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f4f83-7805-402d-8c50-f10712b0746d admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:33.571935 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f4f83-7805-402d-8c50-f10712b0746d admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:33.572728 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183f4f83-7805-402d-8c50-f10712b0746d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:33.574349 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183f4f83-7805-402d-8c50-f10712b0746d admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:33.598858 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 799/1602] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:06:33.600604 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f4f83-7805-402d-8c50-f10712b0746d admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:33.606222 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf65f012-1028-4027-9e86-a1667b8480b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:33.607015 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65f012-1028-4027-9e86-a1667b8480b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:33.607299 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65f012-1028-4027-9e86-a1667b8480b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:33.607575 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65f012-1028-4027-9e86-a1667b8480b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:33.612394 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f4f83-7805-402d-8c50-f10712b0746d admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:33.621128 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf65f012-1028-4027-9e86-a1667b8480b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:33.621245 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf10ce2-de05-4be6-be89-a022b5595e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:33.621245 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf10ce2-de05-4be6-be89-a022b5595e68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:33.621433 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf10ce2-de05-4be6-be89-a022b5595e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:33.621591 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf10ce2-de05-4be6-be89-a022b5595e68 admin admin] PATH_INFO: `/v3/projects/2012ff2b146342d0be7b0c453bc8880f/users/b019d3e9a9c742c8af2954d82a9b5c7f/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:33.623270 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf65f012-1028-4027-9e86-a1667b8480b2 service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:33.636898 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 804/1603] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:06:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:06:33.638237 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05b7e0-638f-487e-8d4e-4d84d7ded7fb None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:33.638526 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05b7e0-638f-487e-8d4e-4d84d7ded7fb None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:33.638803 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05b7e0-638f-487e-8d4e-4d84d7ded7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:33.647350 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf10ce2-de05-4be6-be89-a022b5595e68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2012ff2b146342d0be7b0c453bc8880f, user_id=b019d3e9a9c742c8af2954d82a9b5c7f, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:33.651191 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf10ce2-de05-4be6-be89-a022b5595e68 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:33.669057 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 800/1604] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:06:33 2022] PUT /identity/v3/projects/2012ff2b146342d0be7b0c453bc8880f/users/b019d3e9a9c742c8af2954d82a9b5c7f/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:06:33.669973 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf10ce2-de05-4be6-be89-a022b5595e68 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:33.670503 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-ac05b7e0-638f-487e-8d4e-4d84d7ded7fb None None] MFA Rules not processed for user `a56c1d1321064f378f09730b3d6bbf8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:33.672117 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-ac05b7e0-638f-487e-8d4e-4d84d7ded7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:33.749222 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 805/1605] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:06:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:06:33.751057 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f42b69-eb3f-4897-994e-5ede7ae01cfc None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:33.751422 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f42b69-eb3f-4897-994e-5ede7ae01cfc None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:33.751778 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f42b69-eb3f-4897-994e-5ede7ae01cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:33.753761 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf10ce2-de05-4be6-be89-a022b5595e68 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:33.758885 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc40449-c548-44b9-ba19-5df07d95ed5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:33.759747 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc40449-c548-44b9-ba19-5df07d95ed5f admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:33.760904 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc40449-c548-44b9-ba19-5df07d95ed5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:33.760904 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc40449-c548-44b9-ba19-5df07d95ed5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:33.761229 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc40449-c548-44b9-ba19-5df07d95ed5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:33.763345 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc40449-c548-44b9-ba19-5df07d95ed5f admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:33.775061 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-e8f42b69-eb3f-4897-994e-5ede7ae01cfc None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:33.775506 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-e8f42b69-eb3f-4897-994e-5ede7ae01cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:33.777203 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 801/1606] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:06:33.778761 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1ef99-47ef-4177-8e6e-f046a1064686 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:33.779293 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1ef99-47ef-4177-8e6e-f046a1064686 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:33.779702 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1ef99-47ef-4177-8e6e-f046a1064686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:33.793084 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 806/1607] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:06:33.793084 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f42b69-eb3f-4897-994e-5ede7ae01cfc None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:33.806976 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f42b69-eb3f-4897-994e-5ede7ae01cfc None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:33.808038 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-fbc1ef99-47ef-4177-8e6e-f046a1064686 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:33.810002 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-fbc1ef99-47ef-4177-8e6e-f046a1064686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:33.812570 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766f57b-1b5b-4566-8cd1-9770c3e3bdfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:33.813729 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766f57b-1b5b-4566-8cd1-9770c3e3bdfe admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:33.814017 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766f57b-1b5b-4566-8cd1-9770c3e3bdfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:33.814324 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766f57b-1b5b-4566-8cd1-9770c3e3bdfe admin admin] PATH_INFO: `/v3/projects/aef4d0f0aba4476189301e6a67e67e0c/users/c5d3a00cf4b048f59a5486facb52ae13/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:33.824070 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 802/1608] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:06:33.824070 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12c45c-45f5-41c5-bd45-f67a5f41f216 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:33.824070 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12c45c-45f5-41c5-bd45-f67a5f41f216 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:33.824070 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12c45c-45f5-41c5-bd45-f67a5f41f216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:33.835817 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a766f57b-1b5b-4566-8cd1-9770c3e3bdfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=aef4d0f0aba4476189301e6a67e67e0c, user_id=c5d3a00cf4b048f59a5486facb52ae13, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:33.839299 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a766f57b-1b5b-4566-8cd1-9770c3e3bdfe admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:33.852113 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-8d12c45c-45f5-41c5-bd45-f67a5f41f216 None None] MFA Rules not processed for user `b019d3e9a9c742c8af2954d82a9b5c7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:33.854022 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-8d12c45c-45f5-41c5-bd45-f67a5f41f216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:33.856778 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 807/1609] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:06:33 2022] PUT /identity/v3/projects/aef4d0f0aba4476189301e6a67e67e0c/users/c5d3a00cf4b048f59a5486facb52ae13/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:06:33.857956 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766f57b-1b5b-4566-8cd1-9770c3e3bdfe admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:33.885877 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:06:33.906156 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:06:33.950900 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766f57b-1b5b-4566-8cd1-9770c3e3bdfe admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:33.970218 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7bb4d-4421-4d04-a653-f1e9e5260076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:33.971131 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7bb4d-4421-4d04-a653-f1e9e5260076 admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:33.971422 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7bb4d-4421-4d04-a653-f1e9e5260076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:33.971701 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7bb4d-4421-4d04-a653-f1e9e5260076 admin admin] PATH_INFO: `/v3/projects/dec778bcd9444d4ba49cee429a2f687c/users/8c9b1729824c4d2793b8af88a1184ad0/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:33.980453 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 803/1610] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:06:33 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:06:33.980453 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984d519-4ff4-454f-9022-24bf2f57dd90 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:33.980453 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984d519-4ff4-454f-9022-24bf2f57dd90 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:33.980822 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984d519-4ff4-454f-9022-24bf2f57dd90 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:33.988307 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 804/1611] 10.222.0.39 () {54 vars in 961 bytes} [Wed Jun 8 12:06:33 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:06:33.989279 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e984d519-4ff4-454f-9022-24bf2f57dd90 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:33.997494 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-e984d519-4ff4-454f-9022-24bf2f57dd90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:34.009383 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a7bb4d-4421-4d04-a653-f1e9e5260076 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dec778bcd9444d4ba49cee429a2f687c, user_id=8c9b1729824c4d2793b8af88a1184ad0, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:34.017294 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a7bb4d-4421-4d04-a653-f1e9e5260076 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:34.050797 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 808/1612] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:06:33 2022] PUT /identity/v3/projects/dec778bcd9444d4ba49cee429a2f687c/users/8c9b1729824c4d2793b8af88a1184ad0/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:06:34.050797 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7bb4d-4421-4d04-a653-f1e9e5260076 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:34.050797 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-47a7bb4d-4421-4d04-a653-f1e9e5260076 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:34.100822 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e984d519-4ff4-454f-9022-24bf2f57dd90 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:34.122441 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7bb4d-4421-4d04-a653-f1e9e5260076 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:34.126819 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c07da5-fdbc-4929-bb69-9b2a19e6b6b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:34.127485 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c07da5-fdbc-4929-bb69-9b2a19e6b6b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:34.127794 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c07da5-fdbc-4929-bb69-9b2a19e6b6b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:34.128090 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c07da5-fdbc-4929-bb69-9b2a19e6b6b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:34.190167 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa4f641-bab6-4d75-b9ab-7bae04686cb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:34.191111 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4f641-bab6-4d75-b9ab-7bae04686cb4 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:34.191404 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4f641-bab6-4d75-b9ab-7bae04686cb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:34.191682 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4f641-bab6-4d75-b9ab-7bae04686cb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:34.229830 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c07da5-fdbc-4929-bb69-9b2a19e6b6b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:34.233998 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c07da5-fdbc-4929-bb69-9b2a19e6b6b9 service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:34.265125 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 809/1613] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:06:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:06:34.266285 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659a975-163c-4a58-b49e-b9b083cf00f5 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:34.266578 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659a975-163c-4a58-b49e-b9b083cf00f5 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:34.266859 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659a975-163c-4a58-b49e-b9b083cf00f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:34.271893 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa4f641-bab6-4d75-b9ab-7bae04686cb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:34.275062 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa4f641-bab6-4d75-b9ab-7bae04686cb4 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:34.289477 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 805/1614] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:06:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:06:34.290619 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa4f641-bab6-4d75-b9ab-7bae04686cb4 service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:34.305875 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-2659a975-163c-4a58-b49e-b9b083cf00f5 None None] MFA Rules not processed for user `c5d3a00cf4b048f59a5486facb52ae13`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:34.307533 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-2659a975-163c-4a58-b49e-b9b083cf00f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:34.307840 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa4f641-bab6-4d75-b9ab-7bae04686cb4 service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:34.315678 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d9b66-c63a-45b2-9371-f693b114334f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:34.316400 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d9b66-c63a-45b2-9371-f693b114334f admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:34.316817 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d9b66-c63a-45b2-9371-f693b114334f admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:34.317102 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d9b66-c63a-45b2-9371-f693b114334f admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:34.319071 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d9b66-c63a-45b2-9371-f693b114334f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:34.322504 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d9b66-c63a-45b2-9371-f693b114334f admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:34.354753 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 806/1615] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:06:34 2022] POST /identity/v3/projects => generated 401 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:06:34.356079 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336648e6-9193-4eb8-afdf-620323cd4da6 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:34.356434 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336648e6-9193-4eb8-afdf-620323cd4da6 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:34.356718 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336648e6-9193-4eb8-afdf-620323cd4da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:34.372230 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:06:34.380615 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-336648e6-9193-4eb8-afdf-620323cd4da6 None None] MFA Rules not processed for user `7ef7edb5e9ce49e6b098f48bf060b228`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:34.382545 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-336648e6-9193-4eb8-afdf-620323cd4da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:34.402411 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:06:34.411972 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 810/1616] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:06:34 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:06:34.413508 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b991ac-c679-4e3b-9d5c-b4575ce71e75 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:34.413814 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b991ac-c679-4e3b-9d5c-b4575ce71e75 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:34.414098 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b991ac-c679-4e3b-9d5c-b4575ce71e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:34.438043 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-74b991ac-c679-4e3b-9d5c-b4575ce71e75 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:34.439364 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-74b991ac-c679-4e3b-9d5c-b4575ce71e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:34.470386 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 807/1617] 10.222.0.39 () {58 vars in 1058 bytes} [Wed Jun 8 12:06:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:06:34.471391 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336648e6-9193-4eb8-afdf-620323cd4da6 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:34.527516 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 811/1618] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:06:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:06:34.528933 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b991ac-c679-4e3b-9d5c-b4575ce71e75 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:34.545013 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336648e6-9193-4eb8-afdf-620323cd4da6 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:34.552025 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91616a1-eaa2-4259-b095-8fcf0a4abf75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:34.553462 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91616a1-eaa2-4259-b095-8fcf0a4abf75 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:34.554125 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91616a1-eaa2-4259-b095-8fcf0a4abf75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:34.554471 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91616a1-eaa2-4259-b095-8fcf0a4abf75 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:34.555263 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91616a1-eaa2-4259-b095-8fcf0a4abf75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:34.558714 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91616a1-eaa2-4259-b095-8fcf0a4abf75 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:34.592088 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 808/1619] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:06:34 2022] POST /identity/v3/users => generated 307 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:06:34.593855 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91616a1-eaa2-4259-b095-8fcf0a4abf75 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:34.612819 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91616a1-eaa2-4259-b095-8fcf0a4abf75 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:34.620557 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b991ac-c679-4e3b-9d5c-b4575ce71e75 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:34.621104 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658d4afe-9a95-4e44-bec7-7e64707da925 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef7edb5e9ce49e6b098f48bf060b228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:34.621985 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d4afe-9a95-4e44-bec7-7e64707da925 service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:34.622282 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d4afe-9a95-4e44-bec7-7e64707da925 service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:34.623213 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d4afe-9a95-4e44-bec7-7e64707da925 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:34.625445 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62736e75-299f-4bb9-b394-13a69a084dd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:34.630572 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62736e75-299f-4bb9-b394-13a69a084dd3 service cinder] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:34.631092 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62736e75-299f-4bb9-b394-13a69a084dd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:34.631354 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62736e75-299f-4bb9-b394-13a69a084dd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:34.719547 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658d4afe-9a95-4e44-bec7-7e64707da925 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:34.721727 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658d4afe-9a95-4e44-bec7-7e64707da925 service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:34.728434 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62736e75-299f-4bb9-b394-13a69a084dd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:34.730608 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62736e75-299f-4bb9-b394-13a69a084dd3 service cinder] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:34.738008 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 809/1620] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:06:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:06:34.739257 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658d4afe-9a95-4e44-bec7-7e64707da925 service nova] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:34.744449 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 812/1621] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:06:34 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:06:34.745491 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62736e75-299f-4bb9-b394-13a69a084dd3 service cinder] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:34.756806 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62736e75-299f-4bb9-b394-13a69a084dd3 service cinder] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:34.762521 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ebe13-d7ce-4cf2-8069-62c459406409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:34.763338 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ebe13-d7ce-4cf2-8069-62c459406409 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:34.763624 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ebe13-d7ce-4cf2-8069-62c459406409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:34.763903 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ebe13-d7ce-4cf2-8069-62c459406409 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:34.764839 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67ebe13-d7ce-4cf2-8069-62c459406409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:34.766605 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67ebe13-d7ce-4cf2-8069-62c459406409 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:34.779902 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 813/1622] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:06:34.781415 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85db6d-66b9-443e-bbfa-2b9933bf7a96 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:34.781774 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85db6d-66b9-443e-bbfa-2b9933bf7a96 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:34.783013 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85db6d-66b9-443e-bbfa-2b9933bf7a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:34.804489 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:06:34.851966 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-2c85db6d-66b9-443e-bbfa-2b9933bf7a96 None None] MFA Rules not processed for user `ed8d512bc7984e959510e80687f9ba74`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:34.856503 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-2c85db6d-66b9-443e-bbfa-2b9933bf7a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:34.872464 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658d4afe-9a95-4e44-bec7-7e64707da925 service nova] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:34.881197 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075225d2-6d84-4caf-8332-444e3f3acad4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:34.883303 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075225d2-6d84-4caf-8332-444e3f3acad4 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:34.883595 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075225d2-6d84-4caf-8332-444e3f3acad4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:34.884458 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075225d2-6d84-4caf-8332-444e3f3acad4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:34.914513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075225d2-6d84-4caf-8332-444e3f3acad4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:34.918204 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075225d2-6d84-4caf-8332-444e3f3acad4 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:34.948680 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:06:34.964542 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 810/1623] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:06:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:06:34.967790 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075225d2-6d84-4caf-8332-444e3f3acad4 service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:35.004197 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075225d2-6d84-4caf-8332-444e3f3acad4 service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:35.021115 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da916b3b-068f-4844-a978-1853a8bd49db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:35.023714 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da916b3b-068f-4844-a978-1853a8bd49db admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:35.024006 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da916b3b-068f-4844-a978-1853a8bd49db admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:35.027216 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da916b3b-068f-4844-a978-1853a8bd49db admin admin] PATH_INFO: `/v3/projects/045c6657258b41dcb75c1bd8cf423a7c/users/a092a3c94db04779a9a562d681a58a74/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:35.065892 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da916b3b-068f-4844-a978-1853a8bd49db admin admin] RBAC: Authorizing `identity:create_grant(project_id=045c6657258b41dcb75c1bd8cf423a7c, user_id=a092a3c94db04779a9a562d681a58a74, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:35.069154 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 814/1624] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:06:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:06:35.077259 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da916b3b-068f-4844-a978-1853a8bd49db admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:35.085314 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8b234-100b-49b8-b671-dc25cb69339b None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:35.088890 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8b234-100b-49b8-b671-dc25cb69339b None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:35.088890 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8b234-100b-49b8-b671-dc25cb69339b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:35.131496 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-dbc8b234-100b-49b8-b671-dc25cb69339b None None] MFA Rules not processed for user `ed8d512bc7984e959510e80687f9ba74`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:35.132858 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-dbc8b234-100b-49b8-b671-dc25cb69339b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:35.148074 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 811/1625] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:06:34 2022] PUT /identity/v3/projects/045c6657258b41dcb75c1bd8cf423a7c/users/a092a3c94db04779a9a562d681a58a74/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:06:35.151885 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da916b3b-068f-4844-a978-1853a8bd49db admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:35.269610 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da916b3b-068f-4844-a978-1853a8bd49db admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:35.279442 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 815/1626] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:06:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:06:35.280920 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03afc04e-4f19-43c8-94e6-a9d4f571bcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:35.281884 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03afc04e-4f19-43c8-94e6-a9d4f571bcd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:35.284073 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03afc04e-4f19-43c8-94e6-a9d4f571bcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:35.284428 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03afc04e-4f19-43c8-94e6-a9d4f571bcd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:35.285369 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03afc04e-4f19-43c8-94e6-a9d4f571bcd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:35.286401 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8b234-100b-49b8-b671-dc25cb69339b None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:35.288042 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03afc04e-4f19-43c8-94e6-a9d4f571bcd6 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:35.341919 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 812/1627] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:06:35 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:06:35.344151 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03afc04e-4f19-43c8-94e6-a9d4f571bcd6 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:35.379273 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03afc04e-4f19-43c8-94e6-a9d4f571bcd6 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:35.394795 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8301d-0f39-4fe2-872c-64dc1d8630cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:35.397873 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8301d-0f39-4fe2-872c-64dc1d8630cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:35.399138 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8301d-0f39-4fe2-872c-64dc1d8630cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:35.400015 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8301d-0f39-4fe2-872c-64dc1d8630cb admin admin] PATH_INFO: `/v3/projects/045c6657258b41dcb75c1bd8cf423a7c/users/a092a3c94db04779a9a562d681a58a74/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:35.408563 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f8301d-0f39-4fe2-872c-64dc1d8630cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=045c6657258b41dcb75c1bd8cf423a7c, user_id=a092a3c94db04779a9a562d681a58a74, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:35.420080 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f8301d-0f39-4fe2-872c-64dc1d8630cb admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:35.455340 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8b234-100b-49b8-b671-dc25cb69339b None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:35.456450 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 813/1628] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:06:35 2022] PUT /identity/v3/projects/045c6657258b41dcb75c1bd8cf423a7c/users/a092a3c94db04779a9a562d681a58a74/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:06:35.468431 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf120f5-fc2b-46f6-94f0-8bdddf99669a None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:35.468844 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf120f5-fc2b-46f6-94f0-8bdddf99669a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:35.469417 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf120f5-fc2b-46f6-94f0-8bdddf99669a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:35.531117 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-6bf120f5-fc2b-46f6-94f0-8bdddf99669a None None] MFA Rules not processed for user `a092a3c94db04779a9a562d681a58a74`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:35.531117 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-6bf120f5-fc2b-46f6-94f0-8bdddf99669a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:35.604668 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418b6ca-16c3-48b9-b13d-8ba2a67e9bd0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef7edb5e9ce49e6b098f48bf060b228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:35.605362 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418b6ca-16c3-48b9-b13d-8ba2a67e9bd0 service nova] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:35.605645 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418b6ca-16c3-48b9-b13d-8ba2a67e9bd0 service nova] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:35.605927 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418b6ca-16c3-48b9-b13d-8ba2a67e9bd0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:35.628331 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:06:35.690343 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 814/1629] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:06:35 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:06:35.692453 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a9d62-8d48-4cd6-bc09-51c98b5d7910 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:35.692747 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a9d62-8d48-4cd6-bc09-51c98b5d7910 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:35.693027 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a9d62-8d48-4cd6-bc09-51c98b5d7910 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:35.695091 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 815/1630] 10.222.0.39 () {54 vars in 961 bytes} [Wed Jun 8 12:06:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:06:35.702181 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03f197-0f3f-4129-b28b-80438563d711 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:35.703275 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03f197-0f3f-4129-b28b-80438563d711 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:35.703782 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03f197-0f3f-4129-b28b-80438563d711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:35.717642 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3418b6ca-16c3-48b9-b13d-8ba2a67e9bd0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:35.719285 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3418b6ca-16c3-48b9-b13d-8ba2a67e9bd0 service nova] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:35.730601 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 816/1631] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:06:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:06:35.731464 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418b6ca-16c3-48b9-b13d-8ba2a67e9bd0 service nova] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:35.789695 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418b6ca-16c3-48b9-b13d-8ba2a67e9bd0 service nova] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:35.794052 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-9c03f197-0f3f-4129-b28b-80438563d711 None None] MFA Rules not processed for user `7ef7edb5e9ce49e6b098f48bf060b228`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:35.794401 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c84e25-708f-48bb-9fb0-332314607a4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:35.795034 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c84e25-708f-48bb-9fb0-332314607a4a service cinder] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:35.795468 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c84e25-708f-48bb-9fb0-332314607a4a service cinder] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:35.795745 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c84e25-708f-48bb-9fb0-332314607a4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:35.798989 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-9c03f197-0f3f-4129-b28b-80438563d711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:35.807399 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c84e25-708f-48bb-9fb0-332314607a4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:35.809264 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c84e25-708f-48bb-9fb0-332314607a4a service cinder] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:35.820926 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 817/1632] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:06:35 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:06:35.872601 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 816/1633] 10.222.0.39 () {58 vars in 1058 bytes} [Wed Jun 8 12:06:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:06:35.875763 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c274b69-9224-4ac5-9c30-eaab0bc5f658 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:35.876243 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c274b69-9224-4ac5-9c30-eaab0bc5f658 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:35.877374 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c274b69-9224-4ac5-9c30-eaab0bc5f658 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:35.878616 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 818/1634] 10.222.0.39 () {54 vars in 912 bytes} [Wed Jun 8 12:06:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:06:35.888181 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3edd4-0b80-49c8-8bb4-925c00909a16 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:35.888505 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3edd4-0b80-49c8-8bb4-925c00909a16 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:35.888792 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3edd4-0b80-49c8-8bb4-925c00909a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:35.924138 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:06:35.944250 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-6ae3edd4-0b80-49c8-8bb4-925c00909a16 None None] MFA Rules not processed for user `7ef7edb5e9ce49e6b098f48bf060b228`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:35.945744 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-6ae3edd4-0b80-49c8-8bb4-925c00909a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:35.969110 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 817/1635] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Jun 8 12:06:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:06:36.038167 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdd479-b108-4c0a-8b27-dbe4d148b503 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:36.038460 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdd479-b108-4c0a-8b27-dbe4d148b503 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:36.039076 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdd479-b108-4c0a-8b27-dbe4d148b503 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:36.041108 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 819/1636] 10.222.0.39 () {54 vars in 912 bytes} [Wed Jun 8 12:06:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:06:36.061546 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f84cdf-ece7-4608-a5b5-ccd2d1a83a73 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:36.062303 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f84cdf-ece7-4608-a5b5-ccd2d1a83a73 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:36.062582 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f84cdf-ece7-4608-a5b5-ccd2d1a83a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:36.098956 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-a1f84cdf-ece7-4608-a5b5-ccd2d1a83a73 None None] MFA Rules not processed for user `7ef7edb5e9ce49e6b098f48bf060b228`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:36.101530 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a1f84cdf-ece7-4608-a5b5-ccd2d1a83a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:36.132950 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 818/1637] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Jun 8 12:06:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:06:36.149925 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bdd479-b108-4c0a-8b27-dbe4d148b503 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:36.152034 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-b0bdd479-b108-4c0a-8b27-dbe4d148b503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:36.157772 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f84cdf-ece7-4608-a5b5-ccd2d1a83a73 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:36.174558 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f84cdf-ece7-4608-a5b5-ccd2d1a83a73 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:36.187565 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec586acd-4d86-4811-a134-8f47bdc161d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:36.189143 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec586acd-4d86-4811-a134-8f47bdc161d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:36.189735 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec586acd-4d86-4811-a134-8f47bdc161d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:36.190109 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec586acd-4d86-4811-a134-8f47bdc161d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:36.218649 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec586acd-4d86-4811-a134-8f47bdc161d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:36.220103 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec586acd-4d86-4811-a134-8f47bdc161d5 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:36.252831 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 819/1638] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:06:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:06:36.261193 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec586acd-4d86-4811-a134-8f47bdc161d5 service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:36.286728 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bdd479-b108-4c0a-8b27-dbe4d148b503 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:36.292477 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bcdfa7-eefd-420d-9a2c-cbd5be01b715 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2f8b5040a048c5bf4eef36f2ecd678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:36.293258 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcdfa7-eefd-420d-9a2c-cbd5be01b715 service glance] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:36.293518 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcdfa7-eefd-420d-9a2c-cbd5be01b715 service glance] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:36.293789 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcdfa7-eefd-420d-9a2c-cbd5be01b715 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:36.311855 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bcdfa7-eefd-420d-9a2c-cbd5be01b715 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:36.311855 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bcdfa7-eefd-420d-9a2c-cbd5be01b715 service glance] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:36.331220 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 820/1639] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:06:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:06:36.427902 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec586acd-4d86-4811-a134-8f47bdc161d5 service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:36.456539 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eff5ff-a8bb-4f0e-a541-4f02406e97be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:36.457409 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eff5ff-a8bb-4f0e-a541-4f02406e97be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:36.460497 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eff5ff-a8bb-4f0e-a541-4f02406e97be admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:36.462372 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eff5ff-a8bb-4f0e-a541-4f02406e97be admin admin] PATH_INFO: `/v3/users/b019d3e9a9c742c8af2954d82a9b5c7f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:36.466485 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eff5ff-a8bb-4f0e-a541-4f02406e97be admin admin] RBAC: Authorizing `identity:delete_user(user_id=b019d3e9a9c742c8af2954d82a9b5c7f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:36.472229 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: WARNING py.warnings [None req-74eff5ff-a8bb-4f0e-a541-4f02406e97be admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 08 12:06:36.472229 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: warnings.warn(msg) Jun 08 12:06:36.472229 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: Jun 08 12:06:36.475013 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eff5ff-a8bb-4f0e-a541-4f02406e97be admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:36.581556 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-74eff5ff-a8bb-4f0e-a541-4f02406e97be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b019d3e9a9c742c8af2954d82a9b5c7f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:36.582755 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-74eff5ff-a8bb-4f0e-a541-4f02406e97be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b019d3e9a9c742c8af2954d82a9b5c7f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:36.583582 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-74eff5ff-a8bb-4f0e-a541-4f02406e97be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b019d3e9a9c742c8af2954d82a9b5c7f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:36.617105 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-74eff5ff-a8bb-4f0e-a541-4f02406e97be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b019d3e9a9c742c8af2954d82a9b5c7f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:36.621724 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bcdfa7-eefd-420d-9a2c-cbd5be01b715 service glance] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:36.633823 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bcdfa7-eefd-420d-9a2c-cbd5be01b715 service glance] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:36.640512 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa69885-efc2-4c85-b0e1-b01adfcbbe0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:36.641417 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa69885-efc2-4c85-b0e1-b01adfcbbe0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:36.641956 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa69885-efc2-4c85-b0e1-b01adfcbbe0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:36.642180 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa69885-efc2-4c85-b0e1-b01adfcbbe0b admin admin] PATH_INFO: `/v3/users/a56c1d1321064f378f09730b3d6bbf8a` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:36.648119 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa69885-efc2-4c85-b0e1-b01adfcbbe0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a56c1d1321064f378f09730b3d6bbf8a)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:36.650784 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa69885-efc2-4c85-b0e1-b01adfcbbe0b admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:36.666054 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-74eff5ff-a8bb-4f0e-a541-4f02406e97be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b019d3e9a9c742c8af2954d82a9b5c7f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:36.693276 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 820/1640] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:06:36 2022] DELETE /identity/v3/users/b019d3e9a9c742c8af2954d82a9b5c7f => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:06:36.694737 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5c176-02e8-4353-9a10-9d3709e05ae2 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:36.695032 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5c176-02e8-4353-9a10-9d3709e05ae2 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:36.695316 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5c176-02e8-4353-9a10-9d3709e05ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:36.731038 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-efa69885-efc2-4c85-b0e1-b01adfcbbe0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a56c1d1321064f378f09730b3d6bbf8a'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:36.734711 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-60b5c176-02e8-4353-9a10-9d3709e05ae2 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:36.735969 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-60b5c176-02e8-4353-9a10-9d3709e05ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:36.736899 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:06:36.741565 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-efa69885-efc2-4c85-b0e1-b01adfcbbe0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a56c1d1321064f378f09730b3d6bbf8a'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:36.742384 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-efa69885-efc2-4c85-b0e1-b01adfcbbe0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a56c1d1321064f378f09730b3d6bbf8a'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:36.743808 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-efa69885-efc2-4c85-b0e1-b01adfcbbe0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a56c1d1321064f378f09730b3d6bbf8a'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:36.765080 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-efa69885-efc2-4c85-b0e1-b01adfcbbe0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a56c1d1321064f378f09730b3d6bbf8a'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:36.795969 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 821/1641] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:06:36 2022] DELETE /identity/v3/users/a56c1d1321064f378f09730b3d6bbf8a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:06:36.797948 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f6d6a-b42b-4a23-8679-d58ffd994058 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:36.800397 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f6d6a-b42b-4a23-8679-d58ffd994058 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:36.800913 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f6d6a-b42b-4a23-8679-d58ffd994058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:36.847410 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:06:36.853392 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-5b8f6d6a-b42b-4a23-8679-d58ffd994058 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:36.858301 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-5b8f6d6a-b42b-4a23-8679-d58ffd994058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:36.868910 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 821/1642] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:06:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:06:36.886877 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b5c176-02e8-4353-9a10-9d3709e05ae2 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:36.888384 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-60b5c176-02e8-4353-9a10-9d3709e05ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:36.975055 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 822/1643] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:06:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:06:36.998040 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f6d6a-b42b-4a23-8679-d58ffd994058 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:37.022886 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b5c176-02e8-4353-9a10-9d3709e05ae2 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:37.078732 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f6d6a-b42b-4a23-8679-d58ffd994058 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:37.088228 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c3029-a979-4a4a-a42a-09ee5ba5a003 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:37.090344 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c3029-a979-4a4a-a42a-09ee5ba5a003 service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:37.091473 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c3029-a979-4a4a-a42a-09ee5ba5a003 service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:37.091890 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c3029-a979-4a4a-a42a-09ee5ba5a003 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:37.118753 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57c3029-a979-4a4a-a42a-09ee5ba5a003 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:37.122721 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57c3029-a979-4a4a-a42a-09ee5ba5a003 service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:37.134017 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5c7fc8-3d69-43e0-a4f4-634b74bd682b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:37.135110 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c7fc8-3d69-43e0-a4f4-634b74bd682b service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:37.135405 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c7fc8-3d69-43e0-a4f4-634b74bd682b service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:37.135685 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c7fc8-3d69-43e0-a4f4-634b74bd682b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:37.153297 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 823/1644] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:06:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 12:06:37.159852 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5c7fc8-3d69-43e0-a4f4-634b74bd682b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:37.161488 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5c7fc8-3d69-43e0-a4f4-634b74bd682b service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:37.191797 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 822/1645] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:06:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 12:06:37.282802 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00323c9-4671-4712-9513-4300b05ed8a0 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:37.283091 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00323c9-4671-4712-9513-4300b05ed8a0 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:37.283369 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00323c9-4671-4712-9513-4300b05ed8a0 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:37.285427 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 824/1646] 10.222.0.39 () {54 vars in 912 bytes} [Wed Jun 8 12:06:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:06:37.291113 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e9fdf-cae8-4349-afeb-27217c436346 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:37.291651 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e9fdf-cae8-4349-afeb-27217c436346 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:37.292150 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e9fdf-cae8-4349-afeb-27217c436346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:37.341296 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-235e9fdf-cae8-4349-afeb-27217c436346 None None] MFA Rules not processed for user `2fef074aa2ea4570928109f62ea1aa96`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:37.342726 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-235e9fdf-cae8-4349-afeb-27217c436346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:37.362024 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 823/1647] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Jun 8 12:06:37 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:06:37.405667 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00323c9-4671-4712-9513-4300b05ed8a0 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:37.418197 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00323c9-4671-4712-9513-4300b05ed8a0 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:37.435058 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afefa581-f00c-49e3-a9dc-524ce63f653d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:37.435847 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afefa581-f00c-49e3-a9dc-524ce63f653d service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:37.436138 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afefa581-f00c-49e3-a9dc-524ce63f653d service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:37.436448 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afefa581-f00c-49e3-a9dc-524ce63f653d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:37.449397 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afefa581-f00c-49e3-a9dc-524ce63f653d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:37.450850 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afefa581-f00c-49e3-a9dc-524ce63f653d service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:37.460228 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 825/1648] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:06:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:06:39.091642 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e9fdf-cae8-4349-afeb-27217c436346 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:39.093282 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-235e9fdf-cae8-4349-afeb-27217c436346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:39.153010 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e9fdf-cae8-4349-afeb-27217c436346 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:39.159938 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b25bba-1a32-41bd-9ee3-6d36ceab3d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:39.160968 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b25bba-1a32-41bd-9ee3-6d36ceab3d5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:39.161348 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b25bba-1a32-41bd-9ee3-6d36ceab3d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:39.168474 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b25bba-1a32-41bd-9ee3-6d36ceab3d5c admin admin] PATH_INFO: `/v3/projects/ab06967b11ad40979c5b136d6acf64b5` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:39.173559 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b25bba-1a32-41bd-9ee3-6d36ceab3d5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab06967b11ad40979c5b136d6acf64b5)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:39.190040 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b25bba-1a32-41bd-9ee3-6d36ceab3d5c admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:39.288043 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51657efa-73dd-41e6-a165-3d113da65102 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:39.288912 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51657efa-73dd-41e6-a165-3d113da65102 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:39.288912 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51657efa-73dd-41e6-a165-3d113da65102 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:39.291281 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 826/1649] 10.222.0.39 () {54 vars in 960 bytes} [Wed Jun 8 12:06:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:06:39.302202 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19805aa9-0b92-4f63-90e2-176c457f4fc9 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:39.302714 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19805aa9-0b92-4f63-90e2-176c457f4fc9 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:39.303534 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19805aa9-0b92-4f63-90e2-176c457f4fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:39.339142 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-19805aa9-0b92-4f63-90e2-176c457f4fc9 None None] MFA Rules not processed for user `e9009560a846414b849d42efa8625ff5`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:39.340875 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-19805aa9-0b92-4f63-90e2-176c457f4fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:39.355714 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-39b25bba-1a32-41bd-9ee3-6d36ceab3d5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab06967b11ad40979c5b136d6acf64b5', 'request_id': 'req-39b25bba-1a32-41bd-9ee3-6d36ceab3d5c'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:39.373996 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-39b25bba-1a32-41bd-9ee3-6d36ceab3d5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab06967b11ad40979c5b136d6acf64b5', 'request_id': 'req-39b25bba-1a32-41bd-9ee3-6d36ceab3d5c'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:39.384017 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-39b25bba-1a32-41bd-9ee3-6d36ceab3d5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab06967b11ad40979c5b136d6acf64b5', 'request_id': 'req-39b25bba-1a32-41bd-9ee3-6d36ceab3d5c'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:39.435115 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-39b25bba-1a32-41bd-9ee3-6d36ceab3d5c admin admin] The token cache is being invalidate because project ab06967b11ad40979c5b136d6acf64b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:06:39.435422 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-39b25bba-1a32-41bd-9ee3-6d36ceab3d5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:39.436241 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-39b25bba-1a32-41bd-9ee3-6d36ceab3d5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:39.438471 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 824/1650] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:06:39 2022] DELETE /identity/v3/projects/ab06967b11ad40979c5b136d6acf64b5 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:06:39.444309 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07190413-459d-454d-b708-ca6e94c965a7 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:39.445024 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07190413-459d-454d-b708-ca6e94c965a7 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:39.445673 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07190413-459d-454d-b708-ca6e94c965a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:39.477821 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:06:39.500988 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-07190413-459d-454d-b708-ca6e94c965a7 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:39.504084 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-07190413-459d-454d-b708-ca6e94c965a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:39.521684 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 827/1651] 10.222.0.39 () {58 vars in 1057 bytes} [Wed Jun 8 12:06:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jun 08 12:06:39.522897 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19805aa9-0b92-4f63-90e2-176c457f4fc9 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:39.528206 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-19805aa9-0b92-4f63-90e2-176c457f4fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:39.584130 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:06:39.721039 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 825/1652] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:06:39.722200 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07190413-459d-454d-b708-ca6e94c965a7 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:39.751110 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19805aa9-0b92-4f63-90e2-176c457f4fc9 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:39.755026 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07190413-459d-454d-b708-ca6e94c965a7 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:39.756889 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f85b399-7e7f-4d4d-8e5b-5c8e72ed5429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:39.762199 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85b399-7e7f-4d4d-8e5b-5c8e72ed5429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:39.763191 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85b399-7e7f-4d4d-8e5b-5c8e72ed5429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:39.763709 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85b399-7e7f-4d4d-8e5b-5c8e72ed5429 admin admin] PATH_INFO: `/v3/projects/2012ff2b146342d0be7b0c453bc8880f` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:39.766294 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f85b399-7e7f-4d4d-8e5b-5c8e72ed5429 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2012ff2b146342d0be7b0c453bc8880f)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:39.767609 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: WARNING py.warnings [None req-2f85b399-7e7f-4d4d-8e5b-5c8e72ed5429 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 08 12:06:39.767609 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: warnings.warn(msg) Jun 08 12:06:39.767609 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: Jun 08 12:06:39.769279 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f85b399-7e7f-4d4d-8e5b-5c8e72ed5429 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:39.773825 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fc7a4a-9d42-4df1-8e93-6e2a3bc169e2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9009560a846414b849d42efa8625ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:39.776989 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc7a4a-9d42-4df1-8e93-6e2a3bc169e2 service placement] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:39.778116 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc7a4a-9d42-4df1-8e93-6e2a3bc169e2 service placement] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:39.778403 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc7a4a-9d42-4df1-8e93-6e2a3bc169e2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:39.782609 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-64fc7a4a-9d42-4df1-8e93-6e2a3bc169e2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:39.813370 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fc7a4a-9d42-4df1-8e93-6e2a3bc169e2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:39.817619 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fc7a4a-9d42-4df1-8e93-6e2a3bc169e2 service placement] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:39.859833 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 826/1653] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:06:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:06:39.861508 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf31fd1-e94b-4b79-a084-dea66906e98b None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:39.863691 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf31fd1-e94b-4b79-a084-dea66906e98b None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:39.865822 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf31fd1-e94b-4b79-a084-dea66906e98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:39.922845 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-2f85b399-7e7f-4d4d-8e5b-5c8e72ed5429 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2012ff2b146342d0be7b0c453bc8880f', 'request_id': 'req-2f85b399-7e7f-4d4d-8e5b-5c8e72ed5429'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:39.925098 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-ebf31fd1-e94b-4b79-a084-dea66906e98b None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:39.926557 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ebf31fd1-e94b-4b79-a084-dea66906e98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:39.935598 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-2f85b399-7e7f-4d4d-8e5b-5c8e72ed5429 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2012ff2b146342d0be7b0c453bc8880f', 'request_id': 'req-2f85b399-7e7f-4d4d-8e5b-5c8e72ed5429'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:39.946212 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-2f85b399-7e7f-4d4d-8e5b-5c8e72ed5429 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2012ff2b146342d0be7b0c453bc8880f', 'request_id': 'req-2f85b399-7e7f-4d4d-8e5b-5c8e72ed5429'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:39.996454 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-2f85b399-7e7f-4d4d-8e5b-5c8e72ed5429 admin admin] The token cache is being invalidate because project 2012ff2b146342d0be7b0c453bc8880f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:06:39.997391 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-2f85b399-7e7f-4d4d-8e5b-5c8e72ed5429 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:39.998772 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-2f85b399-7e7f-4d4d-8e5b-5c8e72ed5429 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:40.002292 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 828/1654] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:06:39 2022] DELETE /identity/v3/projects/2012ff2b146342d0be7b0c453bc8880f => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:06:40.006940 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f85b399-7e7f-4d4d-8e5b-5c8e72ed5429 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:40.010117 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-2f85b399-7e7f-4d4d-8e5b-5c8e72ed5429 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:40.125011 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 827/1655] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:06:40.127463 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf31fd1-e94b-4b79-a084-dea66906e98b None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:40.146914 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf31fd1-e94b-4b79-a084-dea66906e98b None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:40.165892 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cae6a8-2dd0-429f-9bd0-866c3c2cf9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:40.166631 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cae6a8-2dd0-429f-9bd0-866c3c2cf9d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:40.167600 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cae6a8-2dd0-429f-9bd0-866c3c2cf9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:40.168268 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cae6a8-2dd0-429f-9bd0-866c3c2cf9d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:40.170817 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cae6a8-2dd0-429f-9bd0-866c3c2cf9d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:06:40.172337 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cae6a8-2dd0-429f-9bd0-866c3c2cf9d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:40.174970 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cae6a8-2dd0-429f-9bd0-866c3c2cf9d4 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:40.213676 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f85b399-7e7f-4d4d-8e5b-5c8e72ed5429 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:40.223603 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 828/1656] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:06:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:06:40.225935 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cae6a8-2dd0-429f-9bd0-866c3c2cf9d4 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:40.237700 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea4aa8-143c-4dbd-b314-b4191ccdbf02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:40.241188 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea4aa8-143c-4dbd-b314-b4191ccdbf02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:40.241489 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea4aa8-143c-4dbd-b314-b4191ccdbf02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:40.241777 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea4aa8-143c-4dbd-b314-b4191ccdbf02 admin admin] PATH_INFO: `/v3/users/a092a3c94db04779a9a562d681a58a74` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:40.249819 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea4aa8-143c-4dbd-b314-b4191ccdbf02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a092a3c94db04779a9a562d681a58a74)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:40.253680 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea4aa8-143c-4dbd-b314-b4191ccdbf02 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:40.263208 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cae6a8-2dd0-429f-9bd0-866c3c2cf9d4 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:40.281011 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320385c-c401-405c-bd83-78bc888ceee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:40.282160 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320385c-c401-405c-bd83-78bc888ceee8 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:40.282160 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320385c-c401-405c-bd83-78bc888ceee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:40.282426 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320385c-c401-405c-bd83-78bc888ceee8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:40.283146 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1320385c-c401-405c-bd83-78bc888ceee8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:40.290663 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1320385c-c401-405c-bd83-78bc888ceee8 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:40.347011 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:06:40.397545 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 829/1657] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:06:40 2022] POST /identity/v3/projects => generated 355 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:06:40.400579 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320385c-c401-405c-bd83-78bc888ceee8 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:40.411877 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-69ea4aa8-143c-4dbd-b314-b4191ccdbf02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a092a3c94db04779a9a562d681a58a74'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:40.434533 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-69ea4aa8-143c-4dbd-b314-b4191ccdbf02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a092a3c94db04779a9a562d681a58a74'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:40.436745 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-69ea4aa8-143c-4dbd-b314-b4191ccdbf02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a092a3c94db04779a9a562d681a58a74'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:40.439188 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-69ea4aa8-143c-4dbd-b314-b4191ccdbf02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a092a3c94db04779a9a562d681a58a74'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:40.475606 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-69ea4aa8-143c-4dbd-b314-b4191ccdbf02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a092a3c94db04779a9a562d681a58a74'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:40.522104 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 829/1658] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:06:40 2022] DELETE /identity/v3/users/a092a3c94db04779a9a562d681a58a74 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:06:40.622256 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320385c-c401-405c-bd83-78bc888ceee8 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:40.700758 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:06:40.850358 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142aac7-2e70-41fc-a527-f5ec674e2c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:40.851095 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142aac7-2e70-41fc-a527-f5ec674e2c57 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:40.851378 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142aac7-2e70-41fc-a527-f5ec674e2c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:40.851653 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142aac7-2e70-41fc-a527-f5ec674e2c57 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:40.855281 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f142aac7-2e70-41fc-a527-f5ec674e2c57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:40.859168 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f142aac7-2e70-41fc-a527-f5ec674e2c57 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:40.964143 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 830/1659] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:06:40 2022] POST /identity/v3/users => generated 278 bytes in 561 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:06:40.966191 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea4aa8-143c-4dbd-b314-b4191ccdbf02 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:40.968278 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-69ea4aa8-143c-4dbd-b314-b4191ccdbf02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:41.014920 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea4aa8-143c-4dbd-b314-b4191ccdbf02 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:41.037118 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff52ce2-cbf8-4250-9e9a-9bc30b5ca67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:41.038133 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff52ce2-cbf8-4250-9e9a-9bc30b5ca67c admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:41.040649 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff52ce2-cbf8-4250-9e9a-9bc30b5ca67c admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:41.041110 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff52ce2-cbf8-4250-9e9a-9bc30b5ca67c admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:41.044135 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff52ce2-cbf8-4250-9e9a-9bc30b5ca67c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:41.053888 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff52ce2-cbf8-4250-9e9a-9bc30b5ca67c admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:41.110169 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 830/1660] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:06:41.111697 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142aac7-2e70-41fc-a527-f5ec674e2c57 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:41.138920 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142aac7-2e70-41fc-a527-f5ec674e2c57 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:41.151004 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d49d39-0d08-4350-b31b-db59df29f7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:41.152486 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d49d39-0d08-4350-b31b-db59df29f7a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:41.154119 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d49d39-0d08-4350-b31b-db59df29f7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:41.154548 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d49d39-0d08-4350-b31b-db59df29f7a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:41.157680 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d49d39-0d08-4350-b31b-db59df29f7a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:41.162163 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d49d39-0d08-4350-b31b-db59df29f7a0 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:41.220043 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 831/1661] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:06:41.224884 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff52ce2-cbf8-4250-9e9a-9bc30b5ca67c admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:41.246684 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff52ce2-cbf8-4250-9e9a-9bc30b5ca67c admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:41.270538 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df85d507-8c3b-431c-879e-f72f4bb4391a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:41.271834 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85d507-8c3b-431c-879e-f72f4bb4391a admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:41.277304 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85d507-8c3b-431c-879e-f72f4bb4391a admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:41.278756 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85d507-8c3b-431c-879e-f72f4bb4391a admin admin] PATH_INFO: `/v3/projects/7694b648b26542f9b0a61841d645ca93/users/d8507d28c24d4552b026aa6b14eb32b6/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:41.334745 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df85d507-8c3b-431c-879e-f72f4bb4391a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7694b648b26542f9b0a61841d645ca93, user_id=d8507d28c24d4552b026aa6b14eb32b6, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:41.345798 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df85d507-8c3b-431c-879e-f72f4bb4391a admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:41.418530 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158a647-6261-42ac-8875-1d5956ca914a None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:41.418831 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158a647-6261-42ac-8875-1d5956ca914a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:41.419111 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158a647-6261-42ac-8875-1d5956ca914a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:41.419272 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 831/1662] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:06:41 2022] PUT /identity/v3/projects/7694b648b26542f9b0a61841d645ca93/users/d8507d28c24d4552b026aa6b14eb32b6/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:06:41.489945 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-7158a647-6261-42ac-8875-1d5956ca914a None None] MFA Rules not processed for user `d8507d28c24d4552b026aa6b14eb32b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:41.491687 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-7158a647-6261-42ac-8875-1d5956ca914a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:41.702554 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 832/1663] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:06:41 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:06:41.705059 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df85d507-8c3b-431c-879e-f72f4bb4391a admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:41.826368 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df85d507-8c3b-431c-879e-f72f4bb4391a admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:41.858420 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca271bec-9c1a-4f9f-8529-56fea63b0b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:41.859135 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca271bec-9c1a-4f9f-8529-56fea63b0b37 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:41.859817 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca271bec-9c1a-4f9f-8529-56fea63b0b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:41.860114 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca271bec-9c1a-4f9f-8529-56fea63b0b37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:41.860883 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca271bec-9c1a-4f9f-8529-56fea63b0b37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:41.872338 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca271bec-9c1a-4f9f-8529-56fea63b0b37 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:41.899132 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7158a647-6261-42ac-8875-1d5956ca914a None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:41.901105 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-7158a647-6261-42ac-8875-1d5956ca914a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:41.943635 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7158a647-6261-42ac-8875-1d5956ca914a None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:41.958587 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5208fa-fd8a-401b-b7e4-37580f940712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:41.959915 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5208fa-fd8a-401b-b7e4-37580f940712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:41.960069 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5208fa-fd8a-401b-b7e4-37580f940712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:41.960372 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5208fa-fd8a-401b-b7e4-37580f940712 admin admin] PATH_INFO: `/v3/projects/045c6657258b41dcb75c1bd8cf423a7c` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:41.966983 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5208fa-fd8a-401b-b7e4-37580f940712 admin admin] RBAC: Authorizing `identity:delete_project(project_id=045c6657258b41dcb75c1bd8cf423a7c)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:41.978083 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5208fa-fd8a-401b-b7e4-37580f940712 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:42.014228 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 832/1664] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:06:41 2022] POST /identity/v3/projects => generated 357 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:06:42.027752 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca271bec-9c1a-4f9f-8529-56fea63b0b37 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:42.128669 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-db5208fa-fd8a-401b-b7e4-37580f940712 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '045c6657258b41dcb75c1bd8cf423a7c', 'request_id': 'req-db5208fa-fd8a-401b-b7e4-37580f940712'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:42.153572 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-db5208fa-fd8a-401b-b7e4-37580f940712 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '045c6657258b41dcb75c1bd8cf423a7c', 'request_id': 'req-db5208fa-fd8a-401b-b7e4-37580f940712'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:42.172070 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-db5208fa-fd8a-401b-b7e4-37580f940712 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '045c6657258b41dcb75c1bd8cf423a7c', 'request_id': 'req-db5208fa-fd8a-401b-b7e4-37580f940712'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:42.246747 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:06:42.258269 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca271bec-9c1a-4f9f-8529-56fea63b0b37 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:42.258666 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-db5208fa-fd8a-401b-b7e4-37580f940712 admin admin] The token cache is being invalidate because project 045c6657258b41dcb75c1bd8cf423a7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:06:42.262326 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-db5208fa-fd8a-401b-b7e4-37580f940712 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:42.266675 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-db5208fa-fd8a-401b-b7e4-37580f940712 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:42.284933 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 833/1665] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:06:41 2022] DELETE /identity/v3/projects/045c6657258b41dcb75c1bd8cf423a7c => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:06:42.288442 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c5a35-5382-4693-88ea-e78e5952926c None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:42.288912 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c5a35-5382-4693-88ea-e78e5952926c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:42.294852 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c5a35-5382-4693-88ea-e78e5952926c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:42.353011 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-173c5a35-5382-4693-88ea-e78e5952926c None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:42.363663 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-173c5a35-5382-4693-88ea-e78e5952926c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:42.393008 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:06:42.467461 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c48c02-43e0-4aa9-b889-ded4afb8bd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:42.470244 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c48c02-43e0-4aa9-b889-ded4afb8bd59 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:42.471104 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c48c02-43e0-4aa9-b889-ded4afb8bd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:42.472970 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c48c02-43e0-4aa9-b889-ded4afb8bd59 admin admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:42.474358 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c48c02-43e0-4aa9-b889-ded4afb8bd59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:42.479372 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c48c02-43e0-4aa9-b889-ded4afb8bd59 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:42.558401 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 833/1666] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:06:42 2022] POST /identity/v3/users => generated 285 bytes in 541 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:06:42.559572 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c48c02-43e0-4aa9-b889-ded4afb8bd59 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:42.564983 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-45c48c02-43e0-4aa9-b889-ded4afb8bd59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:42.591279 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 834/1667] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:06:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:06:42.593160 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36b4e5-c399-4c35-b234-f2f7ba283653 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:42.593654 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36b4e5-c399-4c35-b234-f2f7ba283653 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:42.594159 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36b4e5-c399-4c35-b234-f2f7ba283653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:42.605692 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c48c02-43e0-4aa9-b889-ded4afb8bd59 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:42.618684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-7b36b4e5-c399-4c35-b234-f2f7ba283653 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:42.620307 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-7b36b4e5-c399-4c35-b234-f2f7ba283653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:42.646449 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 835/1668] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:06:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:06:42.648112 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36b4e5-c399-4c35-b234-f2f7ba283653 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:42.650011 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f90a7e-3336-4a39-b671-5ca58d81b445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:42.650724 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f90a7e-3336-4a39-b671-5ca58d81b445 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:42.651016 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f90a7e-3336-4a39-b671-5ca58d81b445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:42.651299 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f90a7e-3336-4a39-b671-5ca58d81b445 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:42.657434 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f90a7e-3336-4a39-b671-5ca58d81b445 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:42.659220 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f90a7e-3336-4a39-b671-5ca58d81b445 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:42.666015 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36b4e5-c399-4c35-b234-f2f7ba283653 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:42.672740 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51e43a-2eb6-4502-a2cb-a2a5a68738c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:42.673806 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51e43a-2eb6-4502-a2cb-a2a5a68738c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:42.674289 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51e43a-2eb6-4502-a2cb-a2a5a68738c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:42.674784 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51e43a-2eb6-4502-a2cb-a2a5a68738c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:42.675747 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51e43a-2eb6-4502-a2cb-a2a5a68738c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:06:42.676307 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51e43a-2eb6-4502-a2cb-a2a5a68738c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:42.678948 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51e43a-2eb6-4502-a2cb-a2a5a68738c7 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:42.698827 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 836/1669] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:06:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:06:42.700082 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51e43a-2eb6-4502-a2cb-a2a5a68738c7 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:42.712119 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51e43a-2eb6-4502-a2cb-a2a5a68738c7 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:42.718330 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a91401d-1f2b-47f4-b10e-80c77e86065a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:42.719695 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91401d-1f2b-47f4-b10e-80c77e86065a admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:42.720223 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91401d-1f2b-47f4-b10e-80c77e86065a admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:42.720901 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91401d-1f2b-47f4-b10e-80c77e86065a admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:42.722525 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a91401d-1f2b-47f4-b10e-80c77e86065a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:42.724693 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a91401d-1f2b-47f4-b10e-80c77e86065a admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:42.728628 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 834/1670] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:06:42.731455 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f90a7e-3336-4a39-b671-5ca58d81b445 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:42.767115 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f90a7e-3336-4a39-b671-5ca58d81b445 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:42.779378 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 837/1671] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:06:42 2022] POST /identity/v3/projects => generated 385 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:06:42.788819 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a91401d-1f2b-47f4-b10e-80c77e86065a admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:42.792327 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e6ad1c-9795-46dc-896b-1d5d99f15162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:42.794226 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6ad1c-9795-46dc-896b-1d5d99f15162 admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:42.798644 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6ad1c-9795-46dc-896b-1d5d99f15162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:42.799058 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6ad1c-9795-46dc-896b-1d5d99f15162 admin admin] PATH_INFO: `/v3/projects/5410b06e72d6407281f667cdd48936af/users/ac804548fa7a4cc786a03572a30a188b/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:42.859731 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e6ad1c-9795-46dc-896b-1d5d99f15162 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5410b06e72d6407281f667cdd48936af, user_id=ac804548fa7a4cc786a03572a30a188b, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:42.866517 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e6ad1c-9795-46dc-896b-1d5d99f15162 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:42.923625 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 835/1672] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:06:42 2022] PUT /identity/v3/projects/5410b06e72d6407281f667cdd48936af/users/ac804548fa7a4cc786a03572a30a188b/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:06:42.927345 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e6ad1c-9795-46dc-896b-1d5d99f15162 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:42.945225 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a91401d-1f2b-47f4-b10e-80c77e86065a admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:43.077082 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e6ad1c-9795-46dc-896b-1d5d99f15162 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:43.094388 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bbebbd-4a8c-4aa2-bf96-fb2e32e86775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:43.096685 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bbebbd-4a8c-4aa2-bf96-fb2e32e86775 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:43.097288 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bbebbd-4a8c-4aa2-bf96-fb2e32e86775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:43.097869 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bbebbd-4a8c-4aa2-bf96-fb2e32e86775 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:43.103028 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bbebbd-4a8c-4aa2-bf96-fb2e32e86775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:43.105540 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eee817-9357-4b36-8144-20e65c573d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:43.106475 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bbebbd-4a8c-4aa2-bf96-fb2e32e86775 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:43.106723 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eee817-9357-4b36-8144-20e65c573d79 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:43.107213 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eee817-9357-4b36-8144-20e65c573d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:43.107666 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eee817-9357-4b36-8144-20e65c573d79 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:43.108664 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eee817-9357-4b36-8144-20e65c573d79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:43.125099 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eee817-9357-4b36-8144-20e65c573d79 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:43.135142 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 836/1673] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:06:43.137537 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bbebbd-4a8c-4aa2-bf96-fb2e32e86775 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:43.151183 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bbebbd-4a8c-4aa2-bf96-fb2e32e86775 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:43.188422 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b5087-7f10-4d55-b14b-d2e97ab195ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:43.190254 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b5087-7f10-4d55-b14b-d2e97ab195ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:43.191913 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b5087-7f10-4d55-b14b-d2e97ab195ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:43.194773 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b5087-7f10-4d55-b14b-d2e97ab195ae admin admin] PATH_INFO: `/v3/projects/5410b06e72d6407281f667cdd48936af/users/ac804548fa7a4cc786a03572a30a188b/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:43.197583 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 838/1674] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:06:42 2022] POST /identity/v3/users => generated 293 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:06:43.199114 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b5087-7f10-4d55-b14b-d2e97ab195ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=5410b06e72d6407281f667cdd48936af, user_id=ac804548fa7a4cc786a03572a30a188b, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:43.204678 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eee817-9357-4b36-8144-20e65c573d79 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:43.205419 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b5087-7f10-4d55-b14b-d2e97ab195ae admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:43.239901 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 837/1675] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:06:43 2022] PUT /identity/v3/projects/5410b06e72d6407281f667cdd48936af/users/ac804548fa7a4cc786a03572a30a188b/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:06:43.254854 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598b09f-5545-421e-ae20-b6cce82fe4b3 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:43.255077 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598b09f-5545-421e-ae20-b6cce82fe4b3 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:43.255513 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598b09f-5545-421e-ae20-b6cce82fe4b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:43.275065 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eee817-9357-4b36-8144-20e65c573d79 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:43.286072 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:06:43.322282 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-3598b09f-5545-421e-ae20-b6cce82fe4b3 None None] MFA Rules not processed for user `ac804548fa7a4cc786a03572a30a188b`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:43.324057 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-3598b09f-5545-421e-ae20-b6cce82fe4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:43.432155 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:06:43.451330 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a893fa5-c3b2-43e7-b607-7bc323385628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:43.453491 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a893fa5-c3b2-43e7-b607-7bc323385628 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:43.453779 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a893fa5-c3b2-43e7-b607-7bc323385628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:43.457247 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a893fa5-c3b2-43e7-b607-7bc323385628 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:43.460728 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a893fa5-c3b2-43e7-b607-7bc323385628 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:43.465549 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a893fa5-c3b2-43e7-b607-7bc323385628 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:43.501692 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 838/1676] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:06:43 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:06:43.511943 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 839/1677] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:06:43.515745 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3598b09f-5545-421e-ae20-b6cce82fe4b3 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:43.518662 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a893fa5-c3b2-43e7-b607-7bc323385628 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:43.525826 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-0a893fa5-c3b2-43e7-b607-7bc323385628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:43.543468 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3598b09f-5545-421e-ae20-b6cce82fe4b3 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:43.549794 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962bd96c-670a-4467-b7a9-37adf4df7269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:43.550912 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962bd96c-670a-4467-b7a9-37adf4df7269 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:43.551392 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962bd96c-670a-4467-b7a9-37adf4df7269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:43.552388 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962bd96c-670a-4467-b7a9-37adf4df7269 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:43.554086 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962bd96c-670a-4467-b7a9-37adf4df7269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:43.556514 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962bd96c-670a-4467-b7a9-37adf4df7269 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:43.616439 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 839/1678] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:06:43.619667 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962bd96c-670a-4467-b7a9-37adf4df7269 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:43.631593 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962bd96c-670a-4467-b7a9-37adf4df7269 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:43.660260 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc7882-4461-4431-a860-13f96e6817a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:43.660260 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc7882-4461-4431-a860-13f96e6817a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:43.660607 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc7882-4461-4431-a860-13f96e6817a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:43.661311 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc7882-4461-4431-a860-13f96e6817a1 admin admin] PATH_INFO: `/v3/projects/8955b3b8a2634c07866a50afc71a0dd0/users/70148fe224214403a17020881ce4531c/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:43.679703 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a893fa5-c3b2-43e7-b607-7bc323385628 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:43.698106 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80820cc9-9055-49b4-901c-c6f01659aba8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:43.698794 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80820cc9-9055-49b4-901c-c6f01659aba8 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:43.699081 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80820cc9-9055-49b4-901c-c6f01659aba8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:43.699361 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80820cc9-9055-49b4-901c-c6f01659aba8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:43.720305 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80820cc9-9055-49b4-901c-c6f01659aba8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:43.721691 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bc7882-4461-4431-a860-13f96e6817a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8955b3b8a2634c07866a50afc71a0dd0, user_id=70148fe224214403a17020881ce4531c, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:43.721811 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80820cc9-9055-49b4-901c-c6f01659aba8 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:43.724839 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bc7882-4461-4431-a860-13f96e6817a1 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:43.755385 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 840/1679] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:06:43 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:06:43.760267 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a658384-6e7d-407a-a9cd-eee9ab32a974 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:43.760562 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a658384-6e7d-407a-a9cd-eee9ab32a974 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:43.761969 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a658384-6e7d-407a-a9cd-eee9ab32a974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:43.781713 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 840/1680] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:06:43 2022] PUT /identity/v3/projects/8955b3b8a2634c07866a50afc71a0dd0/users/70148fe224214403a17020881ce4531c/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:06:43.794263 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498cbf6-b474-47c5-b2a2-fa1aa911f6be None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:43.794638 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498cbf6-b474-47c5-b2a2-fa1aa911f6be None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:43.795042 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498cbf6-b474-47c5-b2a2-fa1aa911f6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:43.825479 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-2a658384-6e7d-407a-a9cd-eee9ab32a974 None None] MFA Rules not processed for user `d52efc21c66d4300a8a979d92dbfeb47`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:43.828577 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-2a658384-6e7d-407a-a9cd-eee9ab32a974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:43.872358 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-e498cbf6-b474-47c5-b2a2-fa1aa911f6be None None] MFA Rules not processed for user `70148fe224214403a17020881ce4531c`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:43.874056 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-e498cbf6-b474-47c5-b2a2-fa1aa911f6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:43.955443 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 841/1681] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Jun 8 12:06:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:06:43.970604 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a658384-6e7d-407a-a9cd-eee9ab32a974 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:43.974679 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-2a658384-6e7d-407a-a9cd-eee9ab32a974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:44.151147 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a658384-6e7d-407a-a9cd-eee9ab32a974 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:44.162588 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 841/1682] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:06:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:06:44.163658 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904dc3b-472a-4339-b38b-3379bf8f19b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:44.165068 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904dc3b-472a-4339-b38b-3379bf8f19b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:44.165474 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904dc3b-472a-4339-b38b-3379bf8f19b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:44.166128 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904dc3b-472a-4339-b38b-3379bf8f19b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:44.168201 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498cbf6-b474-47c5-b2a2-fa1aa911f6be None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:44.174152 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-e904dc3b-472a-4339-b38b-3379bf8f19b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:44.204485 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:06:44.329605 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498cbf6-b474-47c5-b2a2-fa1aa911f6be None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:44.346064 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba9a71-61c1-496e-ad7a-7c31ca4b7c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:44.346401 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba9a71-61c1-496e-ad7a-7c31ca4b7c24 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:44.346681 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba9a71-61c1-496e-ad7a-7c31ca4b7c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:44.347249 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba9a71-61c1-496e-ad7a-7c31ca4b7c24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:44.349231 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ba9a71-61c1-496e-ad7a-7c31ca4b7c24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:44.351231 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ba9a71-61c1-496e-ad7a-7c31ca4b7c24 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:44.377778 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e904dc3b-472a-4339-b38b-3379bf8f19b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:44.381222 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e904dc3b-472a-4339-b38b-3379bf8f19b8 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:44.404783 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 842/1683] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:06:43 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:06:44.411305 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904dc3b-472a-4339-b38b-3379bf8f19b8 service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:44.419345 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 842/1684] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:06:44 2022] POST /identity/v3/projects => generated 385 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 12:06:44.421936 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-e904dc3b-472a-4339-b38b-3379bf8f19b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:44.423974 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba9a71-61c1-496e-ad7a-7c31ca4b7c24 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:44.435665 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:06:44.523668 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba9a71-61c1-496e-ad7a-7c31ca4b7c24 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:44.530432 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51808bb2-ee79-4bb8-9a11-37f3be008d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:44.531191 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51808bb2-ee79-4bb8-9a11-37f3be008d0f admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:44.531481 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51808bb2-ee79-4bb8-9a11-37f3be008d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:44.531755 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51808bb2-ee79-4bb8-9a11-37f3be008d0f admin admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:44.532652 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51808bb2-ee79-4bb8-9a11-37f3be008d0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:44.534850 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51808bb2-ee79-4bb8-9a11-37f3be008d0f admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:44.569808 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 843/1685] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:06:44 2022] POST /identity/v3/users => generated 299 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:06:44.573676 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51808bb2-ee79-4bb8-9a11-37f3be008d0f admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:44.616241 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51808bb2-ee79-4bb8-9a11-37f3be008d0f admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:44.629142 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b532d-b62c-4b90-ae73-74783b9d6e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:44.629925 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b532d-b62c-4b90-ae73-74783b9d6e34 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:44.631152 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904dc3b-472a-4339-b38b-3379bf8f19b8 service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:44.631511 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b532d-b62c-4b90-ae73-74783b9d6e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:44.631893 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b532d-b62c-4b90-ae73-74783b9d6e34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:44.634631 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b532d-b62c-4b90-ae73-74783b9d6e34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:44.638187 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b532d-b62c-4b90-ae73-74783b9d6e34 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:44.673873 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 844/1686] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:06:44 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:06:44.679002 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b532d-b62c-4b90-ae73-74783b9d6e34 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:44.702487 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b532d-b62c-4b90-ae73-74783b9d6e34 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:44.719648 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423028e-4cee-44fa-9d2a-9d0f11ab2c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:44.722750 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423028e-4cee-44fa-9d2a-9d0f11ab2c43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:44.723609 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423028e-4cee-44fa-9d2a-9d0f11ab2c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:44.723609 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423028e-4cee-44fa-9d2a-9d0f11ab2c43 admin admin] PATH_INFO: `/v3/projects/4f1709bd87424a64a3100c5907693fd3/users/ea19b5b5f04a48679ceaec7d409b4fe0/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:44.763320 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5423028e-4cee-44fa-9d2a-9d0f11ab2c43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f1709bd87424a64a3100c5907693fd3, user_id=ea19b5b5f04a48679ceaec7d409b4fe0, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:44.769018 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5423028e-4cee-44fa-9d2a-9d0f11ab2c43 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:44.800446 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1686fe-9a77-4071-bcf2-d438c716e052 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753bde6a72d64045abd3ad44b9b0de04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:44.801075 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 845/1687] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:06:44 2022] PUT /identity/v3/projects/4f1709bd87424a64a3100c5907693fd3/users/ea19b5b5f04a48679ceaec7d409b4fe0/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:06:44.802162 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1686fe-9a77-4071-bcf2-d438c716e052 service swift] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:44.803208 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1686fe-9a77-4071-bcf2-d438c716e052 service swift] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:44.803704 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1686fe-9a77-4071-bcf2-d438c716e052 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:44.804838 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423028e-4cee-44fa-9d2a-9d0f11ab2c43 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:44.927563 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423028e-4cee-44fa-9d2a-9d0f11ab2c43 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:44.936450 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e9141d-818a-412e-8938-da31420ce74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:44.937984 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9141d-818a-412e-8938-da31420ce74e admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:44.938471 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9141d-818a-412e-8938-da31420ce74e admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:44.939633 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9141d-818a-412e-8938-da31420ce74e admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:44.940670 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e9141d-818a-412e-8938-da31420ce74e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:44.943743 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e9141d-818a-412e-8938-da31420ce74e admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:44.947747 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:06:44.963881 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1686fe-9a77-4071-bcf2-d438c716e052 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:44.967887 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1686fe-9a77-4071-bcf2-d438c716e052 service swift] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:44.982501 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 846/1688] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:06:44 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:06:44.984754 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e9141d-818a-412e-8938-da31420ce74e admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:44.991526 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 843/1689] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Jun 8 12:06:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 12:06:45.009353 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e9141d-818a-412e-8938-da31420ce74e admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:45.022176 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26568b3-ec6c-4f34-933e-492bc1c28474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:45.023024 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26568b3-ec6c-4f34-933e-492bc1c28474 admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:45.023320 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26568b3-ec6c-4f34-933e-492bc1c28474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:45.023644 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26568b3-ec6c-4f34-933e-492bc1c28474 admin admin] PATH_INFO: `/v3/projects/4f1709bd87424a64a3100c5907693fd3/users/ea19b5b5f04a48679ceaec7d409b4fe0/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:45.029902 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26568b3-ec6c-4f34-933e-492bc1c28474 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f1709bd87424a64a3100c5907693fd3, user_id=ea19b5b5f04a48679ceaec7d409b4fe0, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:45.032716 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26568b3-ec6c-4f34-933e-492bc1c28474 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:45.072418 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 847/1690] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:06:44 2022] PUT /identity/v3/projects/4f1709bd87424a64a3100c5907693fd3/users/ea19b5b5f04a48679ceaec7d409b4fe0/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:06:45.091563 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b2830-fae1-4826-8250-93508477bff9 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:45.091994 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b2830-fae1-4826-8250-93508477bff9 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:45.093788 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b2830-fae1-4826-8250-93508477bff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:45.237274 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-a90b2830-fae1-4826-8250-93508477bff9 None None] MFA Rules not processed for user `ea19b5b5f04a48679ceaec7d409b4fe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:45.245199 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a90b2830-fae1-4826-8250-93508477bff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:45.570552 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 844/1691] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:06:45 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 488 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:06:45.579381 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26568b3-ec6c-4f34-933e-492bc1c28474 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:45.719747 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:06:45.744822 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26568b3-ec6c-4f34-933e-492bc1c28474 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:45.752198 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e9d59f-056a-4352-9ab7-a53e5646814c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:45.752910 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9d59f-056a-4352-9ab7-a53e5646814c service cinder] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:45.753199 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9d59f-056a-4352-9ab7-a53e5646814c service cinder] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:45.753581 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9d59f-056a-4352-9ab7-a53e5646814c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:45.777915 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e9d59f-056a-4352-9ab7-a53e5646814c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:45.779418 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e9d59f-056a-4352-9ab7-a53e5646814c service cinder] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:45.805927 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 848/1692] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:06:45 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:06:45.958710 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90b2830-fae1-4826-8250-93508477bff9 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:46.163233 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90b2830-fae1-4826-8250-93508477bff9 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:46.180654 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf3af56-2f1a-47a6-894f-9e7199f1d777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:46.186292 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf3af56-2f1a-47a6-894f-9e7199f1d777 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:46.186439 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf3af56-2f1a-47a6-894f-9e7199f1d777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:46.186683 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf3af56-2f1a-47a6-894f-9e7199f1d777 admin admin] PATH_INFO: `/v3/users/70148fe224214403a17020881ce4531c` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:46.191469 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf3af56-2f1a-47a6-894f-9e7199f1d777 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70148fe224214403a17020881ce4531c)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:46.199303 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf3af56-2f1a-47a6-894f-9e7199f1d777 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:46.345635 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-0bf3af56-2f1a-47a6-894f-9e7199f1d777 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70148fe224214403a17020881ce4531c'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:46.347543 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-0bf3af56-2f1a-47a6-894f-9e7199f1d777 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70148fe224214403a17020881ce4531c'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:46.349562 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-0bf3af56-2f1a-47a6-894f-9e7199f1d777 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70148fe224214403a17020881ce4531c'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:46.374793 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-0bf3af56-2f1a-47a6-894f-9e7199f1d777 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70148fe224214403a17020881ce4531c'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:46.410008 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-0bf3af56-2f1a-47a6-894f-9e7199f1d777 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70148fe224214403a17020881ce4531c'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:46.419834 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:06:46.442746 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 845/1693] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:06:45 2022] DELETE /identity/v3/users/70148fe224214403a17020881ce4531c => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:06:46.447561 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847d4d6-7df9-4366-b985-0c7c2d443f4d None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:46.447857 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847d4d6-7df9-4366-b985-0c7c2d443f4d None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:46.448140 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847d4d6-7df9-4366-b985-0c7c2d443f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:46.493486 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-e847d4d6-7df9-4366-b985-0c7c2d443f4d None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:46.496643 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-e847d4d6-7df9-4366-b985-0c7c2d443f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:46.748447 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 849/1694] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:06:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:06:46.817702 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf3af56-2f1a-47a6-894f-9e7199f1d777 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:46.819201 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-0bf3af56-2f1a-47a6-894f-9e7199f1d777 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:47.096233 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf3af56-2f1a-47a6-894f-9e7199f1d777 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:47.106842 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0b875-0b11-48f9-b8a3-3050025a6349 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:47.107513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0b875-0b11-48f9-b8a3-3050025a6349 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:47.107803 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0b875-0b11-48f9-b8a3-3050025a6349 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:47.108082 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0b875-0b11-48f9-b8a3-3050025a6349 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:47.156745 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa0b875-0b11-48f9-b8a3-3050025a6349 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:47.163950 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa0b875-0b11-48f9-b8a3-3050025a6349 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:47.210527 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 846/1695] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:06:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:06:48.141628 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e847d4d6-7df9-4366-b985-0c7c2d443f4d None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:48.143239 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-e847d4d6-7df9-4366-b985-0c7c2d443f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:48.190943 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e847d4d6-7df9-4366-b985-0c7c2d443f4d None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:48.214861 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88a0225-aa30-4602-ad6e-912a012e027f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:48.221709 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a0225-aa30-4602-ad6e-912a012e027f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:48.229887 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a0225-aa30-4602-ad6e-912a012e027f admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:48.230302 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a0225-aa30-4602-ad6e-912a012e027f admin admin] PATH_INFO: `/v3/users/c5d3a00cf4b048f59a5486facb52ae13` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:48.233008 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88a0225-aa30-4602-ad6e-912a012e027f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5d3a00cf4b048f59a5486facb52ae13)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:48.242707 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88a0225-aa30-4602-ad6e-912a012e027f admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:48.415039 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10298815-5fd8-4b79-a3fe-2de1b055d71c None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:48.415620 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10298815-5fd8-4b79-a3fe-2de1b055d71c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:48.415620 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10298815-5fd8-4b79-a3fe-2de1b055d71c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:48.437967 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-d88a0225-aa30-4602-ad6e-912a012e027f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5d3a00cf4b048f59a5486facb52ae13'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:48.457806 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-d88a0225-aa30-4602-ad6e-912a012e027f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5d3a00cf4b048f59a5486facb52ae13'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:48.458566 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-10298815-5fd8-4b79-a3fe-2de1b055d71c None None] MFA Rules not processed for user `2fef074aa2ea4570928109f62ea1aa96`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:48.460931 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-d88a0225-aa30-4602-ad6e-912a012e027f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5d3a00cf4b048f59a5486facb52ae13'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:48.462096 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-10298815-5fd8-4b79-a3fe-2de1b055d71c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:48.463378 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-d88a0225-aa30-4602-ad6e-912a012e027f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5d3a00cf4b048f59a5486facb52ae13'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:48.490206 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 847/1696] 10.222.0.17 () {58 vars in 1015 bytes} [Wed Jun 8 12:06:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:06:48.499815 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-d88a0225-aa30-4602-ad6e-912a012e027f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5d3a00cf4b048f59a5486facb52ae13'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:48.542225 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 850/1697] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:06:48 2022] DELETE /identity/v3/users/c5d3a00cf4b048f59a5486facb52ae13 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:06:48.545435 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a48e5-eb76-4d37-afd3-ce965dc62ac7 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:48.545916 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a48e5-eb76-4d37-afd3-ce965dc62ac7 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:48.546424 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a48e5-eb76-4d37-afd3-ce965dc62ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:48.595508 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-6a2a48e5-eb76-4d37-afd3-ce965dc62ac7 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:48.597655 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-6a2a48e5-eb76-4d37-afd3-ce965dc62ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:48.775365 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 848/1698] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:06:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:06:48.816243 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88a0225-aa30-4602-ad6e-912a012e027f admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:48.818294 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-d88a0225-aa30-4602-ad6e-912a012e027f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:48.978607 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca43898-928c-4d4d-b7a8-f4e3e18e34b3 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:48.979034 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca43898-928c-4d4d-b7a8-f4e3e18e34b3 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:48.979661 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca43898-928c-4d4d-b7a8-f4e3e18e34b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:48.991461 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88a0225-aa30-4602-ad6e-912a012e027f admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:49.016447 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66736f7-2ff9-4bb0-8453-76e58d56d675 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:49.017146 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66736f7-2ff9-4bb0-8453-76e58d56d675 service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:49.017431 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66736f7-2ff9-4bb0-8453-76e58d56d675 service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:49.017706 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66736f7-2ff9-4bb0-8453-76e58d56d675 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:49.050687 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66736f7-2ff9-4bb0-8453-76e58d56d675 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:49.052209 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66736f7-2ff9-4bb0-8453-76e58d56d675 service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:49.083049 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:06:49.094784 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 851/1699] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:06:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:06:49.102733 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-bca43898-928c-4d4d-b7a8-f4e3e18e34b3 None None] MFA Rules not processed for user `f3d3e9767e814d0d995be5c660c36fc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:49.104836 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-bca43898-928c-4d4d-b7a8-f4e3e18e34b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:49.339725 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66736f7-2ff9-4bb0-8453-76e58d56d675 service neutron] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:49.341827 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-b66736f7-2ff9-4bb0-8453-76e58d56d675 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:49.371908 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66736f7-2ff9-4bb0-8453-76e58d56d675 service neutron] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:49.384914 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35867a1a-c05a-44a7-b1d8-6082a6372b9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:49.385858 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35867a1a-c05a-44a7-b1d8-6082a6372b9f service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:49.386291 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35867a1a-c05a-44a7-b1d8-6082a6372b9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:49.386703 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35867a1a-c05a-44a7-b1d8-6082a6372b9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:49.406293 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35867a1a-c05a-44a7-b1d8-6082a6372b9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:49.423935 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35867a1a-c05a-44a7-b1d8-6082a6372b9f service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:49.440641 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 852/1700] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:06:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:06:49.458792 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 849/1701] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:06:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 481 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:06:49.484758 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35867a1a-c05a-44a7-b1d8-6082a6372b9f service neutron] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:49.486447 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-35867a1a-c05a-44a7-b1d8-6082a6372b9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:49.682883 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35867a1a-c05a-44a7-b1d8-6082a6372b9f service neutron] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:49.717023 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cabb17-cfc1-4210-929b-6a8b404423b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef7edb5e9ce49e6b098f48bf060b228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:49.717834 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cabb17-cfc1-4210-929b-6a8b404423b0 service nova] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:49.718238 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cabb17-cfc1-4210-929b-6a8b404423b0 service nova] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:49.718594 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cabb17-cfc1-4210-929b-6a8b404423b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:49.745164 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cabb17-cfc1-4210-929b-6a8b404423b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:49.746903 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cabb17-cfc1-4210-929b-6a8b404423b0 service nova] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:49.793291 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 853/1702] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:06:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:06:50.616809 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca43898-928c-4d4d-b7a8-f4e3e18e34b3 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:50.619082 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-bca43898-928c-4d4d-b7a8-f4e3e18e34b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:50.676517 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca43898-928c-4d4d-b7a8-f4e3e18e34b3 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:50.721314 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f1e967-57f7-4dc1-8318-15a7ac469e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:50.727012 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1e967-57f7-4dc1-8318-15a7ac469e15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:50.729768 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1e967-57f7-4dc1-8318-15a7ac469e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:50.729966 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1e967-57f7-4dc1-8318-15a7ac469e15 admin admin] PATH_INFO: `/v3/projects/aef4d0f0aba4476189301e6a67e67e0c` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:50.738846 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f1e967-57f7-4dc1-8318-15a7ac469e15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aef4d0f0aba4476189301e6a67e67e0c)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:50.751575 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f1e967-57f7-4dc1-8318-15a7ac469e15 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:50.863867 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:06:50.986568 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-97f1e967-57f7-4dc1-8318-15a7ac469e15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aef4d0f0aba4476189301e6a67e67e0c', 'request_id': 'req-97f1e967-57f7-4dc1-8318-15a7ac469e15'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:51.013329 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-97f1e967-57f7-4dc1-8318-15a7ac469e15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aef4d0f0aba4476189301e6a67e67e0c', 'request_id': 'req-97f1e967-57f7-4dc1-8318-15a7ac469e15'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:51.042579 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-97f1e967-57f7-4dc1-8318-15a7ac469e15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aef4d0f0aba4476189301e6a67e67e0c', 'request_id': 'req-97f1e967-57f7-4dc1-8318-15a7ac469e15'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:51.109773 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-97f1e967-57f7-4dc1-8318-15a7ac469e15 admin admin] The token cache is being invalidate because project aef4d0f0aba4476189301e6a67e67e0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:06:51.110517 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-97f1e967-57f7-4dc1-8318-15a7ac469e15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:51.111760 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-97f1e967-57f7-4dc1-8318-15a7ac469e15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:51.114441 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 850/1703] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:06:50 2022] DELETE /identity/v3/projects/aef4d0f0aba4476189301e6a67e67e0c => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:06:51.120409 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e2e92-e54f-49fc-9fab-15256f0a62a9 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:51.121146 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e2e92-e54f-49fc-9fab-15256f0a62a9 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:51.121146 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e2e92-e54f-49fc-9fab-15256f0a62a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:51.158447 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-461e2e92-e54f-49fc-9fab-15256f0a62a9 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:51.162959 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-461e2e92-e54f-49fc-9fab-15256f0a62a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:51.434100 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 854/1704] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:06:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:06:51.441766 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964787a5-dd1e-4310-bb31-03c059c2da52 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:51.442063 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964787a5-dd1e-4310-bb31-03c059c2da52 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:51.442340 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964787a5-dd1e-4310-bb31-03c059c2da52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:51.477471 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-964787a5-dd1e-4310-bb31-03c059c2da52 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:51.478831 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-964787a5-dd1e-4310-bb31-03c059c2da52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:51.509421 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e2e92-e54f-49fc-9fab-15256f0a62a9 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:51.509923 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 851/1705] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:06:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:06:51.536183 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e2e92-e54f-49fc-9fab-15256f0a62a9 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:51.557065 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936120a9-5a45-4fa5-b020-613233cc5218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:51.558124 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936120a9-5a45-4fa5-b020-613233cc5218 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:51.558638 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936120a9-5a45-4fa5-b020-613233cc5218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:51.570291 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936120a9-5a45-4fa5-b020-613233cc5218 admin admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:51.571912 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936120a9-5a45-4fa5-b020-613233cc5218 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:06:51.572543 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936120a9-5a45-4fa5-b020-613233cc5218 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:51.584155 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936120a9-5a45-4fa5-b020-613233cc5218 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:51.632603 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 855/1706] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:06:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:06:51.638089 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964787a5-dd1e-4310-bb31-03c059c2da52 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:51.677305 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964787a5-dd1e-4310-bb31-03c059c2da52 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:51.692445 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e691ec9-c680-4e58-a1cd-044c15325ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:51.693847 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e691ec9-c680-4e58-a1cd-044c15325ec3 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:51.694414 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e691ec9-c680-4e58-a1cd-044c15325ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:51.694898 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e691ec9-c680-4e58-a1cd-044c15325ec3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:51.696360 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e691ec9-c680-4e58-a1cd-044c15325ec3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:51.708421 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e691ec9-c680-4e58-a1cd-044c15325ec3 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:51.775717 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 852/1707] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:06:51 2022] POST /identity/v3/projects => generated 373 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:06:51.777312 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936120a9-5a45-4fa5-b020-613233cc5218 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:51.792637 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936120a9-5a45-4fa5-b020-613233cc5218 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:52.073587 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef066a5-1f0c-4271-96e1-77c2b7ce5cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:52.088822 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef066a5-1f0c-4271-96e1-77c2b7ce5cbd admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:52.090064 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef066a5-1f0c-4271-96e1-77c2b7ce5cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:52.090363 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef066a5-1f0c-4271-96e1-77c2b7ce5cbd admin admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:52.091873 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef066a5-1f0c-4271-96e1-77c2b7ce5cbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:52.098548 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef066a5-1f0c-4271-96e1-77c2b7ce5cbd admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:52.136270 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:06:52.178245 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 856/1708] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:06:51 2022] POST /identity/v3/users => generated 287 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:06:52.178637 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e691ec9-c680-4e58-a1cd-044c15325ec3 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:52.201295 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e691ec9-c680-4e58-a1cd-044c15325ec3 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:52.221534 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366c790-3f6b-4429-a95d-3613096bbca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:52.222232 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366c790-3f6b-4429-a95d-3613096bbca6 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:52.222592 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366c790-3f6b-4429-a95d-3613096bbca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:52.222870 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366c790-3f6b-4429-a95d-3613096bbca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:52.223695 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a366c790-3f6b-4429-a95d-3613096bbca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:52.227298 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a366c790-3f6b-4429-a95d-3613096bbca6 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:52.287700 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 853/1709] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:06:52.293818 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef066a5-1f0c-4271-96e1-77c2b7ce5cbd admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:52.310655 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef066a5-1f0c-4271-96e1-77c2b7ce5cbd admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:52.333835 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a69faa-8fb6-4a77-b20d-2028d1496079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:52.334549 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a69faa-8fb6-4a77-b20d-2028d1496079 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:52.343599 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a69faa-8fb6-4a77-b20d-2028d1496079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:52.343977 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a69faa-8fb6-4a77-b20d-2028d1496079 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:52.347172 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a69faa-8fb6-4a77-b20d-2028d1496079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:52.365925 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a69faa-8fb6-4a77-b20d-2028d1496079 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:52.405882 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 857/1710] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:06:52.409951 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366c790-3f6b-4429-a95d-3613096bbca6 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:52.428017 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366c790-3f6b-4429-a95d-3613096bbca6 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:52.444903 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcdb7bc-2102-4fe6-a00e-ba5d8b6ffed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:52.446697 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcdb7bc-2102-4fe6-a00e-ba5d8b6ffed6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:52.447159 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcdb7bc-2102-4fe6-a00e-ba5d8b6ffed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:52.447588 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcdb7bc-2102-4fe6-a00e-ba5d8b6ffed6 admin admin] PATH_INFO: `/v3/projects/43155ec8af234a53a5f7051f18d4f604/users/f003e4c3efff4905b0ddda5fbd8f2a6f/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:52.494550 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcdb7bc-2102-4fe6-a00e-ba5d8b6ffed6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43155ec8af234a53a5f7051f18d4f604, user_id=f003e4c3efff4905b0ddda5fbd8f2a6f, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:52.498363 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcdb7bc-2102-4fe6-a00e-ba5d8b6ffed6 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:52.527934 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 854/1711] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:06:52 2022] PUT /identity/v3/projects/43155ec8af234a53a5f7051f18d4f604/users/f003e4c3efff4905b0ddda5fbd8f2a6f/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:06:52.544130 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874959b-5852-404b-be15-77b07c644f1b None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:52.544355 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874959b-5852-404b-be15-77b07c644f1b None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:52.544628 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874959b-5852-404b-be15-77b07c644f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:52.589848 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-a874959b-5852-404b-be15-77b07c644f1b None None] MFA Rules not processed for user `f003e4c3efff4905b0ddda5fbd8f2a6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:52.591096 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-a874959b-5852-404b-be15-77b07c644f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:52.710058 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce795ca-f796-4dba-83ab-ce0458c5c76f None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:52.710617 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce795ca-f796-4dba-83ab-ce0458c5c76f None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:52.711776 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce795ca-f796-4dba-83ab-ce0458c5c76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:52.744638 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 858/1712] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:06:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:06:52.747009 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a874959b-5852-404b-be15-77b07c644f1b None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:52.818138 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-2ce795ca-f796-4dba-83ab-ce0458c5c76f None None] MFA Rules not processed for user `ac2ba7b98bfd40a49cf11263d9739e68`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:52.825074 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-2ce795ca-f796-4dba-83ab-ce0458c5c76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:52.994933 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a874959b-5852-404b-be15-77b07c644f1b None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:53.012559 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b1e776-9144-4b5e-8d07-6ce74510e444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:53.021291 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1e776-9144-4b5e-8d07-6ce74510e444 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:53.021884 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1e776-9144-4b5e-8d07-6ce74510e444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:53.022896 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1e776-9144-4b5e-8d07-6ce74510e444 admin admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:53.024425 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b1e776-9144-4b5e-8d07-6ce74510e444 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:53.027867 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b1e776-9144-4b5e-8d07-6ce74510e444 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:53.070364 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 855/1713] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:06:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:06:53.089151 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe1b97-3807-455f-8c1c-68f4fb8159b9 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:53.090348 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe1b97-3807-455f-8c1c-68f4fb8159b9 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:53.090761 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe1b97-3807-455f-8c1c-68f4fb8159b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:53.112212 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 859/1714] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:06:52 2022] POST /identity/v3/projects => generated 373 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:06:53.124913 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b1e776-9144-4b5e-8d07-6ce74510e444 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:53.131575 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-c4b1e776-9144-4b5e-8d07-6ce74510e444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:53.166214 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-f1fe1b97-3807-455f-8c1c-68f4fb8159b9 None None] MFA Rules not processed for user `ac2ba7b98bfd40a49cf11263d9739e68`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:53.168475 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f1fe1b97-3807-455f-8c1c-68f4fb8159b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:53.232482 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:06:53.324144 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:06:53.345938 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 856/1715] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:06:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:06:53.350151 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe1b97-3807-455f-8c1c-68f4fb8159b9 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:53.386476 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b1e776-9144-4b5e-8d07-6ce74510e444 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:53.400387 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe1b97-3807-455f-8c1c-68f4fb8159b9 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:53.404632 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b95a09-a08e-4711-8a23-42773ac23c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:53.406937 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b95a09-a08e-4711-8a23-42773ac23c48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:53.414032 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b95a09-a08e-4711-8a23-42773ac23c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:53.416542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b95a09-a08e-4711-8a23-42773ac23c48 admin admin] PATH_INFO: `/v3/projects/8955b3b8a2634c07866a50afc71a0dd0` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:53.420935 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b95a09-a08e-4711-8a23-42773ac23c48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8955b3b8a2634c07866a50afc71a0dd0)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:53.428064 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b95a09-a08e-4711-8a23-42773ac23c48 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:53.429837 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6dc284-15af-4d2f-924a-e1e7d5529149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:53.430677 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6dc284-15af-4d2f-924a-e1e7d5529149 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:53.430969 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6dc284-15af-4d2f-924a-e1e7d5529149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:53.431243 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6dc284-15af-4d2f-924a-e1e7d5529149 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:53.431945 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6dc284-15af-4d2f-924a-e1e7d5529149 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:53.439679 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6dc284-15af-4d2f-924a-e1e7d5529149 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:53.507843 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 857/1716] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:06:53 2022] POST /identity/v3/users => generated 293 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:06:53.516637 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6dc284-15af-4d2f-924a-e1e7d5529149 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:53.521721 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-db6dc284-15af-4d2f-924a-e1e7d5529149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:53.732019 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-25b95a09-a08e-4711-8a23-42773ac23c48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8955b3b8a2634c07866a50afc71a0dd0', 'request_id': 'req-25b95a09-a08e-4711-8a23-42773ac23c48'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:53.749303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-25b95a09-a08e-4711-8a23-42773ac23c48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8955b3b8a2634c07866a50afc71a0dd0', 'request_id': 'req-25b95a09-a08e-4711-8a23-42773ac23c48'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:53.775012 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-25b95a09-a08e-4711-8a23-42773ac23c48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8955b3b8a2634c07866a50afc71a0dd0', 'request_id': 'req-25b95a09-a08e-4711-8a23-42773ac23c48'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:53.825001 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-25b95a09-a08e-4711-8a23-42773ac23c48 admin admin] The token cache is being invalidate because project 8955b3b8a2634c07866a50afc71a0dd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:06:53.825510 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-25b95a09-a08e-4711-8a23-42773ac23c48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:53.828303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-25b95a09-a08e-4711-8a23-42773ac23c48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:53.835885 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 860/1717] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:06:53 2022] DELETE /identity/v3/projects/8955b3b8a2634c07866a50afc71a0dd0 => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:06:53.837673 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b95a09-a08e-4711-8a23-42773ac23c48 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:53.838211 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6dc284-15af-4d2f-924a-e1e7d5529149 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:53.845003 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-25b95a09-a08e-4711-8a23-42773ac23c48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:54.115142 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b95a09-a08e-4711-8a23-42773ac23c48 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:54.124136 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c50431-7699-48c5-be1a-f4c521bf0e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:54.125769 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c50431-7699-48c5-be1a-f4c521bf0e9b admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:54.127042 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c50431-7699-48c5-be1a-f4c521bf0e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:54.129111 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c50431-7699-48c5-be1a-f4c521bf0e9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:54.130227 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c50431-7699-48c5-be1a-f4c521bf0e9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:54.135895 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c50431-7699-48c5-be1a-f4c521bf0e9b admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:54.137538 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae8251f-bf89-4210-811b-44bac896d3ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef7edb5e9ce49e6b098f48bf060b228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:54.138243 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8251f-bf89-4210-811b-44bac896d3ff service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:54.138524 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8251f-bf89-4210-811b-44bac896d3ff service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:54.138952 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8251f-bf89-4210-811b-44bac896d3ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:54.143098 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-cae8251f-bf89-4210-811b-44bac896d3ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:54.170844 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 861/1718] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:06:54.174553 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c50431-7699-48c5-be1a-f4c521bf0e9b admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:54.180589 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-c9c50431-7699-48c5-be1a-f4c521bf0e9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:54.211125 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c50431-7699-48c5-be1a-f4c521bf0e9b admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:54.223322 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd1276-dfa2-47b3-a2fc-2890459c7aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:54.225261 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd1276-dfa2-47b3-a2fc-2890459c7aed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:54.230187 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd1276-dfa2-47b3-a2fc-2890459c7aed admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:54.230601 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd1276-dfa2-47b3-a2fc-2890459c7aed admin admin] PATH_INFO: `/v3/users/ea19b5b5f04a48679ceaec7d409b4fe0` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:54.232590 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd1276-dfa2-47b3-a2fc-2890459c7aed admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea19b5b5f04a48679ceaec7d409b4fe0)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:54.234826 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd1276-dfa2-47b3-a2fc-2890459c7aed admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:54.371679 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:06:54.392622 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae8251f-bf89-4210-811b-44bac896d3ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:54.394256 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae8251f-bf89-4210-811b-44bac896d3ff service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:54.427452 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 858/1719] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:06:53 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 919 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:06:54.429057 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae8251f-bf89-4210-811b-44bac896d3ff service nova] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:54.438233 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-65cd1276-dfa2-47b3-a2fc-2890459c7aed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea19b5b5f04a48679ceaec7d409b4fe0'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:54.469760 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-65cd1276-dfa2-47b3-a2fc-2890459c7aed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea19b5b5f04a48679ceaec7d409b4fe0'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:54.476522 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-65cd1276-dfa2-47b3-a2fc-2890459c7aed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea19b5b5f04a48679ceaec7d409b4fe0'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:54.478430 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-65cd1276-dfa2-47b3-a2fc-2890459c7aed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea19b5b5f04a48679ceaec7d409b4fe0'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:54.488593 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae8251f-bf89-4210-811b-44bac896d3ff service nova] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:54.514917 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ccc18-a0d6-4ae6-b2e9-0c2a8298c1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:54.516046 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ccc18-a0d6-4ae6-b2e9-0c2a8298c1d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:54.520642 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ccc18-a0d6-4ae6-b2e9-0c2a8298c1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:54.530743 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ccc18-a0d6-4ae6-b2e9-0c2a8298c1d5 admin admin] PATH_INFO: `/v3/projects/60c15aab6579452cb4a604b5dbef8c86/users/87b1412e886c4ca8bbf35ea0357e9d07/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:54.540474 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-65cd1276-dfa2-47b3-a2fc-2890459c7aed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea19b5b5f04a48679ceaec7d409b4fe0'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:54.559060 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:06:54.586687 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762ccc18-a0d6-4ae6-b2e9-0c2a8298c1d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60c15aab6579452cb4a604b5dbef8c86, user_id=87b1412e886c4ca8bbf35ea0357e9d07, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:54.589524 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762ccc18-a0d6-4ae6-b2e9-0c2a8298c1d5 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:54.620565 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 862/1720] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:06:54 2022] DELETE /identity/v3/users/ea19b5b5f04a48679ceaec7d409b4fe0 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:06:54.654873 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 859/1721] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:06:54 2022] PUT /identity/v3/projects/60c15aab6579452cb4a604b5dbef8c86/users/87b1412e886c4ca8bbf35ea0357e9d07/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:06:54.659908 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd1276-dfa2-47b3-a2fc-2890459c7aed admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:54.661746 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-65cd1276-dfa2-47b3-a2fc-2890459c7aed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:54.871066 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd1276-dfa2-47b3-a2fc-2890459c7aed admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:55.086789 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef705d74-4576-4078-8a1a-90b6831e6505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:55.087501 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef705d74-4576-4078-8a1a-90b6831e6505 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:55.087792 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef705d74-4576-4078-8a1a-90b6831e6505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:55.088118 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef705d74-4576-4078-8a1a-90b6831e6505 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:55.088900 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef705d74-4576-4078-8a1a-90b6831e6505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:55.093436 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef705d74-4576-4078-8a1a-90b6831e6505 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:55.129316 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 863/1722] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 470 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:06:55.129897 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ccc18-a0d6-4ae6-b2e9-0c2a8298c1d5 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:55.160706 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ccc18-a0d6-4ae6-b2e9-0c2a8298c1d5 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:55.204123 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8ddb0-4bff-44f6-b1e7-85c7ee401d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:55.205439 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8ddb0-4bff-44f6-b1e7-85c7ee401d47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:55.208492 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8ddb0-4bff-44f6-b1e7-85c7ee401d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:55.208894 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8ddb0-4bff-44f6-b1e7-85c7ee401d47 admin admin] PATH_INFO: `/v3/projects/60c15aab6579452cb4a604b5dbef8c86/users/87b1412e886c4ca8bbf35ea0357e9d07/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:55.221386 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb8ddb0-4bff-44f6-b1e7-85c7ee401d47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60c15aab6579452cb4a604b5dbef8c86, user_id=87b1412e886c4ca8bbf35ea0357e9d07, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:55.228258 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb8ddb0-4bff-44f6-b1e7-85c7ee401d47 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:55.312672 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 860/1723] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:06:55 2022] PUT /identity/v3/projects/60c15aab6579452cb4a604b5dbef8c86/users/87b1412e886c4ca8bbf35ea0357e9d07/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:06:55.326785 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb51eb-53bc-4e8b-bc7d-6c079270469a None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:55.326975 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb51eb-53bc-4e8b-bc7d-6c079270469a None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:55.327264 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb51eb-53bc-4e8b-bc7d-6c079270469a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:55.423793 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-c7bb51eb-53bc-4e8b-bc7d-6c079270469a None None] MFA Rules not processed for user `87b1412e886c4ca8bbf35ea0357e9d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:55.428004 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-c7bb51eb-53bc-4e8b-bc7d-6c079270469a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:55.691739 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 864/1724] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:06:55 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:06:55.696563 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8ddb0-4bff-44f6-b1e7-85c7ee401d47 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:55.698046 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ebb8ddb0-4bff-44f6-b1e7-85c7ee401d47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:55.889628 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8ddb0-4bff-44f6-b1e7-85c7ee401d47 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:55.894977 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f98b43-d755-468a-91b5-41b13a0c8345 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:55.896329 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f98b43-d755-468a-91b5-41b13a0c8345 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:55.896855 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f98b43-d755-468a-91b5-41b13a0c8345 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:55.897404 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f98b43-d755-468a-91b5-41b13a0c8345 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:55.909751 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f98b43-d755-468a-91b5-41b13a0c8345 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:55.929901 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f98b43-d755-468a-91b5-41b13a0c8345 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:55.950497 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 861/1725] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:06:55 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:06:57.280947 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd8afc0-5d44-451a-89b8-bd2a2c14fd8a None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:57.281418 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd8afc0-5d44-451a-89b8-bd2a2c14fd8a None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:57.281504 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd8afc0-5d44-451a-89b8-bd2a2c14fd8a None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:57.282832 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 865/1726] 10.222.0.39 () {54 vars in 912 bytes} [Wed Jun 8 12:06:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:06:57.291231 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6817eee-63ee-4d96-b52e-76725febf13f None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:57.291772 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6817eee-63ee-4d96-b52e-76725febf13f None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:57.291892 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6817eee-63ee-4d96-b52e-76725febf13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:57.341706 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-a6817eee-63ee-4d96-b52e-76725febf13f None None] MFA Rules not processed for user `2fef074aa2ea4570928109f62ea1aa96`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:57.347887 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a6817eee-63ee-4d96-b52e-76725febf13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:57.366053 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd8afc0-5d44-451a-89b8-bd2a2c14fd8a None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:57.457245 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:06:57.568135 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 862/1727] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Jun 8 12:06:57 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:06:57.569655 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6817eee-63ee-4d96-b52e-76725febf13f None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:57.574674 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a6817eee-63ee-4d96-b52e-76725febf13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:57.588234 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd8afc0-5d44-451a-89b8-bd2a2c14fd8a None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:57.613094 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac115461-c90a-423d-92fd-e4056f56b3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:57.614001 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac115461-c90a-423d-92fd-e4056f56b3a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:57.614442 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac115461-c90a-423d-92fd-e4056f56b3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:57.614545 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac115461-c90a-423d-92fd-e4056f56b3a0 admin admin] PATH_INFO: `/v3/users/f003e4c3efff4905b0ddda5fbd8f2a6f` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:57.615961 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac115461-c90a-423d-92fd-e4056f56b3a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f003e4c3efff4905b0ddda5fbd8f2a6f)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:57.618042 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac115461-c90a-423d-92fd-e4056f56b3a0 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:57.629581 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6817eee-63ee-4d96-b52e-76725febf13f None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:57.654699 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513114c9-c069-4da9-9fcf-a5062c53b4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:57.655939 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513114c9-c069-4da9-9fcf-a5062c53b4cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:57.656421 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513114c9-c069-4da9-9fcf-a5062c53b4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:57.656870 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513114c9-c069-4da9-9fcf-a5062c53b4cc admin admin] PATH_INFO: `/v3/projects/4f1709bd87424a64a3100c5907693fd3` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:57.658348 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513114c9-c069-4da9-9fcf-a5062c53b4cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f1709bd87424a64a3100c5907693fd3)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:57.660498 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513114c9-c069-4da9-9fcf-a5062c53b4cc admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:57.817387 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-ac115461-c90a-423d-92fd-e4056f56b3a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f003e4c3efff4905b0ddda5fbd8f2a6f'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:57.831591 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-ac115461-c90a-423d-92fd-e4056f56b3a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f003e4c3efff4905b0ddda5fbd8f2a6f'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:57.833051 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-ac115461-c90a-423d-92fd-e4056f56b3a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f003e4c3efff4905b0ddda5fbd8f2a6f'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:57.834644 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-ac115461-c90a-423d-92fd-e4056f56b3a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f003e4c3efff4905b0ddda5fbd8f2a6f'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:57.840151 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-513114c9-c069-4da9-9fcf-a5062c53b4cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f1709bd87424a64a3100c5907693fd3', 'request_id': 'req-513114c9-c069-4da9-9fcf-a5062c53b4cc'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:57.859259 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-ac115461-c90a-423d-92fd-e4056f56b3a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f003e4c3efff4905b0ddda5fbd8f2a6f'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:57.872765 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-513114c9-c069-4da9-9fcf-a5062c53b4cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f1709bd87424a64a3100c5907693fd3', 'request_id': 'req-513114c9-c069-4da9-9fcf-a5062c53b4cc'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:57.890918 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:06:57.893580 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-513114c9-c069-4da9-9fcf-a5062c53b4cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f1709bd87424a64a3100c5907693fd3', 'request_id': 'req-513114c9-c069-4da9-9fcf-a5062c53b4cc'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:57.918201 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 866/1728] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:06:57 2022] DELETE /identity/v3/users/f003e4c3efff4905b0ddda5fbd8f2a6f => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:06:57.919669 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac115461-c90a-423d-92fd-e4056f56b3a0 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:57.921662 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-ac115461-c90a-423d-92fd-e4056f56b3a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:57.933770 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-513114c9-c069-4da9-9fcf-a5062c53b4cc admin admin] The token cache is being invalidate because project 4f1709bd87424a64a3100c5907693fd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:06:57.934165 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-513114c9-c069-4da9-9fcf-a5062c53b4cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:57.937027 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-513114c9-c069-4da9-9fcf-a5062c53b4cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:57.940321 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 863/1729] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:06:57 2022] DELETE /identity/v3/projects/4f1709bd87424a64a3100c5907693fd3 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:06:57.946947 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ee207-0e79-4c85-9e8a-1b75c8afcd5f None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:57.953027 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ee207-0e79-4c85-9e8a-1b75c8afcd5f None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:57.953447 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ee207-0e79-4c85-9e8a-1b75c8afcd5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:58.015517 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-260ee207-0e79-4c85-9e8a-1b75c8afcd5f None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:58.016833 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-260ee207-0e79-4c85-9e8a-1b75c8afcd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:58.058516 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac115461-c90a-423d-92fd-e4056f56b3a0 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:58.067481 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9a8ff-5e1c-4fc1-b575-f29c107f0e0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:58.070080 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9a8ff-5e1c-4fc1-b575-f29c107f0e0b service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:58.071460 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9a8ff-5e1c-4fc1-b575-f29c107f0e0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:58.074382 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9a8ff-5e1c-4fc1-b575-f29c107f0e0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:58.081943 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-9ff9a8ff-5e1c-4fc1-b575-f29c107f0e0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:58.106714 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff9a8ff-5e1c-4fc1-b575-f29c107f0e0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:58.109988 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff9a8ff-5e1c-4fc1-b575-f29c107f0e0b service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:58.130685 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 867/1730] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:06:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:06:58.134116 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c78adf-b677-4318-8612-a4009e8450e8 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:58.134508 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c78adf-b677-4318-8612-a4009e8450e8 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:58.134875 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c78adf-b677-4318-8612-a4009e8450e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:58.165888 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-e8c78adf-b677-4318-8612-a4009e8450e8 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:58.169774 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-e8c78adf-b677-4318-8612-a4009e8450e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:58.175031 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 864/1731] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:06:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:06:58.191293 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b02e1-11ab-46a2-9c43-036126e78fb6 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:58.191705 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b02e1-11ab-46a2-9c43-036126e78fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:58.192088 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b02e1-11ab-46a2-9c43-036126e78fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:58.194735 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 868/1732] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:06:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:06:58.201233 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c78adf-b677-4318-8612-a4009e8450e8 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:58.206349 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-e8c78adf-b677-4318-8612-a4009e8450e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:58.226470 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-1a7b02e1-11ab-46a2-9c43-036126e78fb6 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:58.231965 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-1a7b02e1-11ab-46a2-9c43-036126e78fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:58.233303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c78adf-b677-4318-8612-a4009e8450e8 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:58.242654 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387fcd5b-3a91-43fe-b349-7a607aeedb65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:58.244878 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387fcd5b-3a91-43fe-b349-7a607aeedb65 service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:58.245370 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387fcd5b-3a91-43fe-b349-7a607aeedb65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:58.245857 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387fcd5b-3a91-43fe-b349-7a607aeedb65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:58.254052 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 865/1733] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:06:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:06:58.255757 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7b02e1-11ab-46a2-9c43-036126e78fb6 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:58.271968 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387fcd5b-3a91-43fe-b349-7a607aeedb65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:58.274121 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387fcd5b-3a91-43fe-b349-7a607aeedb65 service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:58.279855 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7b02e1-11ab-46a2-9c43-036126e78fb6 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:58.293693 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666ad8d-90c6-4709-ad5a-09c4d82cf057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:58.295218 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666ad8d-90c6-4709-ad5a-09c4d82cf057 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:58.295698 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666ad8d-90c6-4709-ad5a-09c4d82cf057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:58.296347 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666ad8d-90c6-4709-ad5a-09c4d82cf057 admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:58.297284 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d666ad8d-90c6-4709-ad5a-09c4d82cf057 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:06:58.297822 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d666ad8d-90c6-4709-ad5a-09c4d82cf057 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:58.299747 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d666ad8d-90c6-4709-ad5a-09c4d82cf057 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:58.300466 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 869/1734] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:06:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:06:58.320150 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387fcd5b-3a91-43fe-b349-7a607aeedb65 service neutron] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:58.326277 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 866/1735] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:06:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:06:58.336843 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387fcd5b-3a91-43fe-b349-7a607aeedb65 service neutron] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:58.347497 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1a5c2-be72-4090-98cf-0c4da324f827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:58.348885 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1a5c2-be72-4090-98cf-0c4da324f827 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:58.349646 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1a5c2-be72-4090-98cf-0c4da324f827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:58.350119 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1a5c2-be72-4090-98cf-0c4da324f827 admin admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:58.351036 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee1a5c2-be72-4090-98cf-0c4da324f827 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:58.356812 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee1a5c2-be72-4090-98cf-0c4da324f827 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:58.366837 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69714667-2a44-41f9-adca-7a1a7945fb2d None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:58.368041 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69714667-2a44-41f9-adca-7a1a7945fb2d None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:58.368579 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69714667-2a44-41f9-adca-7a1a7945fb2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:58.427608 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-69714667-2a44-41f9-adca-7a1a7945fb2d None None] MFA Rules not processed for user `f3d3e9767e814d0d995be5c660c36fc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:58.429359 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-69714667-2a44-41f9-adca-7a1a7945fb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:58.437577 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:06:58.459515 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 870/1736] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:06:58 2022] POST /identity/v3/projects => generated 409 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:06:58.464046 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1a5c2-be72-4090-98cf-0c4da324f827 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:58.609233 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 867/1737] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:06:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:06:58.707085 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1a5c2-be72-4090-98cf-0c4da324f827 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:58.733022 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919fadb9-923c-4125-a7ff-e654539f1b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:58.733770 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919fadb9-923c-4125-a7ff-e654539f1b10 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:58.734074 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919fadb9-923c-4125-a7ff-e654539f1b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:58.734358 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919fadb9-923c-4125-a7ff-e654539f1b10 admin admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:58.735147 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919fadb9-923c-4125-a7ff-e654539f1b10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:58.737271 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919fadb9-923c-4125-a7ff-e654539f1b10 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:58.805179 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 871/1738] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:06:58 2022] POST /identity/v3/users => generated 305 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:06:58.809824 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69714667-2a44-41f9-adca-7a1a7945fb2d None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:58.834744 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69714667-2a44-41f9-adca-7a1a7945fb2d None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:58.856304 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0147caf5-911a-4798-8b08-22e4e0ad15d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:58.858244 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147caf5-911a-4798-8b08-22e4e0ad15d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:58.859685 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147caf5-911a-4798-8b08-22e4e0ad15d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:58.860547 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147caf5-911a-4798-8b08-22e4e0ad15d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:58.861494 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0147caf5-911a-4798-8b08-22e4e0ad15d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:58.866788 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0147caf5-911a-4798-8b08-22e4e0ad15d7 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:58.917269 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919fadb9-923c-4125-a7ff-e654539f1b10 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:58.921673 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 868/1739] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:06:58 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:06:58.933619 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919fadb9-923c-4125-a7ff-e654539f1b10 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:58.948874 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407758ea-dfc3-4096-9f7d-7220c247bb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:58.949898 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407758ea-dfc3-4096-9f7d-7220c247bb9c admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:58.950342 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407758ea-dfc3-4096-9f7d-7220c247bb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:58.955135 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407758ea-dfc3-4096-9f7d-7220c247bb9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:58.958962 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407758ea-dfc3-4096-9f7d-7220c247bb9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:58.963244 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407758ea-dfc3-4096-9f7d-7220c247bb9c admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:59.029814 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 872/1740] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:06:58 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 12:06:59.032244 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0147caf5-911a-4798-8b08-22e4e0ad15d7 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:59.054115 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0147caf5-911a-4798-8b08-22e4e0ad15d7 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:59.069877 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71731157-31af-40cb-897d-91a768514014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:59.072751 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71731157-31af-40cb-897d-91a768514014 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:59.073272 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71731157-31af-40cb-897d-91a768514014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:59.073957 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71731157-31af-40cb-897d-91a768514014 admin admin] PATH_INFO: `/v3/projects/46ddbf7180cb4b36b0d86b1d5c302a1d/users/094582d49e1b4231b395e463aac95bfd/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:59.103597 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407758ea-dfc3-4096-9f7d-7220c247bb9c admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:59.107066 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-407758ea-dfc3-4096-9f7d-7220c247bb9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:59.146883 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407758ea-dfc3-4096-9f7d-7220c247bb9c admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:59.153357 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71731157-31af-40cb-897d-91a768514014 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46ddbf7180cb4b36b0d86b1d5c302a1d, user_id=094582d49e1b4231b395e463aac95bfd, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:59.159515 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71731157-31af-40cb-897d-91a768514014 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:59.162581 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd6185-c2d7-485d-ab4b-6b1d4469d7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:59.163622 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd6185-c2d7-485d-ab4b-6b1d4469d7b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:59.163778 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd6185-c2d7-485d-ab4b-6b1d4469d7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:59.164935 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd6185-c2d7-485d-ab4b-6b1d4469d7b3 admin admin] PATH_INFO: `/v3/projects/43155ec8af234a53a5f7051f18d4f604` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:59.173245 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd6185-c2d7-485d-ab4b-6b1d4469d7b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43155ec8af234a53a5f7051f18d4f604)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:59.177418 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd6185-c2d7-485d-ab4b-6b1d4469d7b3 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:59.187529 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 869/1741] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:06:59 2022] PUT /identity/v3/projects/46ddbf7180cb4b36b0d86b1d5c302a1d/users/094582d49e1b4231b395e463aac95bfd/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:06:59.199530 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6495b-c9c7-418d-9fc3-3bdfa8f01d86 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:59.199847 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6495b-c9c7-418d-9fc3-3bdfa8f01d86 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:59.200107 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6495b-c9c7-418d-9fc3-3bdfa8f01d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:59.247959 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-03d6495b-c9c7-418d-9fc3-3bdfa8f01d86 None None] MFA Rules not processed for user `094582d49e1b4231b395e463aac95bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:06:59.250487 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-03d6495b-c9c7-418d-9fc3-3bdfa8f01d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:59.307207 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-e3bd6185-c2d7-485d-ab4b-6b1d4469d7b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43155ec8af234a53a5f7051f18d4f604', 'request_id': 'req-e3bd6185-c2d7-485d-ab4b-6b1d4469d7b3'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:59.313745 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:06:59.332543 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-e3bd6185-c2d7-485d-ab4b-6b1d4469d7b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43155ec8af234a53a5f7051f18d4f604', 'request_id': 'req-e3bd6185-c2d7-485d-ab4b-6b1d4469d7b3'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:59.347521 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-e3bd6185-c2d7-485d-ab4b-6b1d4469d7b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43155ec8af234a53a5f7051f18d4f604', 'request_id': 'req-e3bd6185-c2d7-485d-ab4b-6b1d4469d7b3'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:59.364698 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-e3bd6185-c2d7-485d-ab4b-6b1d4469d7b3 admin admin] The token cache is being invalidate because project 43155ec8af234a53a5f7051f18d4f604 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:06:59.365349 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-e3bd6185-c2d7-485d-ab4b-6b1d4469d7b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:59.366282 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-e3bd6185-c2d7-485d-ab4b-6b1d4469d7b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:59.373685 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 873/1742] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:06:59 2022] DELETE /identity/v3/projects/43155ec8af234a53a5f7051f18d4f604 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:06:59.375065 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd6185-c2d7-485d-ab4b-6b1d4469d7b3 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:59.376932 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-e3bd6185-c2d7-485d-ab4b-6b1d4469d7b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:59.440515 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 870/1743] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:06:59 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:06:59.444206 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d6495b-c9c7-418d-9fc3-3bdfa8f01d86 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:59.445833 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-03d6495b-c9c7-418d-9fc3-3bdfa8f01d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:06:59.465266 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd6185-c2d7-485d-ab4b-6b1d4469d7b3 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:59.470777 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ff758-7e87-474d-ba85-ad5eda711083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:59.471953 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ff758-7e87-474d-ba85-ad5eda711083 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:59.472393 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ff758-7e87-474d-ba85-ad5eda711083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:59.472778 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ff758-7e87-474d-ba85-ad5eda711083 admin admin] PATH_INFO: `/v3/users/87b1412e886c4ca8bbf35ea0357e9d07` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:59.474994 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ff758-7e87-474d-ba85-ad5eda711083 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87b1412e886c4ca8bbf35ea0357e9d07)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:59.478873 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ff758-7e87-474d-ba85-ad5eda711083 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:59.482544 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:06:59.485012 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d6495b-c9c7-418d-9fc3-3bdfa8f01d86 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:59.495171 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c87520-9475-468b-bd84-ad5469c88cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:59.496133 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c87520-9475-468b-bd84-ad5469c88cf9 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:59.496678 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c87520-9475-468b-bd84-ad5469c88cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:59.497116 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c87520-9475-468b-bd84-ad5469c88cf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:59.498034 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c87520-9475-468b-bd84-ad5469c88cf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:59.504364 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c87520-9475-468b-bd84-ad5469c88cf9 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:06:59.566417 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 871/1744] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:06:59 2022] POST /identity/v3/projects => generated 407 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:06:59.569140 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c87520-9475-468b-bd84-ad5469c88cf9 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:06:59.584991 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-401ff758-7e87-474d-ba85-ad5eda711083 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87b1412e886c4ca8bbf35ea0357e9d07'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:59.610568 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-401ff758-7e87-474d-ba85-ad5eda711083 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87b1412e886c4ca8bbf35ea0357e9d07'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:59.612563 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-401ff758-7e87-474d-ba85-ad5eda711083 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87b1412e886c4ca8bbf35ea0357e9d07'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:59.615187 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-401ff758-7e87-474d-ba85-ad5eda711083 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87b1412e886c4ca8bbf35ea0357e9d07'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:59.650993 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-401ff758-7e87-474d-ba85-ad5eda711083 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87b1412e886c4ca8bbf35ea0357e9d07'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:06:59.677102 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 874/1745] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:06:59 2022] DELETE /identity/v3/users/87b1412e886c4ca8bbf35ea0357e9d07 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:06:59.775679 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c87520-9475-468b-bd84-ad5469c88cf9 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:06:59.990518 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e6f89-5257-4ff6-92ea-391cf02b8b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:06:59.991365 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e6f89-5257-4ff6-92ea-391cf02b8b4a admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:06:59.991710 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e6f89-5257-4ff6-92ea-391cf02b8b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:06:59.991998 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e6f89-5257-4ff6-92ea-391cf02b8b4a admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:06:59.993156 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2e6f89-5257-4ff6-92ea-391cf02b8b4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:06:59.997615 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2e6f89-5257-4ff6-92ea-391cf02b8b4a admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:00.063152 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 872/1746] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:06:59 2022] POST /identity/v3/users => generated 310 bytes in 494 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:07:00.066799 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ff758-7e87-474d-ba85-ad5eda711083 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:00.068696 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-401ff758-7e87-474d-ba85-ad5eda711083 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:00.110616 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ff758-7e87-474d-ba85-ad5eda711083 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:00.126739 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8acb280-a4c0-4fd4-8818-03e965ea4d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:00.126739 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acb280-a4c0-4fd4-8818-03e965ea4d83 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:00.127071 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acb280-a4c0-4fd4-8818-03e965ea4d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:00.127142 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acb280-a4c0-4fd4-8818-03e965ea4d83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:00.128283 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8acb280-a4c0-4fd4-8818-03e965ea4d83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:00.130274 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8acb280-a4c0-4fd4-8818-03e965ea4d83 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:00.149266 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 875/1747] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:07:00 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:07:00.154113 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e6f89-5257-4ff6-92ea-391cf02b8b4a admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:00.176861 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e6f89-5257-4ff6-92ea-391cf02b8b4a admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:00.184779 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed42ae7b-721a-4813-bcfb-ee5e8681fe83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:00.185878 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42ae7b-721a-4813-bcfb-ee5e8681fe83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:00.186155 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42ae7b-721a-4813-bcfb-ee5e8681fe83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:00.186498 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42ae7b-721a-4813-bcfb-ee5e8681fe83 admin admin] PATH_INFO: `/v3/projects/3d1de6a9145f4ce1a63020a3713ed137/users/2b156e8582804be5b89bf08dfb36dbfe/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:00.238738 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed42ae7b-721a-4813-bcfb-ee5e8681fe83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d1de6a9145f4ce1a63020a3713ed137, user_id=2b156e8582804be5b89bf08dfb36dbfe, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:00.241490 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed42ae7b-721a-4813-bcfb-ee5e8681fe83 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:00.266826 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 873/1748] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:07:00 2022] PUT /identity/v3/projects/3d1de6a9145f4ce1a63020a3713ed137/users/2b156e8582804be5b89bf08dfb36dbfe/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:07:00.271642 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8acb280-a4c0-4fd4-8818-03e965ea4d83 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:00.286037 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8acb280-a4c0-4fd4-8818-03e965ea4d83 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:00.328737 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed42ae7b-721a-4813-bcfb-ee5e8681fe83 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:00.331652 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ed42ae7b-721a-4813-bcfb-ee5e8681fe83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:00.384945 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:00.445585 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df97ec8-ad92-431a-84ef-9b16da914bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:00.446827 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df97ec8-ad92-431a-84ef-9b16da914bc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:00.447277 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df97ec8-ad92-431a-84ef-9b16da914bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:00.447703 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df97ec8-ad92-431a-84ef-9b16da914bc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:00.450716 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df97ec8-ad92-431a-84ef-9b16da914bc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:00.452548 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df97ec8-ad92-431a-84ef-9b16da914bc6 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:00.453247 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed42ae7b-721a-4813-bcfb-ee5e8681fe83 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:00.459304 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b09d4c-f1f5-4a99-b774-ba476ebe9021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:00.460428 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b09d4c-f1f5-4a99-b774-ba476ebe9021 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:00.460760 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b09d4c-f1f5-4a99-b774-ba476ebe9021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:00.461590 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b09d4c-f1f5-4a99-b774-ba476ebe9021 admin admin] PATH_INFO: `/v3/projects/60c15aab6579452cb4a604b5dbef8c86` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:00.466256 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b09d4c-f1f5-4a99-b774-ba476ebe9021 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60c15aab6579452cb4a604b5dbef8c86)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:00.468400 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b09d4c-f1f5-4a99-b774-ba476ebe9021 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:00.474788 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 876/1749] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:07:00 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:07:00.475975 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df97ec8-ad92-431a-84ef-9b16da914bc6 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:00.488635 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df97ec8-ad92-431a-84ef-9b16da914bc6 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:00.494895 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b509357a-7039-41e9-804f-215a0eaed92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:00.496078 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509357a-7039-41e9-804f-215a0eaed92e admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:00.496890 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509357a-7039-41e9-804f-215a0eaed92e admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:00.496890 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509357a-7039-41e9-804f-215a0eaed92e admin admin] PATH_INFO: `/v3/projects/3d1de6a9145f4ce1a63020a3713ed137/users/2b156e8582804be5b89bf08dfb36dbfe/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:00.499335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b509357a-7039-41e9-804f-215a0eaed92e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d1de6a9145f4ce1a63020a3713ed137, user_id=2b156e8582804be5b89bf08dfb36dbfe, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:00.503327 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b509357a-7039-41e9-804f-215a0eaed92e admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:00.527115 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 877/1750] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:07:00 2022] PUT /identity/v3/projects/3d1de6a9145f4ce1a63020a3713ed137/users/2b156e8582804be5b89bf08dfb36dbfe/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:07:00.528682 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a466bd0-2d4f-4034-875c-bb8203053152 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:00.529186 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a466bd0-2d4f-4034-875c-bb8203053152 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:00.529410 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a466bd0-2d4f-4034-875c-bb8203053152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:00.558834 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b8b09d4c-f1f5-4a99-b774-ba476ebe9021 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60c15aab6579452cb4a604b5dbef8c86', 'request_id': 'req-b8b09d4c-f1f5-4a99-b774-ba476ebe9021'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:00.578743 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b8b09d4c-f1f5-4a99-b774-ba476ebe9021 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60c15aab6579452cb4a604b5dbef8c86', 'request_id': 'req-b8b09d4c-f1f5-4a99-b774-ba476ebe9021'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:00.586158 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b8b09d4c-f1f5-4a99-b774-ba476ebe9021 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60c15aab6579452cb4a604b5dbef8c86', 'request_id': 'req-b8b09d4c-f1f5-4a99-b774-ba476ebe9021'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:00.596581 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-0a466bd0-2d4f-4034-875c-bb8203053152 None None] MFA Rules not processed for user `2b156e8582804be5b89bf08dfb36dbfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:00.600218 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-0a466bd0-2d4f-4034-875c-bb8203053152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:00.613590 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b8b09d4c-f1f5-4a99-b774-ba476ebe9021 admin admin] The token cache is being invalidate because project 60c15aab6579452cb4a604b5dbef8c86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:07:00.614288 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b8b09d4c-f1f5-4a99-b774-ba476ebe9021 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:00.627859 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b8b09d4c-f1f5-4a99-b774-ba476ebe9021 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:00.630270 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 874/1751] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:07:00 2022] DELETE /identity/v3/projects/60c15aab6579452cb4a604b5dbef8c86 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:07:00.637729 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139612b-df69-41e0-809e-45bf63af287a None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:00.638203 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139612b-df69-41e0-809e-45bf63af287a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:00.638617 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139612b-df69-41e0-809e-45bf63af287a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:00.673974 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-f139612b-df69-41e0-809e-45bf63af287a None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:00.675435 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f139612b-df69-41e0-809e-45bf63af287a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:00.681502 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:00.724331 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 878/1752] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:00 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:07:00.735580 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a466bd0-2d4f-4034-875c-bb8203053152 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:00.737451 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-0a466bd0-2d4f-4034-875c-bb8203053152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:00.812803 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 875/1753] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:07:00.814371 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a227b-04f2-4460-b680-10e5f9611c1c None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:00.816656 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a227b-04f2-4460-b680-10e5f9611c1c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:00.817100 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a227b-04f2-4460-b680-10e5f9611c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:00.854748 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-b09a227b-04f2-4460-b680-10e5f9611c1c None None] MFA Rules not processed for user `ac2ba7b98bfd40a49cf11263d9739e68`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:00.857202 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b09a227b-04f2-4460-b680-10e5f9611c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:00.905908 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a466bd0-2d4f-4034-875c-bb8203053152 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:00.916664 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0edc8a-c155-4a7f-86bb-2ec532ff6f2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:00.917339 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0edc8a-c155-4a7f-86bb-2ec532ff6f2f service cinder] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:00.917460 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:00.917625 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0edc8a-c155-4a7f-86bb-2ec532ff6f2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:00.917909 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0edc8a-c155-4a7f-86bb-2ec532ff6f2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:00.928819 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 876/1754] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:07:00.931214 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746eeefc-825e-4729-9e6c-03b21113cd4e None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:00.932608 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746eeefc-825e-4729-9e6c-03b21113cd4e None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:00.933073 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746eeefc-825e-4729-9e6c-03b21113cd4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:00.937863 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0edc8a-c155-4a7f-86bb-2ec532ff6f2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:00.939712 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0edc8a-c155-4a7f-86bb-2ec532ff6f2f service cinder] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:00.964307 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 879/1755] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:07:00 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 12:07:01.015311 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-746eeefc-825e-4729-9e6c-03b21113cd4e None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:01.018029 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-746eeefc-825e-4729-9e6c-03b21113cd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:01.049028 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 877/1756] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:07:01.053545 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0edc8a-c155-4a7f-86bb-2ec532ff6f2f service cinder] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:01.074671 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0edc8a-c155-4a7f-86bb-2ec532ff6f2f service cinder] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:01.084807 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b33a3c-a7ca-42cc-ba7d-55bb8a4274b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:01.086378 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b33a3c-a7ca-42cc-ba7d-55bb8a4274b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:01.088618 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b33a3c-a7ca-42cc-ba7d-55bb8a4274b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:01.088867 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b33a3c-a7ca-42cc-ba7d-55bb8a4274b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:01.089646 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b33a3c-a7ca-42cc-ba7d-55bb8a4274b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:07:01.089959 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b33a3c-a7ca-42cc-ba7d-55bb8a4274b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:01.091610 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b33a3c-a7ca-42cc-ba7d-55bb8a4274b6 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:01.129372 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 880/1757] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:07:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:07:01.133684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746eeefc-825e-4729-9e6c-03b21113cd4e None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:01.150444 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746eeefc-825e-4729-9e6c-03b21113cd4e None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:01.162078 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadef0ff-93b4-4365-9d6a-1d1720bd8d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:01.163154 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadef0ff-93b4-4365-9d6a-1d1720bd8d2a admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:01.164789 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadef0ff-93b4-4365-9d6a-1d1720bd8d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:01.164789 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadef0ff-93b4-4365-9d6a-1d1720bd8d2a admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:01.165753 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadef0ff-93b4-4365-9d6a-1d1720bd8d2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:01.171003 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadef0ff-93b4-4365-9d6a-1d1720bd8d2a admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:01.249855 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 878/1758] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:07:01 2022] POST /identity/v3/projects => generated 365 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:07:01.251303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b33a3c-a7ca-42cc-ba7d-55bb8a4274b6 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:01.265990 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b33a3c-a7ca-42cc-ba7d-55bb8a4274b6 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:01.345081 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadef0ff-93b4-4365-9d6a-1d1720bd8d2a admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:01.384641 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16291e-81bd-453f-bbdd-ab5aa0e7a109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:01.385662 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16291e-81bd-453f-bbdd-ab5aa0e7a109 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:01.386222 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16291e-81bd-453f-bbdd-ab5aa0e7a109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:01.386670 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16291e-81bd-453f-bbdd-ab5aa0e7a109 admin admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:01.387547 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c16291e-81bd-453f-bbdd-ab5aa0e7a109 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:01.390136 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c16291e-81bd-453f-bbdd-ab5aa0e7a109 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:01.448154 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 881/1759] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:07:01 2022] POST /identity/v3/users => generated 283 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:07:01.456568 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16291e-81bd-453f-bbdd-ab5aa0e7a109 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:01.505385 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadef0ff-93b4-4365-9d6a-1d1720bd8d2a admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:01.509249 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16291e-81bd-453f-bbdd-ab5aa0e7a109 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:01.519235 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea4f50-322c-421e-ae1b-112280d04aae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:01.519915 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea4f50-322c-421e-ae1b-112280d04aae service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:01.520251 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea4f50-322c-421e-ae1b-112280d04aae service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:01.520501 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea4f50-322c-421e-ae1b-112280d04aae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:01.525683 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59fcf1-65e5-42ed-91f6-c9fc9e05c103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:01.527740 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59fcf1-65e5-42ed-91f6-c9fc9e05c103 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:01.528025 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59fcf1-65e5-42ed-91f6-c9fc9e05c103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:01.534368 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-dfea4f50-322c-421e-ae1b-112280d04aae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:01.536185 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59fcf1-65e5-42ed-91f6-c9fc9e05c103 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:01.536965 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c59fcf1-65e5-42ed-91f6-c9fc9e05c103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:01.538629 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c59fcf1-65e5-42ed-91f6-c9fc9e05c103 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:01.564967 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 882/1760] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:07:01 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:07:01.568937 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59fcf1-65e5-42ed-91f6-c9fc9e05c103 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:01.596415 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59fcf1-65e5-42ed-91f6-c9fc9e05c103 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:01.602843 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feb9fae-a888-4a35-bb42-ab5a966d09e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:01.603552 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb9fae-a888-4a35-bb42-ab5a966d09e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:01.603842 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb9fae-a888-4a35-bb42-ab5a966d09e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:01.604125 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb9fae-a888-4a35-bb42-ab5a966d09e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:01.605219 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feb9fae-a888-4a35-bb42-ab5a966d09e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:01.606835 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feb9fae-a888-4a35-bb42-ab5a966d09e8 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:01.619733 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 883/1761] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:07:01 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:07:01.625215 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feb9fae-a888-4a35-bb42-ab5a966d09e8 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:01.639327 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feb9fae-a888-4a35-bb42-ab5a966d09e8 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:01.645771 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4513be6-7959-44d0-a23e-b3423b85ffb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:01.650015 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4513be6-7959-44d0-a23e-b3423b85ffb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:01.650539 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4513be6-7959-44d0-a23e-b3423b85ffb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:01.650786 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfea4f50-322c-421e-ae1b-112280d04aae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:01.650896 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4513be6-7959-44d0-a23e-b3423b85ffb1 admin admin] PATH_INFO: `/v3/projects/59aa5fb3bad54e8f9db723964b6ebd47/users/8a8cf9cc4d5645eca84b8a0589914da3/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:01.652451 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfea4f50-322c-421e-ae1b-112280d04aae service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:01.665281 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 879/1762] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:07:01 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:07:01.670916 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6321d-e1c2-4429-822d-8e4080fa9eb8 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:01.671258 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6321d-e1c2-4429-822d-8e4080fa9eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:01.671606 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6321d-e1c2-4429-822d-8e4080fa9eb8 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:01.674059 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 880/1763] 10.222.0.39 () {54 vars in 921 bytes} [Wed Jun 8 12:07:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:07:01.710126 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4513be6-7959-44d0-a23e-b3423b85ffb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59aa5fb3bad54e8f9db723964b6ebd47, user_id=8a8cf9cc4d5645eca84b8a0589914da3, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:01.713595 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4513be6-7959-44d0-a23e-b3423b85ffb1 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:01.723487 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ea961-423e-435f-bbb2-00dc647cb14f None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:01.723755 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ea961-423e-435f-bbb2-00dc647cb14f None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:01.724020 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ea961-423e-435f-bbb2-00dc647cb14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:01.733867 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 884/1764] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:07:01 2022] PUT /identity/v3/projects/59aa5fb3bad54e8f9db723964b6ebd47/users/8a8cf9cc4d5645eca84b8a0589914da3/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:07:01.745594 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f17c7-5ebb-4129-899d-7d8480a55505 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:01.747202 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f17c7-5ebb-4129-899d-7d8480a55505 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:01.747202 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f17c7-5ebb-4129-899d-7d8480a55505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:01.780730 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-3d0ea961-423e-435f-bbb2-00dc647cb14f None None] MFA Rules not processed for user `7ef7edb5e9ce49e6b098f48bf060b228`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:01.781986 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-3d0ea961-423e-435f-bbb2-00dc647cb14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:01.792985 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:01.818215 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-501f17c7-5ebb-4129-899d-7d8480a55505 None None] MFA Rules not processed for user `8a8cf9cc4d5645eca84b8a0589914da3`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:01.820130 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-501f17c7-5ebb-4129-899d-7d8480a55505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:01.953613 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 885/1765] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:01 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:07:01.956258 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f17c7-5ebb-4129-899d-7d8480a55505 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:02.008936 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 881/1766] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Jun 8 12:07:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:07:02.103896 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f17c7-5ebb-4129-899d-7d8480a55505 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:02.118378 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88935362-0fc7-4519-9824-6d6fd5f22382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:02.119186 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88935362-0fc7-4519-9824-6d6fd5f22382 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:02.119535 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88935362-0fc7-4519-9824-6d6fd5f22382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:02.119821 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88935362-0fc7-4519-9824-6d6fd5f22382 admin admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:02.121616 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88935362-0fc7-4519-9824-6d6fd5f22382 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:02.124853 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88935362-0fc7-4519-9824-6d6fd5f22382 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:02.205299 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 886/1767] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:07:01 2022] POST /identity/v3/projects => generated 365 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:07:02.210567 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0ea961-423e-435f-bbb2-00dc647cb14f None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:02.232242 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0ea961-423e-435f-bbb2-00dc647cb14f None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:02.281641 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:02.454685 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c971e4-f8a5-4cb2-b572-9eeb2c50adeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:02.457085 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c971e4-f8a5-4cb2-b572-9eeb2c50adeb admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:02.457337 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c971e4-f8a5-4cb2-b572-9eeb2c50adeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:02.457603 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c971e4-f8a5-4cb2-b572-9eeb2c50adeb admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:02.458497 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c971e4-f8a5-4cb2-b572-9eeb2c50adeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:02.462058 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c971e4-f8a5-4cb2-b572-9eeb2c50adeb admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:02.513354 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 882/1768] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:07:02 2022] POST /identity/v3/users => generated 289 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:07:02.514830 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88935362-0fc7-4519-9824-6d6fd5f22382 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:02.529342 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88935362-0fc7-4519-9824-6d6fd5f22382 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:02.535153 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f5f42a-d476-400f-972d-894322d01d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:02.535885 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5f42a-d476-400f-972d-894322d01d04 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:02.536311 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5f42a-d476-400f-972d-894322d01d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:02.537342 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5f42a-d476-400f-972d-894322d01d04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:02.538649 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f5f42a-d476-400f-972d-894322d01d04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:02.541599 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f5f42a-d476-400f-972d-894322d01d04 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:02.575386 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 887/1769] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:07:02.579508 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c971e4-f8a5-4cb2-b572-9eeb2c50adeb admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:02.599478 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c971e4-f8a5-4cb2-b572-9eeb2c50adeb admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:02.608916 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebbd74f-ac2b-4605-be2c-94c1a70a0630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:02.609915 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbd74f-ac2b-4605-be2c-94c1a70a0630 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:02.610262 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbd74f-ac2b-4605-be2c-94c1a70a0630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:02.610619 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbd74f-ac2b-4605-be2c-94c1a70a0630 admin admin] PATH_INFO: `/v3/projects/55ad613bcecc4d36be6e1b5fc3c7c242/users/d7516b3c1c97417bb9de6f32a195b079/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:02.634641 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebbd74f-ac2b-4605-be2c-94c1a70a0630 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55ad613bcecc4d36be6e1b5fc3c7c242, user_id=d7516b3c1c97417bb9de6f32a195b079, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:02.638870 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebbd74f-ac2b-4605-be2c-94c1a70a0630 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:02.682617 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 883/1770] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:07:02 2022] PUT /identity/v3/projects/55ad613bcecc4d36be6e1b5fc3c7c242/users/d7516b3c1c97417bb9de6f32a195b079/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:07:02.687888 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f5f42a-d476-400f-972d-894322d01d04 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:02.712270 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f5f42a-d476-400f-972d-894322d01d04 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:02.855728 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a39ae9-8ca4-4ee3-a1df-b020855b2783 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:02.855728 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a39ae9-8ca4-4ee3-a1df-b020855b2783 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:02.855728 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a39ae9-8ca4-4ee3-a1df-b020855b2783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:02.929875 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-e2a39ae9-8ca4-4ee3-a1df-b020855b2783 None None] MFA Rules not processed for user `38475bbe086b451fb78750ce6606dfa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:02.931388 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-e2a39ae9-8ca4-4ee3-a1df-b020855b2783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:02.952947 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1eab1-40d5-43a4-b03d-9f7fdde3ad83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:02.953994 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1eab1-40d5-43a4-b03d-9f7fdde3ad83 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:02.954489 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1eab1-40d5-43a4-b03d-9f7fdde3ad83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:02.954963 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1eab1-40d5-43a4-b03d-9f7fdde3ad83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:02.955917 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe1eab1-40d5-43a4-b03d-9f7fdde3ad83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:02.958080 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe1eab1-40d5-43a4-b03d-9f7fdde3ad83 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:02.978092 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 888/1771] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:07:02.982029 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1eab1-40d5-43a4-b03d-9f7fdde3ad83 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:02.993694 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1eab1-40d5-43a4-b03d-9f7fdde3ad83 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:02.999178 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee9644-b25f-418f-9332-9bd90513ab7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:03.000552 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee9644-b25f-418f-9332-9bd90513ab7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:03.000552 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee9644-b25f-418f-9332-9bd90513ab7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:03.001455 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee9644-b25f-418f-9332-9bd90513ab7c admin admin] PATH_INFO: `/v3/projects/55ad613bcecc4d36be6e1b5fc3c7c242/users/d7516b3c1c97417bb9de6f32a195b079/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:03.004575 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ee9644-b25f-418f-9332-9bd90513ab7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=55ad613bcecc4d36be6e1b5fc3c7c242, user_id=d7516b3c1c97417bb9de6f32a195b079, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:03.009079 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ee9644-b25f-418f-9332-9bd90513ab7c admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:03.015619 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:03.024101 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 889/1772] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:07:02 2022] PUT /identity/v3/projects/55ad613bcecc4d36be6e1b5fc3c7c242/users/d7516b3c1c97417bb9de6f32a195b079/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:07:03.042107 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0c7dc-9d14-45b3-a80a-9401a268f257 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:03.042411 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0c7dc-9d14-45b3-a80a-9401a268f257 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:03.042682 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0c7dc-9d14-45b3-a80a-9401a268f257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:03.109428 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-65f0c7dc-9d14-45b3-a80a-9401a268f257 None None] MFA Rules not processed for user `d7516b3c1c97417bb9de6f32a195b079`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:03.111899 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-65f0c7dc-9d14-45b3-a80a-9401a268f257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:03.112930 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 884/1773] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:07:03.277746 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 890/1774] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:03 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:07:03.289854 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a39ae9-8ca4-4ee3-a1df-b020855b2783 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:03.291286 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-e2a39ae9-8ca4-4ee3-a1df-b020855b2783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:03.450009 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a39ae9-8ca4-4ee3-a1df-b020855b2783 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:03.501913 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:03.573488 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6eca3a-4e0b-4a28-8fa3-36561217511a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:03.574873 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6eca3a-4e0b-4a28-8fa3-36561217511a service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:03.575148 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6eca3a-4e0b-4a28-8fa3-36561217511a service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:03.575425 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6eca3a-4e0b-4a28-8fa3-36561217511a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:03.605598 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6eca3a-4e0b-4a28-8fa3-36561217511a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:03.607070 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6eca3a-4e0b-4a28-8fa3-36561217511a service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:03.631520 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 885/1775] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:07:03 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:07:04.327704 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0c7dc-9d14-45b3-a80a-9401a268f257 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:04.347102 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0c7dc-9d14-45b3-a80a-9401a268f257 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:04.361597 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d79d32-fdeb-4a49-bb61-5905f0b10e4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:04.362287 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d79d32-fdeb-4a49-bb61-5905f0b10e4d service cinder] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:04.362598 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d79d32-fdeb-4a49-bb61-5905f0b10e4d service cinder] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:04.363187 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d79d32-fdeb-4a49-bb61-5905f0b10e4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:04.548814 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d79d32-fdeb-4a49-bb61-5905f0b10e4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:04.550583 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d79d32-fdeb-4a49-bb61-5905f0b10e4d service cinder] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:04.592545 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23078d-f9e0-42f7-9847-6c527434aee4 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:04.593992 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23078d-f9e0-42f7-9847-6c527434aee4 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:04.594425 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23078d-f9e0-42f7-9847-6c527434aee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:04.649173 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 891/1776] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:07:04 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:07:04.650212 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d79d32-fdeb-4a49-bb61-5905f0b10e4d service cinder] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:04.661115 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-22d79d32-fdeb-4a49-bb61-5905f0b10e4d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:04.719347 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-7f23078d-f9e0-42f7-9847-6c527434aee4 None None] MFA Rules not processed for user `8c9b1729824c4d2793b8af88a1184ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:04.721104 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-7f23078d-f9e0-42f7-9847-6c527434aee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:04.897825 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 886/1777] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:07:04.985129 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d79d32-fdeb-4a49-bb61-5905f0b10e4d service cinder] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:04.999734 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b43c2f-08d5-465d-80e7-cb6bd2628027 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef7edb5e9ce49e6b098f48bf060b228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:05.000235 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b43c2f-08d5-465d-80e7-cb6bd2628027 service nova] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:05.000515 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b43c2f-08d5-465d-80e7-cb6bd2628027 service nova] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:05.001662 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b43c2f-08d5-465d-80e7-cb6bd2628027 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:05.021937 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b43c2f-08d5-465d-80e7-cb6bd2628027 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:05.026588 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b43c2f-08d5-465d-80e7-cb6bd2628027 service nova] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:05.044297 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 892/1778] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:07:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:07:05.072796 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f23078d-f9e0-42f7-9847-6c527434aee4 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:05.075294 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-7f23078d-f9e0-42f7-9847-6c527434aee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:05.114991 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f23078d-f9e0-42f7-9847-6c527434aee4 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:05.135741 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad6f5e-110a-41c5-860a-0c4d2520679e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef7edb5e9ce49e6b098f48bf060b228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:05.136482 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad6f5e-110a-41c5-860a-0c4d2520679e service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:05.136767 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad6f5e-110a-41c5-860a-0c4d2520679e service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:05.137040 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad6f5e-110a-41c5-860a-0c4d2520679e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:05.259534 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ad6f5e-110a-41c5-860a-0c4d2520679e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:05.261532 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ad6f5e-110a-41c5-860a-0c4d2520679e service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:05.273055 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 887/1779] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:07:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 12:07:05.402819 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b43c2f-08d5-465d-80e7-cb6bd2628027 service nova] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:05.426117 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b43c2f-08d5-465d-80e7-cb6bd2628027 service nova] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:05.438613 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3add02-452d-4025-a633-f9cf0271dccb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef7edb5e9ce49e6b098f48bf060b228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:05.440474 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3add02-452d-4025-a633-f9cf0271dccb service nova] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:05.440775 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3add02-452d-4025-a633-f9cf0271dccb service nova] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:05.441051 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3add02-452d-4025-a633-f9cf0271dccb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:05.452049 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:05.460410 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3add02-452d-4025-a633-f9cf0271dccb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:05.466024 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3add02-452d-4025-a633-f9cf0271dccb service nova] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:05.496901 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 893/1780] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:07:05 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:07:07.733447 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3b257-cb71-4fd9-80b5-bd172be6b4c7 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:07.734018 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3b257-cb71-4fd9-80b5-bd172be6b4c7 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:07.734125 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3b257-cb71-4fd9-80b5-bd172be6b4c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:07.784191 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-84d3b257-cb71-4fd9-80b5-bd172be6b4c7 None None] MFA Rules not processed for user `38475bbe086b451fb78750ce6606dfa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:07.784191 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-84d3b257-cb71-4fd9-80b5-bd172be6b4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:07.810917 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 888/1781] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:07:08.747059 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ad6ec-d928-4b7e-a9d5-4df2b73405a2 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:08.747907 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ad6ec-d928-4b7e-a9d5-4df2b73405a2 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:08.748362 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ad6ec-d928-4b7e-a9d5-4df2b73405a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:08.775598 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-d06ad6ec-d928-4b7e-a9d5-4df2b73405a2 None None] MFA Rules not processed for user `8c9b1729824c4d2793b8af88a1184ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:08.776984 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-d06ad6ec-d928-4b7e-a9d5-4df2b73405a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:08.799571 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 894/1782] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:07:10.197684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3b257-cb71-4fd9-80b5-bd172be6b4c7 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:10.263131 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:10.276440 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3b257-cb71-4fd9-80b5-bd172be6b4c7 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:10.281051 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9007eb7-94ad-44bb-b6ba-30a6102f6ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:10.281938 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9007eb7-94ad-44bb-b6ba-30a6102f6ac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:10.282225 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9007eb7-94ad-44bb-b6ba-30a6102f6ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:10.282504 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9007eb7-94ad-44bb-b6ba-30a6102f6ac5 admin admin] PATH_INFO: `/v3/users/8a8cf9cc4d5645eca84b8a0589914da3` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:10.283709 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9007eb7-94ad-44bb-b6ba-30a6102f6ac5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a8cf9cc4d5645eca84b8a0589914da3)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:10.285694 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9007eb7-94ad-44bb-b6ba-30a6102f6ac5 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:10.334303 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b9007eb7-94ad-44bb-b6ba-30a6102f6ac5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a8cf9cc4d5645eca84b8a0589914da3'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:10.334963 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b9007eb7-94ad-44bb-b6ba-30a6102f6ac5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a8cf9cc4d5645eca84b8a0589914da3'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:10.336291 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b9007eb7-94ad-44bb-b6ba-30a6102f6ac5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a8cf9cc4d5645eca84b8a0589914da3'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:10.344015 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b9007eb7-94ad-44bb-b6ba-30a6102f6ac5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a8cf9cc4d5645eca84b8a0589914da3'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:10.356324 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b9007eb7-94ad-44bb-b6ba-30a6102f6ac5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a8cf9cc4d5645eca84b8a0589914da3'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:10.372031 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 889/1783] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:07:10 2022] DELETE /identity/v3/users/8a8cf9cc4d5645eca84b8a0589914da3 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:07:10.376443 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847d509-83d4-4435-8b2e-4f64aa4a4d40 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:10.376891 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847d509-83d4-4435-8b2e-4f64aa4a4d40 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:10.377094 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847d509-83d4-4435-8b2e-4f64aa4a4d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:10.395987 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-3847d509-83d4-4435-8b2e-4f64aa4a4d40 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:10.397217 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-3847d509-83d4-4435-8b2e-4f64aa4a4d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:10.468985 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 895/1784] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:07:10.478816 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9007eb7-94ad-44bb-b6ba-30a6102f6ac5 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:10.480605 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b9007eb7-94ad-44bb-b6ba-30a6102f6ac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:10.552343 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9007eb7-94ad-44bb-b6ba-30a6102f6ac5 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:10.556569 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a41fc6f-b5b7-4504-a665-a617f6f27272 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:10.557228 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41fc6f-b5b7-4504-a665-a617f6f27272 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:10.557510 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41fc6f-b5b7-4504-a665-a617f6f27272 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:10.557785 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41fc6f-b5b7-4504-a665-a617f6f27272 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:10.568842 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a41fc6f-b5b7-4504-a665-a617f6f27272 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:10.571546 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a41fc6f-b5b7-4504-a665-a617f6f27272 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:10.584027 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 890/1785] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:07:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:07:10.662781 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847d509-83d4-4435-8b2e-4f64aa4a4d40 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:10.664936 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-3847d509-83d4-4435-8b2e-4f64aa4a4d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:10.680883 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847d509-83d4-4435-8b2e-4f64aa4a4d40 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:10.686456 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f9d04-e891-494e-9a80-5d70e08237ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:10.687345 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f9d04-e891-494e-9a80-5d70e08237ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:10.687899 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f9d04-e891-494e-9a80-5d70e08237ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:10.688432 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f9d04-e891-494e-9a80-5d70e08237ee admin admin] PATH_INFO: `/v3/users/d8507d28c24d4552b026aa6b14eb32b6` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:10.690166 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f9d04-e891-494e-9a80-5d70e08237ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8507d28c24d4552b026aa6b14eb32b6)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:10.692516 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f9d04-e891-494e-9a80-5d70e08237ee admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:10.763340 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-bd2f9d04-e891-494e-9a80-5d70e08237ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8507d28c24d4552b026aa6b14eb32b6'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:10.771124 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-bd2f9d04-e891-494e-9a80-5d70e08237ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8507d28c24d4552b026aa6b14eb32b6'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:10.771943 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-bd2f9d04-e891-494e-9a80-5d70e08237ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8507d28c24d4552b026aa6b14eb32b6'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:10.772567 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-bd2f9d04-e891-494e-9a80-5d70e08237ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8507d28c24d4552b026aa6b14eb32b6'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:10.795320 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-bd2f9d04-e891-494e-9a80-5d70e08237ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8507d28c24d4552b026aa6b14eb32b6'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:10.814169 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 896/1786] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:07:10 2022] DELETE /identity/v3/users/d8507d28c24d4552b026aa6b14eb32b6 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:07:10.818366 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c4142-ddba-4e54-a834-4e3d4390ec51 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:10.818686 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c4142-ddba-4e54-a834-4e3d4390ec51 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:10.818991 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c4142-ddba-4e54-a834-4e3d4390ec51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:10.859773 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-355c4142-ddba-4e54-a834-4e3d4390ec51 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:10.862237 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-355c4142-ddba-4e54-a834-4e3d4390ec51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:10.954700 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 891/1787] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:07:10.965287 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f9d04-e891-494e-9a80-5d70e08237ee admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:10.966752 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-bd2f9d04-e891-494e-9a80-5d70e08237ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:11.037817 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c4142-ddba-4e54-a834-4e3d4390ec51 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:11.039847 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-355c4142-ddba-4e54-a834-4e3d4390ec51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:11.046261 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f9d04-e891-494e-9a80-5d70e08237ee admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:11.049823 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfeb7f5-1dc3-4d2c-a746-f0d62ab2b752 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:11.050482 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfeb7f5-1dc3-4d2c-a746-f0d62ab2b752 service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:11.050831 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfeb7f5-1dc3-4d2c-a746-f0d62ab2b752 service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:11.051101 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfeb7f5-1dc3-4d2c-a746-f0d62ab2b752 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:11.053788 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c4142-ddba-4e54-a834-4e3d4390ec51 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:11.065204 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6689eda-797c-4593-959d-59467846193f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:11.066374 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6689eda-797c-4593-959d-59467846193f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:11.066518 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfeb7f5-1dc3-4d2c-a746-f0d62ab2b752 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:11.067321 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6689eda-797c-4593-959d-59467846193f admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:11.067703 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6689eda-797c-4593-959d-59467846193f admin admin] PATH_INFO: `/v3/projects/59aa5fb3bad54e8f9db723964b6ebd47` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:11.068780 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfeb7f5-1dc3-4d2c-a746-f0d62ab2b752 service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:11.069642 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6689eda-797c-4593-959d-59467846193f admin admin] RBAC: Authorizing `identity:delete_project(project_id=59aa5fb3bad54e8f9db723964b6ebd47)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:11.072603 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6689eda-797c-4593-959d-59467846193f admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:11.083277 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 897/1788] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:07:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:07:11.090960 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:11.145941 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a6689eda-797c-4593-959d-59467846193f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59aa5fb3bad54e8f9db723964b6ebd47', 'request_id': 'req-a6689eda-797c-4593-959d-59467846193f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:11.153539 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a6689eda-797c-4593-959d-59467846193f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59aa5fb3bad54e8f9db723964b6ebd47', 'request_id': 'req-a6689eda-797c-4593-959d-59467846193f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:11.159561 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a6689eda-797c-4593-959d-59467846193f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59aa5fb3bad54e8f9db723964b6ebd47', 'request_id': 'req-a6689eda-797c-4593-959d-59467846193f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:11.171551 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a6689eda-797c-4593-959d-59467846193f admin admin] The token cache is being invalidate because project 59aa5fb3bad54e8f9db723964b6ebd47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:07:11.171844 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a6689eda-797c-4593-959d-59467846193f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:11.172538 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a6689eda-797c-4593-959d-59467846193f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:11.174112 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 892/1789] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:07:11 2022] DELETE /identity/v3/projects/59aa5fb3bad54e8f9db723964b6ebd47 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:07:11.178100 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfeb7f5-1dc3-4d2c-a746-f0d62ab2b752 service neutron] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:11.183902 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:11.189913 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfeb7f5-1dc3-4d2c-a746-f0d62ab2b752 service neutron] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:11.261146 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aafa08-bfc9-4ecd-a687-20301e080f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:11.262102 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aafa08-bfc9-4ecd-a687-20301e080f35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:11.262404 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aafa08-bfc9-4ecd-a687-20301e080f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:11.262683 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aafa08-bfc9-4ecd-a687-20301e080f35 admin admin] PATH_INFO: `/v3/users/d7516b3c1c97417bb9de6f32a195b079` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:11.263933 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aafa08-bfc9-4ecd-a687-20301e080f35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7516b3c1c97417bb9de6f32a195b079)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:11.266098 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aafa08-bfc9-4ecd-a687-20301e080f35 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:11.319350 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-e1aafa08-bfc9-4ecd-a687-20301e080f35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7516b3c1c97417bb9de6f32a195b079'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:11.327155 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-e1aafa08-bfc9-4ecd-a687-20301e080f35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7516b3c1c97417bb9de6f32a195b079'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:11.328049 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-e1aafa08-bfc9-4ecd-a687-20301e080f35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7516b3c1c97417bb9de6f32a195b079'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:11.328713 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-e1aafa08-bfc9-4ecd-a687-20301e080f35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7516b3c1c97417bb9de6f32a195b079'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:11.345568 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-e1aafa08-bfc9-4ecd-a687-20301e080f35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7516b3c1c97417bb9de6f32a195b079'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:11.362145 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 898/1790] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:07:11 2022] DELETE /identity/v3/users/d7516b3c1c97417bb9de6f32a195b079 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:07:11.424912 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6689eda-797c-4593-959d-59467846193f admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:11.427657 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a6689eda-797c-4593-959d-59467846193f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:11.443688 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6689eda-797c-4593-959d-59467846193f admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:11.517892 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68799d45-0f55-4687-b6a3-0da4bc3b3c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:11.518983 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68799d45-0f55-4687-b6a3-0da4bc3b3c54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:11.519351 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68799d45-0f55-4687-b6a3-0da4bc3b3c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:11.519678 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68799d45-0f55-4687-b6a3-0da4bc3b3c54 admin admin] PATH_INFO: `/v3/projects/7694b648b26542f9b0a61841d645ca93` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:11.520956 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68799d45-0f55-4687-b6a3-0da4bc3b3c54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7694b648b26542f9b0a61841d645ca93)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:11.523657 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68799d45-0f55-4687-b6a3-0da4bc3b3c54 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:11.587298 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-68799d45-0f55-4687-b6a3-0da4bc3b3c54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7694b648b26542f9b0a61841d645ca93', 'request_id': 'req-68799d45-0f55-4687-b6a3-0da4bc3b3c54'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:11.617958 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-68799d45-0f55-4687-b6a3-0da4bc3b3c54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7694b648b26542f9b0a61841d645ca93', 'request_id': 'req-68799d45-0f55-4687-b6a3-0da4bc3b3c54'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:11.629597 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-68799d45-0f55-4687-b6a3-0da4bc3b3c54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7694b648b26542f9b0a61841d645ca93', 'request_id': 'req-68799d45-0f55-4687-b6a3-0da4bc3b3c54'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:11.645654 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-68799d45-0f55-4687-b6a3-0da4bc3b3c54 admin admin] The token cache is being invalidate because project 7694b648b26542f9b0a61841d645ca93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:07:11.646033 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-68799d45-0f55-4687-b6a3-0da4bc3b3c54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:11.646692 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-68799d45-0f55-4687-b6a3-0da4bc3b3c54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:11.648917 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 893/1791] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:07:11 2022] DELETE /identity/v3/projects/7694b648b26542f9b0a61841d645ca93 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:07:11.653109 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aafa08-bfc9-4ecd-a687-20301e080f35 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:11.654561 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-e1aafa08-bfc9-4ecd-a687-20301e080f35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:11.668420 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aafa08-bfc9-4ecd-a687-20301e080f35 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:11.683021 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68799d45-0f55-4687-b6a3-0da4bc3b3c54 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:11.684433 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-68799d45-0f55-4687-b6a3-0da4bc3b3c54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:11.717805 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:11.734814 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69341251-e830-4d39-8c22-f6ae286cfdf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:11.735766 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69341251-e830-4d39-8c22-f6ae286cfdf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:11.736212 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69341251-e830-4d39-8c22-f6ae286cfdf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:11.736511 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69341251-e830-4d39-8c22-f6ae286cfdf2 admin admin] PATH_INFO: `/v3/users/ac804548fa7a4cc786a03572a30a188b` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:11.737861 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69341251-e830-4d39-8c22-f6ae286cfdf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac804548fa7a4cc786a03572a30a188b)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:11.739871 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69341251-e830-4d39-8c22-f6ae286cfdf2 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:11.756308 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68799d45-0f55-4687-b6a3-0da4bc3b3c54 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:11.762241 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d6419-b9dc-4402-91e2-2f52a1a17ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:11.763145 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d6419-b9dc-4402-91e2-2f52a1a17ba8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:11.763473 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d6419-b9dc-4402-91e2-2f52a1a17ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:11.763747 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d6419-b9dc-4402-91e2-2f52a1a17ba8 admin admin] PATH_INFO: `/v3/projects/55ad613bcecc4d36be6e1b5fc3c7c242` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:11.764971 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886d6419-b9dc-4402-91e2-2f52a1a17ba8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55ad613bcecc4d36be6e1b5fc3c7c242)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:11.766015 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:11.767025 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886d6419-b9dc-4402-91e2-2f52a1a17ba8 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:11.792520 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-69341251-e830-4d39-8c22-f6ae286cfdf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac804548fa7a4cc786a03572a30a188b'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:11.800098 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-69341251-e830-4d39-8c22-f6ae286cfdf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac804548fa7a4cc786a03572a30a188b'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:11.801056 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-69341251-e830-4d39-8c22-f6ae286cfdf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac804548fa7a4cc786a03572a30a188b'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:11.801730 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-69341251-e830-4d39-8c22-f6ae286cfdf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac804548fa7a4cc786a03572a30a188b'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:11.815825 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-69341251-e830-4d39-8c22-f6ae286cfdf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac804548fa7a4cc786a03572a30a188b'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:11.817307 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-886d6419-b9dc-4402-91e2-2f52a1a17ba8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55ad613bcecc4d36be6e1b5fc3c7c242', 'request_id': 'req-886d6419-b9dc-4402-91e2-2f52a1a17ba8'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:11.828330 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-886d6419-b9dc-4402-91e2-2f52a1a17ba8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55ad613bcecc4d36be6e1b5fc3c7c242', 'request_id': 'req-886d6419-b9dc-4402-91e2-2f52a1a17ba8'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:11.831265 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 899/1792] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:07:11 2022] DELETE /identity/v3/users/ac804548fa7a4cc786a03572a30a188b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:07:11.837063 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-886d6419-b9dc-4402-91e2-2f52a1a17ba8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55ad613bcecc4d36be6e1b5fc3c7c242', 'request_id': 'req-886d6419-b9dc-4402-91e2-2f52a1a17ba8'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:11.851682 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-886d6419-b9dc-4402-91e2-2f52a1a17ba8 admin admin] The token cache is being invalidate because project 55ad613bcecc4d36be6e1b5fc3c7c242 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:07:11.851979 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-886d6419-b9dc-4402-91e2-2f52a1a17ba8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:11.853100 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-886d6419-b9dc-4402-91e2-2f52a1a17ba8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:11.855167 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 894/1793] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:07:11 2022] DELETE /identity/v3/projects/55ad613bcecc4d36be6e1b5fc3c7c242 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:07:11.859934 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7648c-d1f0-456e-983f-e59edfeb0c1a None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:11.860255 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7648c-d1f0-456e-983f-e59edfeb0c1a None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:11.860538 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7648c-d1f0-456e-983f-e59edfeb0c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:11.879730 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-d2e7648c-d1f0-456e-983f-e59edfeb0c1a None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:11.881013 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-d2e7648c-d1f0-456e-983f-e59edfeb0c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:11.948833 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 900/1794] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:07:11.956409 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa270e6-9b23-479d-80b1-77f7568b2878 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:11.956713 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa270e6-9b23-479d-80b1-77f7568b2878 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:11.956990 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa270e6-9b23-479d-80b1-77f7568b2878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:11.984479 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-4fa270e6-9b23-479d-80b1-77f7568b2878 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:11.985827 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-4fa270e6-9b23-479d-80b1-77f7568b2878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:11.994734 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 895/1795] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:07:11.999122 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e7648c-d1f0-456e-983f-e59edfeb0c1a None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:12.009589 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e7648c-d1f0-456e-983f-e59edfeb0c1a None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:12.014690 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c106e026-505a-4f14-a18b-0ce4682b718e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:12.015361 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106e026-505a-4f14-a18b-0ce4682b718e admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:12.015643 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106e026-505a-4f14-a18b-0ce4682b718e admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:12.015914 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106e026-505a-4f14-a18b-0ce4682b718e admin admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:12.016673 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c106e026-505a-4f14-a18b-0ce4682b718e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:07:12.016977 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c106e026-505a-4f14-a18b-0ce4682b718e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:12.018575 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c106e026-505a-4f14-a18b-0ce4682b718e admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:12.032839 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 901/1796] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:07:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:07:12.037245 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa270e6-9b23-479d-80b1-77f7568b2878 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:12.048007 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa270e6-9b23-479d-80b1-77f7568b2878 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:12.053117 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb8c530-8981-4b4c-8be7-bd66055fbeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:12.053789 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8c530-8981-4b4c-8be7-bd66055fbeef admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:12.054277 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8c530-8981-4b4c-8be7-bd66055fbeef admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:12.054767 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8c530-8981-4b4c-8be7-bd66055fbeef admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:12.055639 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb8c530-8981-4b4c-8be7-bd66055fbeef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:12.057629 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb8c530-8981-4b4c-8be7-bd66055fbeef admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:12.087115 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 896/1797] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:07:12 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:07:12.091255 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c106e026-505a-4f14-a18b-0ce4682b718e admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:12.102534 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c106e026-505a-4f14-a18b-0ce4682b718e admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:12.175633 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda8d1af-df82-42d1-85c8-800d1c24ec7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:12.176501 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8d1af-df82-42d1-85c8-800d1c24ec7c admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:12.176785 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8d1af-df82-42d1-85c8-800d1c24ec7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:12.177660 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8d1af-df82-42d1-85c8-800d1c24ec7c admin admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:12.178373 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda8d1af-df82-42d1-85c8-800d1c24ec7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:12.180566 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda8d1af-df82-42d1-85c8-800d1c24ec7c admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:12.241057 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb8c530-8981-4b4c-8be7-bd66055fbeef admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:12.252870 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 902/1798] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:07:12 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:07:12.258495 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb8c530-8981-4b4c-8be7-bd66055fbeef admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:12.276936 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ae69e-6e34-422a-a002-0e34559ecded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:12.277606 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ae69e-6e34-422a-a002-0e34559ecded admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:12.277990 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ae69e-6e34-422a-a002-0e34559ecded admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:12.282840 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ae69e-6e34-422a-a002-0e34559ecded admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:12.282840 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3ae69e-6e34-422a-a002-0e34559ecded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:12.282840 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3ae69e-6e34-422a-a002-0e34559ecded admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:12.323906 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 897/1799] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:07:12.328841 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda8d1af-df82-42d1-85c8-800d1c24ec7c admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:12.344404 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda8d1af-df82-42d1-85c8-800d1c24ec7c admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:12.367601 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50a9b3-12b8-4cb7-a422-63b0d71f69a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:12.367601 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50a9b3-12b8-4cb7-a422-63b0d71f69a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:12.367601 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50a9b3-12b8-4cb7-a422-63b0d71f69a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:12.367601 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50a9b3-12b8-4cb7-a422-63b0d71f69a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:12.371052 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac50a9b3-12b8-4cb7-a422-63b0d71f69a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:12.375077 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac50a9b3-12b8-4cb7-a422-63b0d71f69a6 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:12.388755 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ae69e-6e34-422a-a002-0e34559ecded admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:12.390689 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-aa3ae69e-6e34-422a-a002-0e34559ecded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:12.410324 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ae69e-6e34-422a-a002-0e34559ecded admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:12.418899 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 903/1800] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:07:12.422629 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50a9b3-12b8-4cb7-a422-63b0d71f69a6 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:12.432743 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fae705d-d741-4a53-b024-2898ebceec49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:12.444843 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae705d-d741-4a53-b024-2898ebceec49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:12.445598 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae705d-d741-4a53-b024-2898ebceec49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:12.447480 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae705d-d741-4a53-b024-2898ebceec49 admin admin] PATH_INFO: `/v3/projects/5410b06e72d6407281f667cdd48936af` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:12.451203 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fae705d-d741-4a53-b024-2898ebceec49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5410b06e72d6407281f667cdd48936af)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:12.453500 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fae705d-d741-4a53-b024-2898ebceec49 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:12.455878 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50a9b3-12b8-4cb7-a422-63b0d71f69a6 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:12.471217 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707c82a-f0a7-40a5-b25d-bd99d35c4a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:12.472489 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707c82a-f0a7-40a5-b25d-bd99d35c4a4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:12.489457 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707c82a-f0a7-40a5-b25d-bd99d35c4a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:12.495550 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707c82a-f0a7-40a5-b25d-bd99d35c4a4d admin admin] PATH_INFO: `/v3/projects/e66929d0d3a745ad94ccdbcc0a5788ab/users/9bb8d92318ad4eccbd072f94258c70a7/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:12.506841 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:12.542682 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5707c82a-f0a7-40a5-b25d-bd99d35c4a4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e66929d0d3a745ad94ccdbcc0a5788ab, user_id=9bb8d92318ad4eccbd072f94258c70a7, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:12.545842 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5707c82a-f0a7-40a5-b25d-bd99d35c4a4d admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:12.584584 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 904/1801] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:07:12 2022] PUT /identity/v3/projects/e66929d0d3a745ad94ccdbcc0a5788ab/users/9bb8d92318ad4eccbd072f94258c70a7/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:07:12.597425 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90701a52-928e-4fe3-8aae-2021d6c1cc4c None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:12.598911 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90701a52-928e-4fe3-8aae-2021d6c1cc4c None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:12.599443 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90701a52-928e-4fe3-8aae-2021d6c1cc4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:12.643488 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-4fae705d-d741-4a53-b024-2898ebceec49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5410b06e72d6407281f667cdd48936af', 'request_id': 'req-4fae705d-d741-4a53-b024-2898ebceec49'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:12.667495 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-4fae705d-d741-4a53-b024-2898ebceec49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5410b06e72d6407281f667cdd48936af', 'request_id': 'req-4fae705d-d741-4a53-b024-2898ebceec49'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:12.692912 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-4fae705d-d741-4a53-b024-2898ebceec49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5410b06e72d6407281f667cdd48936af', 'request_id': 'req-4fae705d-d741-4a53-b024-2898ebceec49'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:12.730844 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:12.736763 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-90701a52-928e-4fe3-8aae-2021d6c1cc4c None None] MFA Rules not processed for user `9bb8d92318ad4eccbd072f94258c70a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:12.747780 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-90701a52-928e-4fe3-8aae-2021d6c1cc4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:12.752643 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-4fae705d-d741-4a53-b024-2898ebceec49 admin admin] The token cache is being invalidate because project 5410b06e72d6407281f667cdd48936af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:07:12.753315 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-4fae705d-d741-4a53-b024-2898ebceec49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:12.755517 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-4fae705d-d741-4a53-b024-2898ebceec49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:12.763090 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 898/1802] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:07:12 2022] DELETE /identity/v3/projects/5410b06e72d6407281f667cdd48936af => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:07:12.771178 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e12f3d-5103-436a-8d1f-89e3b824526b None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:12.771865 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e12f3d-5103-436a-8d1f-89e3b824526b None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:12.772318 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e12f3d-5103-436a-8d1f-89e3b824526b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:12.818513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-74e12f3d-5103-436a-8d1f-89e3b824526b None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:12.820406 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-74e12f3d-5103-436a-8d1f-89e3b824526b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:12.935895 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 899/1803] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:07:12.942875 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd0359-bff8-46c8-83a8-a401fdce7373 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:12.943172 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd0359-bff8-46c8-83a8-a401fdce7373 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:12.943456 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd0359-bff8-46c8-83a8-a401fdce7373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:12.969155 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 905/1804] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:07:12.969954 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90701a52-928e-4fe3-8aae-2021d6c1cc4c None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:12.971245 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-cbdd0359-bff8-46c8-83a8-a401fdce7373 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:12.973391 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-cbdd0359-bff8-46c8-83a8-a401fdce7373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:12.974720 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-90701a52-928e-4fe3-8aae-2021d6c1cc4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:12.987957 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 900/1805] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:07:12.993378 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd0359-bff8-46c8-83a8-a401fdce7373 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:13.004753 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd0359-bff8-46c8-83a8-a401fdce7373 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:13.006468 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90701a52-928e-4fe3-8aae-2021d6c1cc4c None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:13.010014 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eed919-effc-49bc-b44c-47ecf9000639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:13.010862 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eed919-effc-49bc-b44c-47ecf9000639 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:13.011169 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd855c-22a6-4caf-b85b-ee6e1746f956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:13.011337 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eed919-effc-49bc-b44c-47ecf9000639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:13.011714 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eed919-effc-49bc-b44c-47ecf9000639 admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:13.011847 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd855c-22a6-4caf-b85b-ee6e1746f956 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:13.012135 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd855c-22a6-4caf-b85b-ee6e1746f956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:13.012966 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eed919-effc-49bc-b44c-47ecf9000639 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:07:13.013085 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd855c-22a6-4caf-b85b-ee6e1746f956 admin admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:13.013465 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eed919-effc-49bc-b44c-47ecf9000639 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:13.013766 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd855c-22a6-4caf-b85b-ee6e1746f956 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:13.015291 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eed919-effc-49bc-b44c-47ecf9000639 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:13.015755 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd855c-22a6-4caf-b85b-ee6e1746f956 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:13.032385 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 901/1806] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:07:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:07:13.035625 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eed919-effc-49bc-b44c-47ecf9000639 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:13.050625 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 906/1807] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:07:12 2022] POST /identity/v3/projects => generated 385 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:07:13.050817 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eed919-effc-49bc-b44c-47ecf9000639 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:13.053216 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd855c-22a6-4caf-b85b-ee6e1746f956 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:13.117376 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed01a3-e4a0-4b20-bf0b-d171141baee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:13.118180 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed01a3-e4a0-4b20-bf0b-d171141baee6 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:13.118523 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed01a3-e4a0-4b20-bf0b-d171141baee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:13.118878 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed01a3-e4a0-4b20-bf0b-d171141baee6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:13.119645 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ed01a3-e4a0-4b20-bf0b-d171141baee6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:13.121705 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ed01a3-e4a0-4b20-bf0b-d171141baee6 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:13.122354 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd855c-22a6-4caf-b85b-ee6e1746f956 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:13.127766 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c8e10-43b6-4a15-a2ae-f7bc6e19060f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:13.128830 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c8e10-43b6-4a15-a2ae-f7bc6e19060f admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:13.129199 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c8e10-43b6-4a15-a2ae-f7bc6e19060f admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:13.129538 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c8e10-43b6-4a15-a2ae-f7bc6e19060f admin admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:13.130301 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c8e10-43b6-4a15-a2ae-f7bc6e19060f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:13.132550 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c8e10-43b6-4a15-a2ae-f7bc6e19060f admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:13.166660 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 907/1808] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:07:13 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 12:07:13.170636 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c8e10-43b6-4a15-a2ae-f7bc6e19060f admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:13.173606 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 902/1809] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:07:13 2022] POST /identity/v3/projects => generated 387 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:07:13.177587 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed01a3-e4a0-4b20-bf0b-d171141baee6 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:13.183983 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c8e10-43b6-4a15-a2ae-f7bc6e19060f admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:13.235066 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:13.263013 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b073a-e471-4b56-8645-03187dbbd559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:13.264447 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b073a-e471-4b56-8645-03187dbbd559 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:13.264771 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b073a-e471-4b56-8645-03187dbbd559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:13.265150 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b073a-e471-4b56-8645-03187dbbd559 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:13.266468 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8b073a-e471-4b56-8645-03187dbbd559 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:13.268333 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8b073a-e471-4b56-8645-03187dbbd559 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:13.281629 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 908/1810] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:07:13 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:07:13.284723 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed01a3-e4a0-4b20-bf0b-d171141baee6 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:13.285478 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b073a-e471-4b56-8645-03187dbbd559 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:13.290277 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74e4d4-2476-455f-8da0-4c3f65464b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:13.291142 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74e4d4-2476-455f-8da0-4c3f65464b46 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:13.292241 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74e4d4-2476-455f-8da0-4c3f65464b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:13.292543 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74e4d4-2476-455f-8da0-4c3f65464b46 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:13.293250 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c74e4d4-2476-455f-8da0-4c3f65464b46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:13.295619 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c74e4d4-2476-455f-8da0-4c3f65464b46 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:13.300790 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b073a-e471-4b56-8645-03187dbbd559 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:13.307396 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433b5881-6c0d-42bb-948a-2bc755bebeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:13.308315 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b5881-6c0d-42bb-948a-2bc755bebeef admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:13.308699 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b5881-6c0d-42bb-948a-2bc755bebeef admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:13.309276 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:13.309860 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b5881-6c0d-42bb-948a-2bc755bebeef admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:13.311108 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433b5881-6c0d-42bb-948a-2bc755bebeef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:13.313736 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433b5881-6c0d-42bb-948a-2bc755bebeef admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:13.327201 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 903/1811] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:07:13 2022] POST /identity/v3/users => generated 294 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 12:07:13.331143 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74e4d4-2476-455f-8da0-4c3f65464b46 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:13.334976 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 909/1812] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:07:13 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:07:13.341204 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433b5881-6c0d-42bb-948a-2bc755bebeef admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:13.349504 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74e4d4-2476-455f-8da0-4c3f65464b46 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:13.354654 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433b5881-6c0d-42bb-948a-2bc755bebeef admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:13.357024 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500dd29c-310f-4d1a-9e33-c8877d3e581b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:13.357538 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500dd29c-310f-4d1a-9e33-c8877d3e581b admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:13.357945 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500dd29c-310f-4d1a-9e33-c8877d3e581b admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:13.358235 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500dd29c-310f-4d1a-9e33-c8877d3e581b admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:13.359118 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500dd29c-310f-4d1a-9e33-c8877d3e581b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:13.361172 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500dd29c-310f-4d1a-9e33-c8877d3e581b admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:13.365585 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac4567a-f43f-41a9-a0d7-f74efeadb82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:13.368785 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4567a-f43f-41a9-a0d7-f74efeadb82b admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:13.374009 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 904/1813] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:07:13 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:07:13.378001 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500dd29c-310f-4d1a-9e33-c8877d3e581b admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:13.382901 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4567a-f43f-41a9-a0d7-f74efeadb82b admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:13.383266 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4567a-f43f-41a9-a0d7-f74efeadb82b admin admin] PATH_INFO: `/v3/projects/eefc9cb6ce4f42adb65db74773cac86c/users/b5f2b18c7c9b4ad88be411a219d0fe5f/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:13.402731 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500dd29c-310f-4d1a-9e33-c8877d3e581b admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:13.427770 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35812174-6d01-480a-988c-665c0f046d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:13.429668 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac4567a-f43f-41a9-a0d7-f74efeadb82b admin admin] RBAC: Authorizing `identity:create_grant(project_id=eefc9cb6ce4f42adb65db74773cac86c, user_id=b5f2b18c7c9b4ad88be411a219d0fe5f, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:13.430284 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35812174-6d01-480a-988c-665c0f046d84 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:13.430647 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35812174-6d01-480a-988c-665c0f046d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:13.430931 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35812174-6d01-480a-988c-665c0f046d84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:13.434531 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac4567a-f43f-41a9-a0d7-f74efeadb82b admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:13.435902 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35812174-6d01-480a-988c-665c0f046d84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:13.437614 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35812174-6d01-480a-988c-665c0f046d84 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:13.462654 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 905/1814] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:07:13 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:07:13.467995 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 910/1815] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:07:13 2022] PUT /identity/v3/projects/eefc9cb6ce4f42adb65db74773cac86c/users/b5f2b18c7c9b4ad88be411a219d0fe5f/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:07:13.478318 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35812174-6d01-480a-988c-665c0f046d84 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:13.479738 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c25ad-2f9d-409d-b217-3c7aa694950b None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:13.480357 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c25ad-2f9d-409d-b217-3c7aa694950b None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:13.481395 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c25ad-2f9d-409d-b217-3c7aa694950b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:13.519905 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35812174-6d01-480a-988c-665c0f046d84 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:13.544848 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-2b0c25ad-2f9d-409d-b217-3c7aa694950b None None] MFA Rules not processed for user `b5f2b18c7c9b4ad88be411a219d0fe5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:13.546186 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-2b0c25ad-2f9d-409d-b217-3c7aa694950b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:13.636667 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3df615-4206-473d-96e7-e98c2e0bc40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:13.639791 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3df615-4206-473d-96e7-e98c2e0bc40e admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:13.640104 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3df615-4206-473d-96e7-e98c2e0bc40e admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:13.641551 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3df615-4206-473d-96e7-e98c2e0bc40e admin admin] PATH_INFO: `/v3/projects/a0454e1e8d284fe28a82b162ae0cd7c9/users/28ff1e0e9a48424eb9100e4a32991f15/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:13.667214 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3df615-4206-473d-96e7-e98c2e0bc40e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0454e1e8d284fe28a82b162ae0cd7c9, user_id=28ff1e0e9a48424eb9100e4a32991f15, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:13.671014 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3df615-4206-473d-96e7-e98c2e0bc40e admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:13.680400 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 911/1816] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:07:13.681992 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c25ad-2f9d-409d-b217-3c7aa694950b None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:13.685568 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-2b0c25ad-2f9d-409d-b217-3c7aa694950b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:13.690198 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 906/1817] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:07:13 2022] PUT /identity/v3/projects/a0454e1e8d284fe28a82b162ae0cd7c9/users/28ff1e0e9a48424eb9100e4a32991f15/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:07:13.691311 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3df615-4206-473d-96e7-e98c2e0bc40e admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:13.736017 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c25ad-2f9d-409d-b217-3c7aa694950b None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:13.822774 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3df615-4206-473d-96e7-e98c2e0bc40e admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:13.833612 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad6371-ae7c-464e-b139-18b4d154a992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:13.834462 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad6371-ae7c-464e-b139-18b4d154a992 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:13.835053 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad6371-ae7c-464e-b139-18b4d154a992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:13.836208 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad6371-ae7c-464e-b139-18b4d154a992 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:13.836825 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad6371-ae7c-464e-b139-18b4d154a992 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:13.839356 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad6371-ae7c-464e-b139-18b4d154a992 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:13.940004 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 907/1818] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:07:13 2022] POST /identity/v3/projects => generated 387 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:07:13.941757 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6ca95-033a-4961-8271-812136656bb3 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:13.942232 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6ca95-033a-4961-8271-812136656bb3 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:13.942676 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6ca95-033a-4961-8271-812136656bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:13.963121 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12531490-eb03-4f71-a2b5-99166f2b2173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:13.964030 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12531490-eb03-4f71-a2b5-99166f2b2173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:13.964345 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12531490-eb03-4f71-a2b5-99166f2b2173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:13.964627 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12531490-eb03-4f71-a2b5-99166f2b2173 admin admin] PATH_INFO: `/v3/users/094582d49e1b4231b395e463aac95bfd` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:13.971512 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12531490-eb03-4f71-a2b5-99166f2b2173 admin admin] RBAC: Authorizing `identity:delete_user(user_id=094582d49e1b4231b395e463aac95bfd)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:13.973550 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12531490-eb03-4f71-a2b5-99166f2b2173 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:14.030376 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:14.032545 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-67a6ca95-033a-4961-8271-812136656bb3 None None] MFA Rules not processed for user `28ff1e0e9a48424eb9100e4a32991f15`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:14.035518 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-67a6ca95-033a-4961-8271-812136656bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:14.053713 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-12531490-eb03-4f71-a2b5-99166f2b2173 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '094582d49e1b4231b395e463aac95bfd'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:14.063773 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-12531490-eb03-4f71-a2b5-99166f2b2173 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '094582d49e1b4231b395e463aac95bfd'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:14.064582 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-12531490-eb03-4f71-a2b5-99166f2b2173 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '094582d49e1b4231b395e463aac95bfd'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:14.065526 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-12531490-eb03-4f71-a2b5-99166f2b2173 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '094582d49e1b4231b395e463aac95bfd'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:14.097866 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-12531490-eb03-4f71-a2b5-99166f2b2173 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '094582d49e1b4231b395e463aac95bfd'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:14.110242 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:14.125051 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 912/1819] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:07:13 2022] DELETE /identity/v3/users/094582d49e1b4231b395e463aac95bfd => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:07:14.126609 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2922fe-2c4a-44c8-b7c8-ffc7ce5a9b3a None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:14.126982 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2922fe-2c4a-44c8-b7c8-ffc7ce5a9b3a None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:14.128078 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2922fe-2c4a-44c8-b7c8-ffc7ce5a9b3a None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:14.130129 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 913/1820] 10.222.0.39 () {54 vars in 921 bytes} [Wed Jun 8 12:07:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:07:14.130912 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2922fe-2c4a-44c8-b7c8-ffc7ce5a9b3a None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:14.134243 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-9d2922fe-2c4a-44c8-b7c8-ffc7ce5a9b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:14.175893 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 908/1821] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:07:14.177360 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980fcce9-cab1-4c29-a61d-23764aa6cdfc None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:14.177851 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980fcce9-cab1-4c29-a61d-23764aa6cdfc None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:14.178132 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980fcce9-cab1-4c29-a61d-23764aa6cdfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:14.196759 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-980fcce9-cab1-4c29-a61d-23764aa6cdfc None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:14.198446 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-980fcce9-cab1-4c29-a61d-23764aa6cdfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:14.217711 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2922fe-2c4a-44c8-b7c8-ffc7ce5a9b3a None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:14.223141 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb443ca-6e54-475b-a5ee-5203c1e075f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:14.223805 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb443ca-6e54-475b-a5ee-5203c1e075f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:14.224156 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb443ca-6e54-475b-a5ee-5203c1e075f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:14.224499 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb443ca-6e54-475b-a5ee-5203c1e075f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:14.225259 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb443ca-6e54-475b-a5ee-5203c1e075f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:14.227308 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb443ca-6e54-475b-a5ee-5203c1e075f7 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:14.252114 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 914/1822] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:07:14 2022] POST /identity/v3/users => generated 300 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:07:14.252114 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce38e15-8b6f-4be1-86d2-4822ca5fcf36 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:14.252114 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce38e15-8b6f-4be1-86d2-4822ca5fcf36 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:14.252114 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce38e15-8b6f-4be1-86d2-4822ca5fcf36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:14.271381 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-2ce38e15-8b6f-4be1-86d2-4822ca5fcf36 None None] MFA Rules not processed for user `7ef7edb5e9ce49e6b098f48bf060b228`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:14.272813 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-2ce38e15-8b6f-4be1-86d2-4822ca5fcf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:14.275728 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 909/1823] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:07:14.276824 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980fcce9-cab1-4c29-a61d-23764aa6cdfc None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:14.278177 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-980fcce9-cab1-4c29-a61d-23764aa6cdfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:14.290520 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980fcce9-cab1-4c29-a61d-23764aa6cdfc None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:14.296056 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f2d5fd-75a2-4af5-82c2-03fe3361dac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:14.297119 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2d5fd-75a2-4af5-82c2-03fe3361dac6 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:14.300278 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2d5fd-75a2-4af5-82c2-03fe3361dac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:14.300619 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2d5fd-75a2-4af5-82c2-03fe3361dac6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:14.301346 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f2d5fd-75a2-4af5-82c2-03fe3361dac6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:14.303797 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f2d5fd-75a2-4af5-82c2-03fe3361dac6 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:14.338822 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 910/1824] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:07:14 2022] POST /identity/v3/projects => generated 387 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:07:14.340693 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f2d5fd-75a2-4af5-82c2-03fe3361dac6 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:14.375692 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 915/1825] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Jun 8 12:07:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:07:14.376558 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce38e15-8b6f-4be1-86d2-4822ca5fcf36 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:14.380040 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-2ce38e15-8b6f-4be1-86d2-4822ca5fcf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:14.440835 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:14.487020 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f2d5fd-75a2-4af5-82c2-03fe3361dac6 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:14.498354 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce38e15-8b6f-4be1-86d2-4822ca5fcf36 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:14.508468 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd624450-fb91-4988-b988-3916e17db984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:14.508468 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd624450-fb91-4988-b988-3916e17db984 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:14.509873 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd624450-fb91-4988-b988-3916e17db984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:14.510177 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd624450-fb91-4988-b988-3916e17db984 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:14.510933 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd624450-fb91-4988-b988-3916e17db984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:14.517741 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd624450-fb91-4988-b988-3916e17db984 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:14.560470 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 911/1826] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:07:14.563708 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd624450-fb91-4988-b988-3916e17db984 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:14.588302 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd624450-fb91-4988-b988-3916e17db984 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:14.600149 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bfd9b3-ff0d-455d-a3c7-8fc87c295864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:14.602905 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bfd9b3-ff0d-455d-a3c7-8fc87c295864 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:14.603220 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bfd9b3-ff0d-455d-a3c7-8fc87c295864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:14.603505 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bfd9b3-ff0d-455d-a3c7-8fc87c295864 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:14.605808 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bfd9b3-ff0d-455d-a3c7-8fc87c295864 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:14.612618 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bfd9b3-ff0d-455d-a3c7-8fc87c295864 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:14.618196 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f8a6dc-b5d7-43b5-8ece-2160475b2647 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:14.619401 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8a6dc-b5d7-43b5-8ece-2160475b2647 service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:14.619401 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8a6dc-b5d7-43b5-8ece-2160475b2647 service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:14.619759 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8a6dc-b5d7-43b5-8ece-2160475b2647 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:14.640332 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f8a6dc-b5d7-43b5-8ece-2160475b2647 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:14.645286 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f8a6dc-b5d7-43b5-8ece-2160475b2647 service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:14.664577 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 912/1827] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:07:14 2022] POST /identity/v3/users => generated 300 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:07:14.665225 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bfd9b3-ff0d-455d-a3c7-8fc87c295864 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:14.669136 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-31bfd9b3-ff0d-455d-a3c7-8fc87c295864 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:14.674397 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 916/1828] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:07:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:07:14.675386 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f8a6dc-b5d7-43b5-8ece-2160475b2647 service neutron] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:14.695229 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f8a6dc-b5d7-43b5-8ece-2160475b2647 service neutron] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:14.708661 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c41fae-347c-438a-af3e-a65034c1f3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:14.709587 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c41fae-347c-438a-af3e-a65034c1f3c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:14.709993 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c41fae-347c-438a-af3e-a65034c1f3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:14.710790 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c41fae-347c-438a-af3e-a65034c1f3c8 admin admin] PATH_INFO: `/v3/projects/809798260a4f4c2daf32a002b897451e/users/a888d277382d4d78ac165147e7823736/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:14.711985 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:14.747957 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c41fae-347c-438a-af3e-a65034c1f3c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=809798260a4f4c2daf32a002b897451e, user_id=a888d277382d4d78ac165147e7823736, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:14.750799 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c41fae-347c-438a-af3e-a65034c1f3c8 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:14.779307 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bfd9b3-ff0d-455d-a3c7-8fc87c295864 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:14.782356 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 917/1829] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:07:14 2022] PUT /identity/v3/projects/809798260a4f4c2daf32a002b897451e/users/a888d277382d4d78ac165147e7823736/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:07:14.782997 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c41fae-347c-438a-af3e-a65034c1f3c8 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:14.917877 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c41fae-347c-438a-af3e-a65034c1f3c8 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:14.930251 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf61cc-58e0-4963-a797-74ef7265c3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:14.930958 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf61cc-58e0-4963-a797-74ef7265c3e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:14.931251 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf61cc-58e0-4963-a797-74ef7265c3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:14.931646 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf61cc-58e0-4963-a797-74ef7265c3e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:14.935236 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf61cc-58e0-4963-a797-74ef7265c3e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:14.937987 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf61cc-58e0-4963-a797-74ef7265c3e3 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:14.966982 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 918/1830] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:07:14.968074 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf61cc-58e0-4963-a797-74ef7265c3e3 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:14.988041 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf61cc-58e0-4963-a797-74ef7265c3e3 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:15.002130 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dfa04c-0951-49eb-be41-1ea15ca067c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:15.002287 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66f909-494c-4a1e-9716-e886f7cbb36b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef7edb5e9ce49e6b098f48bf060b228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:15.002866 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66f909-494c-4a1e-9716-e886f7cbb36b service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:15.003160 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66f909-494c-4a1e-9716-e886f7cbb36b service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:15.003445 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66f909-494c-4a1e-9716-e886f7cbb36b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:15.003545 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dfa04c-0951-49eb-be41-1ea15ca067c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:15.003822 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dfa04c-0951-49eb-be41-1ea15ca067c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:15.004109 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dfa04c-0951-49eb-be41-1ea15ca067c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:15.005019 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dfa04c-0951-49eb-be41-1ea15ca067c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:15.007003 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dfa04c-0951-49eb-be41-1ea15ca067c9 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:15.027547 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 919/1831] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:07:15.031226 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66f909-494c-4a1e-9716-e886f7cbb36b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:15.031430 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dfa04c-0951-49eb-be41-1ea15ca067c9 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:15.035311 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66f909-494c-4a1e-9716-e886f7cbb36b service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:15.060495 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dfa04c-0951-49eb-be41-1ea15ca067c9 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:15.061510 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 913/1832] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:07:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:07:15.062453 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66f909-494c-4a1e-9716-e886f7cbb36b service nova] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:15.068138 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e489209-5c6f-49e8-a7ad-2583d3f5ad83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:15.069132 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e489209-5c6f-49e8-a7ad-2583d3f5ad83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:15.069343 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e489209-5c6f-49e8-a7ad-2583d3f5ad83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:15.070154 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e489209-5c6f-49e8-a7ad-2583d3f5ad83 admin admin] PATH_INFO: `/v3/projects/ba0f24dfeee94680b7dfcec5c41e7e6c/users/880124fe02184601b764c3c8bd341358/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:15.081882 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66f909-494c-4a1e-9716-e886f7cbb36b service nova] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:15.092137 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867162ae-d9e7-4374-94bf-d53ce3c97150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:15.093635 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867162ae-d9e7-4374-94bf-d53ce3c97150 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:15.094794 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867162ae-d9e7-4374-94bf-d53ce3c97150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:15.095538 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867162ae-d9e7-4374-94bf-d53ce3c97150 admin admin] PATH_INFO: `/v3/projects/809798260a4f4c2daf32a002b897451e/users/a888d277382d4d78ac165147e7823736/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:15.101966 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867162ae-d9e7-4374-94bf-d53ce3c97150 admin admin] RBAC: Authorizing `identity:create_grant(project_id=809798260a4f4c2daf32a002b897451e, user_id=a888d277382d4d78ac165147e7823736, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:15.106581 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867162ae-d9e7-4374-94bf-d53ce3c97150 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:15.107637 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e489209-5c6f-49e8-a7ad-2583d3f5ad83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba0f24dfeee94680b7dfcec5c41e7e6c, user_id=880124fe02184601b764c3c8bd341358, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:15.115042 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e489209-5c6f-49e8-a7ad-2583d3f5ad83 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:15.154523 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 914/1833] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:07:15 2022] PUT /identity/v3/projects/809798260a4f4c2daf32a002b897451e/users/a888d277382d4d78ac165147e7823736/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:07:15.157627 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 920/1834] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:07:15 2022] PUT /identity/v3/projects/ba0f24dfeee94680b7dfcec5c41e7e6c/users/880124fe02184601b764c3c8bd341358/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:07:15.158673 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867162ae-d9e7-4374-94bf-d53ce3c97150 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:15.165472 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c26f8-04cf-40bb-9123-9363111547ad None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:15.165838 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c26f8-04cf-40bb-9123-9363111547ad None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:15.166127 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c26f8-04cf-40bb-9123-9363111547ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:15.229945 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-d27c26f8-04cf-40bb-9123-9363111547ad None None] MFA Rules not processed for user `a888d277382d4d78ac165147e7823736`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:15.231179 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-d27c26f8-04cf-40bb-9123-9363111547ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:15.247073 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:15.320304 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 921/1835] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:15 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:07:15.328772 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c26f8-04cf-40bb-9123-9363111547ad None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:15.330831 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-d27c26f8-04cf-40bb-9123-9363111547ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:15.347157 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867162ae-d9e7-4374-94bf-d53ce3c97150 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:15.409259 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c26f8-04cf-40bb-9123-9363111547ad None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:15.414831 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a946c5e-5bb4-49af-a9b2-a00e8f6f8cea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:15.415528 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a946c5e-5bb4-49af-a9b2-a00e8f6f8cea service cinder] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:15.415812 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a946c5e-5bb4-49af-a9b2-a00e8f6f8cea service cinder] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:15.416206 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a946c5e-5bb4-49af-a9b2-a00e8f6f8cea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:15.426549 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:15.428491 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a946c5e-5bb4-49af-a9b2-a00e8f6f8cea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:15.431638 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a946c5e-5bb4-49af-a9b2-a00e8f6f8cea service cinder] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:15.445806 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce94168-586c-4910-8aeb-d110db06753e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:15.447421 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce94168-586c-4910-8aeb-d110db06753e admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:15.448111 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce94168-586c-4910-8aeb-d110db06753e admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:15.449017 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce94168-586c-4910-8aeb-d110db06753e admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:15.450888 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce94168-586c-4910-8aeb-d110db06753e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:15.453498 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce94168-586c-4910-8aeb-d110db06753e admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:15.454358 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 922/1836] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:07:15 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 12:07:15.475236 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 915/1837] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:07:15.479231 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a946c5e-5bb4-49af-a9b2-a00e8f6f8cea service cinder] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:15.497803 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a946c5e-5bb4-49af-a9b2-a00e8f6f8cea service cinder] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:15.503580 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d9a63-bc0d-4ef3-ae9e-8ceb407ead31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:15.504566 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d9a63-bc0d-4ef3-ae9e-8ceb407ead31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:15.504858 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d9a63-bc0d-4ef3-ae9e-8ceb407ead31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:15.505134 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d9a63-bc0d-4ef3-ae9e-8ceb407ead31 admin admin] PATH_INFO: `/v3/projects/ba0f24dfeee94680b7dfcec5c41e7e6c/users/880124fe02184601b764c3c8bd341358/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:15.508248 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61d9a63-bc0d-4ef3-ae9e-8ceb407ead31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba0f24dfeee94680b7dfcec5c41e7e6c, user_id=880124fe02184601b764c3c8bd341358, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:15.510910 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61d9a63-bc0d-4ef3-ae9e-8ceb407ead31 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:15.528426 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 923/1838] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:07:15 2022] PUT /identity/v3/projects/ba0f24dfeee94680b7dfcec5c41e7e6c/users/880124fe02184601b764c3c8bd341358/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:07:15.539152 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac47f4f-e39c-461a-822b-5b11c09c13a0 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:15.539668 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac47f4f-e39c-461a-822b-5b11c09c13a0 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:15.539744 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac47f4f-e39c-461a-822b-5b11c09c13a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:15.571624 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-4ac47f4f-e39c-461a-822b-5b11c09c13a0 None None] MFA Rules not processed for user `880124fe02184601b764c3c8bd341358`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:15.572878 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-4ac47f4f-e39c-461a-822b-5b11c09c13a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:15.696537 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 916/1839] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:15 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:07:15.711585 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d9a63-bc0d-4ef3-ae9e-8ceb407ead31 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:15.714061 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-b61d9a63-bc0d-4ef3-ae9e-8ceb407ead31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:15.787545 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d9a63-bc0d-4ef3-ae9e-8ceb407ead31 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:15.793543 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc128f-dccc-42fa-b139-c4add5418b7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:15.794210 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc128f-dccc-42fa-b139-c4add5418b7b service cinder] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:15.794496 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc128f-dccc-42fa-b139-c4add5418b7b service cinder] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:15.794773 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc128f-dccc-42fa-b139-c4add5418b7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:15.805598 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc128f-dccc-42fa-b139-c4add5418b7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:15.807049 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc128f-dccc-42fa-b139-c4add5418b7b service cinder] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:15.817267 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 924/1840] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:07:15 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 12:07:15.848527 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac47f4f-e39c-461a-822b-5b11c09c13a0 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:15.942451 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac47f4f-e39c-461a-822b-5b11c09c13a0 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:15.949147 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17badb26-6df7-4c2a-8c01-b928f705ba79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:15.950053 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17badb26-6df7-4c2a-8c01-b928f705ba79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:15.950339 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17badb26-6df7-4c2a-8c01-b928f705ba79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:15.950618 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17badb26-6df7-4c2a-8c01-b928f705ba79 admin admin] PATH_INFO: `/v3/users/28ff1e0e9a48424eb9100e4a32991f15` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:15.951860 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17badb26-6df7-4c2a-8c01-b928f705ba79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28ff1e0e9a48424eb9100e4a32991f15)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:15.954260 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17badb26-6df7-4c2a-8c01-b928f705ba79 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:16.018057 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-17badb26-6df7-4c2a-8c01-b928f705ba79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28ff1e0e9a48424eb9100e4a32991f15'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:16.019192 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-17badb26-6df7-4c2a-8c01-b928f705ba79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28ff1e0e9a48424eb9100e4a32991f15'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:16.019961 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-17badb26-6df7-4c2a-8c01-b928f705ba79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28ff1e0e9a48424eb9100e4a32991f15'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:16.030921 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-17badb26-6df7-4c2a-8c01-b928f705ba79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28ff1e0e9a48424eb9100e4a32991f15'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:16.060230 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:16.062677 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-17badb26-6df7-4c2a-8c01-b928f705ba79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28ff1e0e9a48424eb9100e4a32991f15'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:16.094349 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 917/1841] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:07:15 2022] DELETE /identity/v3/users/28ff1e0e9a48424eb9100e4a32991f15 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:07:16.096905 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d68e59-4bce-47d4-a4f1-70f9cdf1e561 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:16.097316 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d68e59-4bce-47d4-a4f1-70f9cdf1e561 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:16.097715 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d68e59-4bce-47d4-a4f1-70f9cdf1e561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:16.121403 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-f8d68e59-4bce-47d4-a4f1-70f9cdf1e561 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:16.122832 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-f8d68e59-4bce-47d4-a4f1-70f9cdf1e561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:16.142998 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17badb26-6df7-4c2a-8c01-b928f705ba79 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:16.144648 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-17badb26-6df7-4c2a-8c01-b928f705ba79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:16.231167 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:16.267903 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17badb26-6df7-4c2a-8c01-b928f705ba79 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:16.271069 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 925/1842] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:07:16.282863 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e19323-a9e4-416e-b6c4-1ce41888b438 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:16.283803 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e19323-a9e4-416e-b6c4-1ce41888b438 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:16.284412 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e19323-a9e4-416e-b6c4-1ce41888b438 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:16.284925 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e19323-a9e4-416e-b6c4-1ce41888b438 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:16.287157 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d68e59-4bce-47d4-a4f1-70f9cdf1e561 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:16.287802 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-46e19323-a9e4-416e-b6c4-1ce41888b438 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:16.290083 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-f8d68e59-4bce-47d4-a4f1-70f9cdf1e561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:16.387255 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d68e59-4bce-47d4-a4f1-70f9cdf1e561 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:16.393094 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a71e006-373e-465a-965e-6980032aee13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:16.394052 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71e006-373e-465a-965e-6980032aee13 service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:16.395094 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71e006-373e-465a-965e-6980032aee13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:16.395933 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71e006-373e-465a-965e-6980032aee13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:16.409901 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a71e006-373e-465a-965e-6980032aee13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:16.412469 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a71e006-373e-465a-965e-6980032aee13 service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:16.428972 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 926/1843] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:07:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 12:07:16.431579 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f4ad6-fdc3-4617-af97-f4e7dc7f9ff8 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:16.432029 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f4ad6-fdc3-4617-af97-f4e7dc7f9ff8 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:16.432426 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f4ad6-fdc3-4617-af97-f4e7dc7f9ff8 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:16.434331 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 927/1844] 10.222.0.39 () {54 vars in 921 bytes} [Wed Jun 8 12:07:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:07:16.435170 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f4ad6-fdc3-4617-af97-f4e7dc7f9ff8 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:16.438434 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-1c1f4ad6-fdc3-4617-af97-f4e7dc7f9ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:16.468224 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f4ad6-fdc3-4617-af97-f4e7dc7f9ff8 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:16.476764 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e19323-a9e4-416e-b6c4-1ce41888b438 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:16.478635 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ab659-0850-41a1-8925-289804ad6226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:16.479688 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e19323-a9e4-416e-b6c4-1ce41888b438 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:16.480397 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ab659-0850-41a1-8925-289804ad6226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:16.480919 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ab659-0850-41a1-8925-289804ad6226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:16.481482 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ab659-0850-41a1-8925-289804ad6226 admin admin] PATH_INFO: `/v3/projects/46ddbf7180cb4b36b0d86b1d5c302a1d` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:16.483432 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358ab659-0850-41a1-8925-289804ad6226 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46ddbf7180cb4b36b0d86b1d5c302a1d)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:16.485821 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358ab659-0850-41a1-8925-289804ad6226 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:16.506136 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 918/1845] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:07:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:07:16.507748 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f11ae0-a349-4a1b-806d-14e3d6c099f0 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:16.508049 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f11ae0-a349-4a1b-806d-14e3d6c099f0 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:16.508363 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f11ae0-a349-4a1b-806d-14e3d6c099f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:16.555356 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-38f11ae0-a349-4a1b-806d-14e3d6c099f0 None None] MFA Rules not processed for user `7ef7edb5e9ce49e6b098f48bf060b228`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:16.561850 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-38f11ae0-a349-4a1b-806d-14e3d6c099f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:16.573679 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-358ab659-0850-41a1-8925-289804ad6226 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46ddbf7180cb4b36b0d86b1d5c302a1d', 'request_id': 'req-358ab659-0850-41a1-8925-289804ad6226'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:16.585831 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-358ab659-0850-41a1-8925-289804ad6226 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46ddbf7180cb4b36b0d86b1d5c302a1d', 'request_id': 'req-358ab659-0850-41a1-8925-289804ad6226'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:16.595223 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-358ab659-0850-41a1-8925-289804ad6226 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46ddbf7180cb4b36b0d86b1d5c302a1d', 'request_id': 'req-358ab659-0850-41a1-8925-289804ad6226'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:16.617676 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-358ab659-0850-41a1-8925-289804ad6226 admin admin] The token cache is being invalidate because project 46ddbf7180cb4b36b0d86b1d5c302a1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:07:16.618217 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-358ab659-0850-41a1-8925-289804ad6226 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:16.619390 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-358ab659-0850-41a1-8925-289804ad6226 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:16.623831 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 928/1846] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:07:16 2022] DELETE /identity/v3/projects/46ddbf7180cb4b36b0d86b1d5c302a1d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:07:16.628012 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ab659-0850-41a1-8925-289804ad6226 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:16.631957 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-358ab659-0850-41a1-8925-289804ad6226 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:16.662002 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 919/1847] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Jun 8 12:07:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:07:16.847669 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ab659-0850-41a1-8925-289804ad6226 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:16.850460 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f11ae0-a349-4a1b-806d-14e3d6c099f0 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:16.852621 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-38f11ae0-a349-4a1b-806d-14e3d6c099f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:16.853843 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98541697-74b0-4c46-a5f4-cd758c3c67a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:16.856124 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98541697-74b0-4c46-a5f4-cd758c3c67a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:16.856514 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98541697-74b0-4c46-a5f4-cd758c3c67a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:16.856811 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98541697-74b0-4c46-a5f4-cd758c3c67a7 admin admin] PATH_INFO: `/v3/users/2b156e8582804be5b89bf08dfb36dbfe` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:16.859594 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98541697-74b0-4c46-a5f4-cd758c3c67a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b156e8582804be5b89bf08dfb36dbfe)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:16.862073 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98541697-74b0-4c46-a5f4-cd758c3c67a7 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:16.897608 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:16.925429 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f11ae0-a349-4a1b-806d-14e3d6c099f0 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:16.938332 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab73a899-ac8d-4b9d-bbd1-7a03787a7aeb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef7edb5e9ce49e6b098f48bf060b228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:16.939755 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab73a899-ac8d-4b9d-bbd1-7a03787a7aeb service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:16.941998 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab73a899-ac8d-4b9d-bbd1-7a03787a7aeb service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:16.943803 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab73a899-ac8d-4b9d-bbd1-7a03787a7aeb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:16.970140 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab73a899-ac8d-4b9d-bbd1-7a03787a7aeb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:16.973126 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab73a899-ac8d-4b9d-bbd1-7a03787a7aeb service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:17.014832 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 920/1848] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:07:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:07:17.060426 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-98541697-74b0-4c46-a5f4-cd758c3c67a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b156e8582804be5b89bf08dfb36dbfe'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:17.083344 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-98541697-74b0-4c46-a5f4-cd758c3c67a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b156e8582804be5b89bf08dfb36dbfe'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:17.084103 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-98541697-74b0-4c46-a5f4-cd758c3c67a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b156e8582804be5b89bf08dfb36dbfe'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:17.084759 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-98541697-74b0-4c46-a5f4-cd758c3c67a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b156e8582804be5b89bf08dfb36dbfe'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:17.110387 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-98541697-74b0-4c46-a5f4-cd758c3c67a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b156e8582804be5b89bf08dfb36dbfe'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:17.139672 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 929/1849] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:07:16 2022] DELETE /identity/v3/users/2b156e8582804be5b89bf08dfb36dbfe => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:07:17.281063 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab73a899-ac8d-4b9d-bbd1-7a03787a7aeb service nova] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:17.282676 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ab73a899-ac8d-4b9d-bbd1-7a03787a7aeb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:17.304927 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab73a899-ac8d-4b9d-bbd1-7a03787a7aeb service nova] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:17.325246 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:17.374838 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee1d6e-d274-471a-a2e2-518a7f76c341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:17.375912 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee1d6e-d274-471a-a2e2-518a7f76c341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:17.376228 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee1d6e-d274-471a-a2e2-518a7f76c341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:17.376505 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee1d6e-d274-471a-a2e2-518a7f76c341 admin admin] PATH_INFO: `/v3/projects/a0454e1e8d284fe28a82b162ae0cd7c9` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:17.377712 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee1d6e-d274-471a-a2e2-518a7f76c341 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0454e1e8d284fe28a82b162ae0cd7c9)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:17.379603 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee1d6e-d274-471a-a2e2-518a7f76c341 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:17.436483 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-acee1d6e-d274-471a-a2e2-518a7f76c341 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0454e1e8d284fe28a82b162ae0cd7c9', 'request_id': 'req-acee1d6e-d274-471a-a2e2-518a7f76c341'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:17.444148 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-acee1d6e-d274-471a-a2e2-518a7f76c341 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0454e1e8d284fe28a82b162ae0cd7c9', 'request_id': 'req-acee1d6e-d274-471a-a2e2-518a7f76c341'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:17.450108 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-acee1d6e-d274-471a-a2e2-518a7f76c341 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0454e1e8d284fe28a82b162ae0cd7c9', 'request_id': 'req-acee1d6e-d274-471a-a2e2-518a7f76c341'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:17.462200 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-acee1d6e-d274-471a-a2e2-518a7f76c341 admin admin] The token cache is being invalidate because project a0454e1e8d284fe28a82b162ae0cd7c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:07:17.462567 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-acee1d6e-d274-471a-a2e2-518a7f76c341 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:17.463276 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-acee1d6e-d274-471a-a2e2-518a7f76c341 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:17.465255 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 921/1850] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:07:17 2022] DELETE /identity/v3/projects/a0454e1e8d284fe28a82b162ae0cd7c9 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:07:17.470055 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98541697-74b0-4c46-a5f4-cd758c3c67a7 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:17.471801 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-98541697-74b0-4c46-a5f4-cd758c3c67a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:17.485676 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98541697-74b0-4c46-a5f4-cd758c3c67a7 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:17.548541 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd4e43-9587-444c-b1b4-f389ca530392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:17.549370 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd4e43-9587-444c-b1b4-f389ca530392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:17.549652 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd4e43-9587-444c-b1b4-f389ca530392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:17.549924 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd4e43-9587-444c-b1b4-f389ca530392 admin admin] PATH_INFO: `/v3/users/880124fe02184601b764c3c8bd341358` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:17.551156 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbd4e43-9587-444c-b1b4-f389ca530392 admin admin] RBAC: Authorizing `identity:delete_user(user_id=880124fe02184601b764c3c8bd341358)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:17.553272 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbd4e43-9587-444c-b1b4-f389ca530392 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:17.611684 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-bfbd4e43-9587-444c-b1b4-f389ca530392 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '880124fe02184601b764c3c8bd341358'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:17.621749 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-bfbd4e43-9587-444c-b1b4-f389ca530392 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '880124fe02184601b764c3c8bd341358'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:17.622627 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-bfbd4e43-9587-444c-b1b4-f389ca530392 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '880124fe02184601b764c3c8bd341358'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:17.623235 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-bfbd4e43-9587-444c-b1b4-f389ca530392 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '880124fe02184601b764c3c8bd341358'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:17.636206 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-bfbd4e43-9587-444c-b1b4-f389ca530392 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '880124fe02184601b764c3c8bd341358'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:17.656486 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 930/1851] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:07:17 2022] DELETE /identity/v3/users/880124fe02184601b764c3c8bd341358 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:07:18.457401 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee1d6e-d274-471a-a2e2-518a7f76c341 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:18.459673 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-acee1d6e-d274-471a-a2e2-518a7f76c341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:18.481828 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee1d6e-d274-471a-a2e2-518a7f76c341 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:18.611305 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473eea3a-0420-4972-b9c4-3f25a7b29084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:18.612614 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473eea3a-0420-4972-b9c4-3f25a7b29084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:18.613530 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473eea3a-0420-4972-b9c4-3f25a7b29084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:18.614157 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473eea3a-0420-4972-b9c4-3f25a7b29084 admin admin] PATH_INFO: `/v3/projects/3d1de6a9145f4ce1a63020a3713ed137` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:18.616298 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473eea3a-0420-4972-b9c4-3f25a7b29084 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d1de6a9145f4ce1a63020a3713ed137)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:18.619568 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473eea3a-0420-4972-b9c4-3f25a7b29084 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:18.733809 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-473eea3a-0420-4972-b9c4-3f25a7b29084 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d1de6a9145f4ce1a63020a3713ed137', 'request_id': 'req-473eea3a-0420-4972-b9c4-3f25a7b29084'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:18.736662 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:18.760591 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-473eea3a-0420-4972-b9c4-3f25a7b29084 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d1de6a9145f4ce1a63020a3713ed137', 'request_id': 'req-473eea3a-0420-4972-b9c4-3f25a7b29084'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:18.770368 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-473eea3a-0420-4972-b9c4-3f25a7b29084 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d1de6a9145f4ce1a63020a3713ed137', 'request_id': 'req-473eea3a-0420-4972-b9c4-3f25a7b29084'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:18.782733 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-473eea3a-0420-4972-b9c4-3f25a7b29084 admin admin] The token cache is being invalidate because project 3d1de6a9145f4ce1a63020a3713ed137 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:07:18.783027 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-473eea3a-0420-4972-b9c4-3f25a7b29084 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:18.783689 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-473eea3a-0420-4972-b9c4-3f25a7b29084 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:18.785561 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 922/1852] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:07:18 2022] DELETE /identity/v3/projects/3d1de6a9145f4ce1a63020a3713ed137 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:07:18.792083 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58117075-6b00-4dd2-b877-d1b9a0b2e940 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:18.792772 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58117075-6b00-4dd2-b877-d1b9a0b2e940 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:18.793278 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58117075-6b00-4dd2-b877-d1b9a0b2e940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:18.831708 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-58117075-6b00-4dd2-b877-d1b9a0b2e940 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:18.833626 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-58117075-6b00-4dd2-b877-d1b9a0b2e940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:18.840403 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:18.874452 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473eea3a-0420-4972-b9c4-3f25a7b29084 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:18.877879 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-473eea3a-0420-4972-b9c4-3f25a7b29084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:18.958970 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473eea3a-0420-4972-b9c4-3f25a7b29084 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:18.968692 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 931/1853] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:07:18.971819 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85880248-8f81-4829-9942-e8441496df26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:18.972747 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85880248-8f81-4829-9942-e8441496df26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:18.973030 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85880248-8f81-4829-9942-e8441496df26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:18.973305 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85880248-8f81-4829-9942-e8441496df26 admin admin] PATH_INFO: `/v3/projects/ba0f24dfeee94680b7dfcec5c41e7e6c` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:18.974520 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85880248-8f81-4829-9942-e8441496df26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba0f24dfeee94680b7dfcec5c41e7e6c)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:18.976873 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85880248-8f81-4829-9942-e8441496df26 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:18.978097 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca8c27-cc0d-45d0-bf88-c047aac485de None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:18.978527 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca8c27-cc0d-45d0-bf88-c047aac485de None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:18.978820 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca8c27-cc0d-45d0-bf88-c047aac485de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:19.015368 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-edca8c27-cc0d-45d0-bf88-c047aac485de None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:19.016627 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-edca8c27-cc0d-45d0-bf88-c047aac485de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:19.036222 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-85880248-8f81-4829-9942-e8441496df26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba0f24dfeee94680b7dfcec5c41e7e6c', 'request_id': 'req-85880248-8f81-4829-9942-e8441496df26'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:19.045515 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-85880248-8f81-4829-9942-e8441496df26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba0f24dfeee94680b7dfcec5c41e7e6c', 'request_id': 'req-85880248-8f81-4829-9942-e8441496df26'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:19.052666 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-85880248-8f81-4829-9942-e8441496df26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba0f24dfeee94680b7dfcec5c41e7e6c', 'request_id': 'req-85880248-8f81-4829-9942-e8441496df26'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:19.067676 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-85880248-8f81-4829-9942-e8441496df26 admin admin] The token cache is being invalidate because project ba0f24dfeee94680b7dfcec5c41e7e6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:07:19.067967 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-85880248-8f81-4829-9942-e8441496df26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:19.068668 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-85880248-8f81-4829-9942-e8441496df26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:19.070885 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 923/1854] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:07:18 2022] DELETE /identity/v3/projects/ba0f24dfeee94680b7dfcec5c41e7e6c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:07:19.077699 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f943a8f-1d95-4d94-a4d9-9e434e91084a None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:19.077997 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f943a8f-1d95-4d94-a4d9-9e434e91084a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:19.078272 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f943a8f-1d95-4d94-a4d9-9e434e91084a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:19.097981 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-4f943a8f-1d95-4d94-a4d9-9e434e91084a None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:19.099109 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-4f943a8f-1d95-4d94-a4d9-9e434e91084a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:19.103729 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 932/1855] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:07:19.107790 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 924/1856] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:07:19.110984 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca8c27-cc0d-45d0-bf88-c047aac485de None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:19.114928 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94456f34-a668-4e40-a8d1-05aefc5ee837 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:19.115259 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94456f34-a668-4e40-a8d1-05aefc5ee837 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:19.115541 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94456f34-a668-4e40-a8d1-05aefc5ee837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:19.120861 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca8c27-cc0d-45d0-bf88-c047aac485de None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:19.125604 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5133841-9e00-4c89-9050-5c2af0b8d825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:19.126262 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5133841-9e00-4c89-9050-5c2af0b8d825 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:19.126635 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5133841-9e00-4c89-9050-5c2af0b8d825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:19.126822 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5133841-9e00-4c89-9050-5c2af0b8d825 admin admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:19.127544 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5133841-9e00-4c89-9050-5c2af0b8d825 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:07:19.127855 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5133841-9e00-4c89-9050-5c2af0b8d825 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:19.129496 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5133841-9e00-4c89-9050-5c2af0b8d825 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:19.134593 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-94456f34-a668-4e40-a8d1-05aefc5ee837 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:19.135781 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-94456f34-a668-4e40-a8d1-05aefc5ee837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:19.144251 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 925/1857] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:07:19.147845 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 933/1858] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:07:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:07:19.149041 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5133841-9e00-4c89-9050-5c2af0b8d825 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:19.150339 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94456f34-a668-4e40-a8d1-05aefc5ee837 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:19.160617 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94456f34-a668-4e40-a8d1-05aefc5ee837 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:19.163651 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5133841-9e00-4c89-9050-5c2af0b8d825 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:19.166774 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b9f271-8e4b-4318-b0be-ccc227e7c483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:19.167455 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9f271-8e4b-4318-b0be-ccc227e7c483 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:19.167725 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9f271-8e4b-4318-b0be-ccc227e7c483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:19.168002 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9f271-8e4b-4318-b0be-ccc227e7c483 admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:19.168906 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570d666-d688-499f-8062-0256b782deaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:19.169163 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b9f271-8e4b-4318-b0be-ccc227e7c483 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:07:19.169479 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b9f271-8e4b-4318-b0be-ccc227e7c483 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:19.169566 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570d666-d688-499f-8062-0256b782deaa admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:19.169842 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570d666-d688-499f-8062-0256b782deaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:19.170122 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570d666-d688-499f-8062-0256b782deaa admin admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:19.170832 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7570d666-d688-499f-8062-0256b782deaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:19.171120 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b9f271-8e4b-4318-b0be-ccc227e7c483 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:19.172756 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7570d666-d688-499f-8062-0256b782deaa admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:19.185710 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 926/1859] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:07:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:07:19.189146 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b9f271-8e4b-4318-b0be-ccc227e7c483 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:19.201851 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b9f271-8e4b-4318-b0be-ccc227e7c483 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:19.206419 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 934/1860] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:07:19 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:07:19.210303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570d666-d688-499f-8062-0256b782deaa admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:19.214695 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7957aed7-3182-4024-9d6e-fcc3be911acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:19.215378 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957aed7-3182-4024-9d6e-fcc3be911acc admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:19.215663 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957aed7-3182-4024-9d6e-fcc3be911acc admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:19.215964 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957aed7-3182-4024-9d6e-fcc3be911acc admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:19.216701 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7957aed7-3182-4024-9d6e-fcc3be911acc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:19.218610 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7957aed7-3182-4024-9d6e-fcc3be911acc admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:19.259823 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 927/1861] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:07:19 2022] POST /identity/v3/projects => generated 383 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:07:19.264913 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7957aed7-3182-4024-9d6e-fcc3be911acc admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:19.302120 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:19.340558 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570d666-d688-499f-8062-0256b782deaa admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:19.384045 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:19.397983 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7957aed7-3182-4024-9d6e-fcc3be911acc admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:19.413143 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee041f-83ff-4499-bdf0-bf7780923738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:19.414377 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee041f-83ff-4499-bdf0-bf7780923738 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:19.414684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee041f-83ff-4499-bdf0-bf7780923738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:19.415031 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee041f-83ff-4499-bdf0-bf7780923738 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:19.415659 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee041f-83ff-4499-bdf0-bf7780923738 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:19.417730 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee041f-83ff-4499-bdf0-bf7780923738 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:19.450787 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8328e4-007c-4b1c-80a5-b07abf4b2432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:19.451980 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8328e4-007c-4b1c-80a5-b07abf4b2432 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:19.452424 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8328e4-007c-4b1c-80a5-b07abf4b2432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:19.452924 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8328e4-007c-4b1c-80a5-b07abf4b2432 admin admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:19.454245 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8328e4-007c-4b1c-80a5-b07abf4b2432 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:19.456808 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8328e4-007c-4b1c-80a5-b07abf4b2432 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:19.464062 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 928/1862] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:07:19 2022] POST /identity/v3/users => generated 292 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:07:19.470289 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee041f-83ff-4499-bdf0-bf7780923738 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:19.499222 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 935/1863] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:07:19 2022] POST /identity/v3/users => generated 287 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 12:07:19.500875 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8328e4-007c-4b1c-80a5-b07abf4b2432 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:19.501307 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee041f-83ff-4499-bdf0-bf7780923738 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:19.510034 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a189d3-70e1-4f53-988a-1c402c9a167b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:19.510733 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a189d3-70e1-4f53-988a-1c402c9a167b admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:19.511017 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a189d3-70e1-4f53-988a-1c402c9a167b admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:19.511290 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a189d3-70e1-4f53-988a-1c402c9a167b admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:19.512268 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a189d3-70e1-4f53-988a-1c402c9a167b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:19.514930 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a189d3-70e1-4f53-988a-1c402c9a167b admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:19.516323 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8328e4-007c-4b1c-80a5-b07abf4b2432 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:19.525219 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba01e5da-0b1b-4213-97d0-c452ef954d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:19.526285 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01e5da-0b1b-4213-97d0-c452ef954d71 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:19.526774 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01e5da-0b1b-4213-97d0-c452ef954d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:19.527252 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01e5da-0b1b-4213-97d0-c452ef954d71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:19.528084 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 929/1864] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:07:19.528435 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba01e5da-0b1b-4213-97d0-c452ef954d71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:19.530231 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba01e5da-0b1b-4213-97d0-c452ef954d71 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:19.531521 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a189d3-70e1-4f53-988a-1c402c9a167b admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:19.543134 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 936/1865] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:07:19.544052 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a189d3-70e1-4f53-988a-1c402c9a167b admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:19.547188 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba01e5da-0b1b-4213-97d0-c452ef954d71 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:19.551808 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f631a0-015b-4a9c-832e-43d118ac640e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:19.552199 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f631a0-015b-4a9c-832e-43d118ac640e admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:19.552505 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f631a0-015b-4a9c-832e-43d118ac640e admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:19.552783 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f631a0-015b-4a9c-832e-43d118ac640e admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:19.553664 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f631a0-015b-4a9c-832e-43d118ac640e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:19.556787 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f631a0-015b-4a9c-832e-43d118ac640e admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:19.577024 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 930/1866] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 12:07:19.588661 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba01e5da-0b1b-4213-97d0-c452ef954d71 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:19.593117 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f631a0-015b-4a9c-832e-43d118ac640e admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:19.594509 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc33a6-2781-4d07-ab41-719922f67d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:19.595427 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc33a6-2781-4d07-ab41-719922f67d98 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:19.595789 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc33a6-2781-4d07-ab41-719922f67d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:19.596330 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc33a6-2781-4d07-ab41-719922f67d98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:19.597140 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cc33a6-2781-4d07-ab41-719922f67d98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:19.598831 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cc33a6-2781-4d07-ab41-719922f67d98 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:19.615857 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f631a0-015b-4a9c-832e-43d118ac640e admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:19.618433 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 937/1867] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 12:07:19.621881 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc33a6-2781-4d07-ab41-719922f67d98 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:19.628917 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f101a9d7-e179-4dd5-aeb0-7f0d7d3225c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:19.631641 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101a9d7-e179-4dd5-aeb0-7f0d7d3225c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:19.633523 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101a9d7-e179-4dd5-aeb0-7f0d7d3225c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:19.634073 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101a9d7-e179-4dd5-aeb0-7f0d7d3225c5 admin admin] PATH_INFO: `/v3/projects/3d7433abba484c0b87da4d93f5a57724/users/a863f31c8aa34ba49f84cdacf39af095/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:19.640788 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc33a6-2781-4d07-ab41-719922f67d98 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:19.646733 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea193e-2e6c-4fa1-8e70-5277fd21ae51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:19.648621 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea193e-2e6c-4fa1-8e70-5277fd21ae51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:19.649444 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea193e-2e6c-4fa1-8e70-5277fd21ae51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:19.649894 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea193e-2e6c-4fa1-8e70-5277fd21ae51 admin admin] PATH_INFO: `/v3/projects/d96b43984a604e979559bc32b5a439ac/users/189a967938c546d6a82c45f4e374ac69/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:19.654374 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f101a9d7-e179-4dd5-aeb0-7f0d7d3225c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d7433abba484c0b87da4d93f5a57724, user_id=a863f31c8aa34ba49f84cdacf39af095, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:19.658588 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f101a9d7-e179-4dd5-aeb0-7f0d7d3225c5 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:19.683190 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dea193e-2e6c-4fa1-8e70-5277fd21ae51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d96b43984a604e979559bc32b5a439ac, user_id=189a967938c546d6a82c45f4e374ac69, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:19.683740 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 931/1868] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:07:19 2022] PUT /identity/v3/projects/3d7433abba484c0b87da4d93f5a57724/users/a863f31c8aa34ba49f84cdacf39af095/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:07:19.697921 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dea193e-2e6c-4fa1-8e70-5277fd21ae51 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:19.699943 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1ef3e-908c-4b29-8afc-4c1d5799c7d8 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:19.700378 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1ef3e-908c-4b29-8afc-4c1d5799c7d8 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:19.700764 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1ef3e-908c-4b29-8afc-4c1d5799c7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:19.720949 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 938/1869] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:07:19 2022] PUT /identity/v3/projects/d96b43984a604e979559bc32b5a439ac/users/189a967938c546d6a82c45f4e374ac69/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:07:19.731958 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c01f4-ecb4-41ed-a015-a839b689b9a2 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:19.732281 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c01f4-ecb4-41ed-a015-a839b689b9a2 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:19.734195 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c01f4-ecb4-41ed-a015-a839b689b9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:19.755151 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-1bc1ef3e-908c-4b29-8afc-4c1d5799c7d8 None None] MFA Rules not processed for user `a863f31c8aa34ba49f84cdacf39af095`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:19.756705 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-1bc1ef3e-908c-4b29-8afc-4c1d5799c7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:19.777683 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-4c5c01f4-ecb4-41ed-a015-a839b689b9a2 None None] MFA Rules not processed for user `189a967938c546d6a82c45f4e374ac69`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:19.779150 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-4c5c01f4-ecb4-41ed-a015-a839b689b9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:19.903792 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 939/1870] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:07:19.913134 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 932/1871] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:07:19.922918 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c01f4-ecb4-41ed-a015-a839b689b9a2 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:19.925339 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc1ef3e-908c-4b29-8afc-4c1d5799c7d8 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:19.928455 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-4c5c01f4-ecb4-41ed-a015-a839b689b9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:20.041958 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:20.070137 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c01f4-ecb4-41ed-a015-a839b689b9a2 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:20.072641 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc1ef3e-908c-4b29-8afc-4c1d5799c7d8 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:20.076420 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43797489-ce6b-4b65-b871-6b9dae3d0a11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:20.077102 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43797489-ce6b-4b65-b871-6b9dae3d0a11 service cinder] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:20.077577 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43797489-ce6b-4b65-b871-6b9dae3d0a11 service cinder] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:20.077869 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43797489-ce6b-4b65-b871-6b9dae3d0a11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:20.084691 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448410ab-c731-4a7c-89df-0dcd2f66f726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:20.085569 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448410ab-c731-4a7c-89df-0dcd2f66f726 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:20.085919 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448410ab-c731-4a7c-89df-0dcd2f66f726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:20.086230 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448410ab-c731-4a7c-89df-0dcd2f66f726 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:20.087252 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448410ab-c731-4a7c-89df-0dcd2f66f726 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:20.089235 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448410ab-c731-4a7c-89df-0dcd2f66f726 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:20.090539 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43797489-ce6b-4b65-b871-6b9dae3d0a11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:20.092367 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43797489-ce6b-4b65-b871-6b9dae3d0a11 service cinder] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:20.097533 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:20.107071 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 940/1872] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:07:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:07:20.131892 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43797489-ce6b-4b65-b871-6b9dae3d0a11 service cinder] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:20.159315 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43797489-ce6b-4b65-b871-6b9dae3d0a11 service cinder] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:20.169320 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd3238-990f-4de2-810f-85f0021d09fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:20.170807 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd3238-990f-4de2-810f-85f0021d09fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:20.171307 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd3238-990f-4de2-810f-85f0021d09fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:20.172023 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd3238-990f-4de2-810f-85f0021d09fa admin admin] PATH_INFO: `/v3/users/189a967938c546d6a82c45f4e374ac69` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:20.174154 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd3238-990f-4de2-810f-85f0021d09fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=189a967938c546d6a82c45f4e374ac69)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:20.176465 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd3238-990f-4de2-810f-85f0021d09fa admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:20.198163 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 933/1873] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:07:19 2022] POST /identity/v3/projects => generated 381 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:07:20.203830 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448410ab-c731-4a7c-89df-0dcd2f66f726 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:20.268085 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-1dbd3238-990f-4de2-810f-85f0021d09fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '189a967938c546d6a82c45f4e374ac69'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:20.282012 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-1dbd3238-990f-4de2-810f-85f0021d09fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '189a967938c546d6a82c45f4e374ac69'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:20.282990 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-1dbd3238-990f-4de2-810f-85f0021d09fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '189a967938c546d6a82c45f4e374ac69'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:20.284188 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-1dbd3238-990f-4de2-810f-85f0021d09fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '189a967938c546d6a82c45f4e374ac69'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:20.304326 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-1dbd3238-990f-4de2-810f-85f0021d09fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '189a967938c546d6a82c45f4e374ac69'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:20.333430 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 941/1874] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:07:20 2022] DELETE /identity/v3/users/189a967938c546d6a82c45f4e374ac69 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:07:20.342726 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4e3c9-f889-4c36-a2b6-fcded4a13b25 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:20.343021 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4e3c9-f889-4c36-a2b6-fcded4a13b25 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:20.343310 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4e3c9-f889-4c36-a2b6-fcded4a13b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:20.374898 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448410ab-c731-4a7c-89df-0dcd2f66f726 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:20.382947 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-3eb4e3c9-f889-4c36-a2b6-fcded4a13b25 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:20.384677 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-3eb4e3c9-f889-4c36-a2b6-fcded4a13b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:20.449756 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f76190d-753d-4240-8cdc-58c0ec08241c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:20.450647 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76190d-753d-4240-8cdc-58c0ec08241c admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:20.451146 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76190d-753d-4240-8cdc-58c0ec08241c admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:20.451540 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76190d-753d-4240-8cdc-58c0ec08241c admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:20.452337 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f76190d-753d-4240-8cdc-58c0ec08241c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:20.454508 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f76190d-753d-4240-8cdc-58c0ec08241c admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:20.479870 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 934/1875] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:07:20 2022] POST /identity/v3/users => generated 297 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:07:20.484067 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f76190d-753d-4240-8cdc-58c0ec08241c admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:20.486911 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-7f76190d-753d-4240-8cdc-58c0ec08241c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:20.487622 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 942/1876] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:07:20.498695 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb4e3c9-f889-4c36-a2b6-fcded4a13b25 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:20.499966 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-3eb4e3c9-f889-4c36-a2b6-fcded4a13b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:20.506528 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f76190d-753d-4240-8cdc-58c0ec08241c admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:20.517837 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c2a566-248b-4a4c-a266-15f95dbd0c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:20.519192 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2a566-248b-4a4c-a266-15f95dbd0c0d admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:20.519483 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2a566-248b-4a4c-a266-15f95dbd0c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:20.519918 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2a566-248b-4a4c-a266-15f95dbd0c0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:20.520734 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c2a566-248b-4a4c-a266-15f95dbd0c0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:20.522738 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c2a566-248b-4a4c-a266-15f95dbd0c0d admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:20.544550 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 935/1877] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 12:07:20.548340 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c2a566-248b-4a4c-a266-15f95dbd0c0d admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:20.560403 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c2a566-248b-4a4c-a266-15f95dbd0c0d admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:20.569320 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790790a8-ed64-4c72-9f32-aa955cdaee00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:20.571455 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790790a8-ed64-4c72-9f32-aa955cdaee00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:20.571972 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790790a8-ed64-4c72-9f32-aa955cdaee00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:20.572487 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790790a8-ed64-4c72-9f32-aa955cdaee00 admin admin] PATH_INFO: `/v3/projects/09aae0e5e32c427a8a3ae24e175faeb6/users/b4ebcfa6df1b4ba6ac76e5bc502e6244/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:20.582598 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb4e3c9-f889-4c36-a2b6-fcded4a13b25 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:20.590726 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790790a8-ed64-4c72-9f32-aa955cdaee00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09aae0e5e32c427a8a3ae24e175faeb6, user_id=b4ebcfa6df1b4ba6ac76e5bc502e6244, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:20.594564 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790790a8-ed64-4c72-9f32-aa955cdaee00 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:20.594713 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39cce0-0910-49c5-b085-8c4f5cdf8414 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:20.595567 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39cce0-0910-49c5-b085-8c4f5cdf8414 service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:20.596380 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39cce0-0910-49c5-b085-8c4f5cdf8414 service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:20.596835 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39cce0-0910-49c5-b085-8c4f5cdf8414 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:20.610844 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d39cce0-0910-49c5-b085-8c4f5cdf8414 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:20.612518 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d39cce0-0910-49c5-b085-8c4f5cdf8414 service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:20.615800 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 936/1878] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:07:20 2022] PUT /identity/v3/projects/09aae0e5e32c427a8a3ae24e175faeb6/users/b4ebcfa6df1b4ba6ac76e5bc502e6244/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:07:20.621895 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790790a8-ed64-4c72-9f32-aa955cdaee00 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:20.624391 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 943/1879] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:07:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:07:20.673718 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:20.698620 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790790a8-ed64-4c72-9f32-aa955cdaee00 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:20.704351 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69913d41-59a1-4202-bf51-f487bf52ab26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:20.705044 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69913d41-59a1-4202-bf51-f487bf52ab26 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:20.705332 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69913d41-59a1-4202-bf51-f487bf52ab26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:20.705754 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69913d41-59a1-4202-bf51-f487bf52ab26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:20.706494 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69913d41-59a1-4202-bf51-f487bf52ab26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:20.708339 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69913d41-59a1-4202-bf51-f487bf52ab26 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:20.727548 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 937/1880] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:07:20.731960 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39cce0-0910-49c5-b085-8c4f5cdf8414 service neutron] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:20.743894 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39cce0-0910-49c5-b085-8c4f5cdf8414 service neutron] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:20.749986 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a704fb-90f7-440d-964f-7f603b941163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:20.750931 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a704fb-90f7-440d-964f-7f603b941163 admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:20.751228 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a704fb-90f7-440d-964f-7f603b941163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:20.752552 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a704fb-90f7-440d-964f-7f603b941163 admin admin] PATH_INFO: `/v3/projects/09aae0e5e32c427a8a3ae24e175faeb6/users/b4ebcfa6df1b4ba6ac76e5bc502e6244/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:20.755269 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a704fb-90f7-440d-964f-7f603b941163 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09aae0e5e32c427a8a3ae24e175faeb6, user_id=b4ebcfa6df1b4ba6ac76e5bc502e6244, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:20.758464 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a704fb-90f7-440d-964f-7f603b941163 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:20.768338 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:20.772322 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 944/1881] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:07:20 2022] PUT /identity/v3/projects/09aae0e5e32c427a8a3ae24e175faeb6/users/b4ebcfa6df1b4ba6ac76e5bc502e6244/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:07:20.783876 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a33cf-a80b-4dd5-b1dc-24786c6ac38e None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:20.784410 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a33cf-a80b-4dd5-b1dc-24786c6ac38e None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:20.784957 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a33cf-a80b-4dd5-b1dc-24786c6ac38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:20.825967 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-8c8a33cf-a80b-4dd5-b1dc-24786c6ac38e None None] MFA Rules not processed for user `b4ebcfa6df1b4ba6ac76e5bc502e6244`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:20.827694 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-8c8a33cf-a80b-4dd5-b1dc-24786c6ac38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:20.940336 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 938/1882] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:20 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:07:20.950186 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a704fb-90f7-440d-964f-7f603b941163 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:20.952006 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-07a704fb-90f7-440d-964f-7f603b941163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:21.045275 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a704fb-90f7-440d-964f-7f603b941163 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:21.050628 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932d75a-1e9c-4bb3-a762-53f52129d9aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:21.051313 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932d75a-1e9c-4bb3-a762-53f52129d9aa service cinder] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:21.051602 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932d75a-1e9c-4bb3-a762-53f52129d9aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:21.051881 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932d75a-1e9c-4bb3-a762-53f52129d9aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:21.063750 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a33cf-a80b-4dd5-b1dc-24786c6ac38e None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:21.065688 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-8c8a33cf-a80b-4dd5-b1dc-24786c6ac38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:21.081242 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0932d75a-1e9c-4bb3-a762-53f52129d9aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:21.082957 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0932d75a-1e9c-4bb3-a762-53f52129d9aa service cinder] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:21.109722 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 945/1883] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:07:20 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:07:21.217300 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a33cf-a80b-4dd5-b1dc-24786c6ac38e None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:21.224031 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5bcb5-7cd1-4592-af93-b242b053fe5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:21.225009 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5bcb5-7cd1-4592-af93-b242b053fe5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:21.225299 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5bcb5-7cd1-4592-af93-b242b053fe5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:21.225577 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5bcb5-7cd1-4592-af93-b242b053fe5f admin admin] PATH_INFO: `/v3/projects/d96b43984a604e979559bc32b5a439ac` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:21.227302 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa5bcb5-7cd1-4592-af93-b242b053fe5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d96b43984a604e979559bc32b5a439ac)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:21.229868 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa5bcb5-7cd1-4592-af93-b242b053fe5f admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:21.243749 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932d75a-1e9c-4bb3-a762-53f52129d9aa service cinder] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:21.253745 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932d75a-1e9c-4bb3-a762-53f52129d9aa service cinder] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:21.258789 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c5cb6-8b45-4867-bf84-5b37af649dd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:21.259410 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c5cb6-8b45-4867-bf84-5b37af649dd4 service cinder] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:21.259764 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c5cb6-8b45-4867-bf84-5b37af649dd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:21.260136 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c5cb6-8b45-4867-bf84-5b37af649dd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:21.262329 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-422c5cb6-8b45-4867-bf84-5b37af649dd4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:21.306845 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-8aa5bcb5-7cd1-4592-af93-b242b053fe5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd96b43984a604e979559bc32b5a439ac', 'request_id': 'req-8aa5bcb5-7cd1-4592-af93-b242b053fe5f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:21.318326 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-8aa5bcb5-7cd1-4592-af93-b242b053fe5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd96b43984a604e979559bc32b5a439ac', 'request_id': 'req-8aa5bcb5-7cd1-4592-af93-b242b053fe5f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:21.333509 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-8aa5bcb5-7cd1-4592-af93-b242b053fe5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd96b43984a604e979559bc32b5a439ac', 'request_id': 'req-8aa5bcb5-7cd1-4592-af93-b242b053fe5f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:21.335742 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:21.360693 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-8aa5bcb5-7cd1-4592-af93-b242b053fe5f admin admin] The token cache is being invalidate because project d96b43984a604e979559bc32b5a439ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:07:21.360693 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-8aa5bcb5-7cd1-4592-af93-b242b053fe5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:21.360693 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-8aa5bcb5-7cd1-4592-af93-b242b053fe5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:21.360693 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 939/1884] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:07:21 2022] DELETE /identity/v3/projects/d96b43984a604e979559bc32b5a439ac => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:07:21.360693 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26340f-26f7-4cbb-a610-06a734df5427 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:21.361298 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26340f-26f7-4cbb-a610-06a734df5427 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:21.361298 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26340f-26f7-4cbb-a610-06a734df5427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:21.387665 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-ed26340f-26f7-4cbb-a610-06a734df5427 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:21.389187 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ed26340f-26f7-4cbb-a610-06a734df5427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:21.404901 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422c5cb6-8b45-4867-bf84-5b37af649dd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:21.406754 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422c5cb6-8b45-4867-bf84-5b37af649dd4 service cinder] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:21.436908 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 946/1885] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:07:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:07:21.470991 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 940/1886] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:07:21.478931 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6567d-1438-441b-b41b-cae3cb581684 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:21.479224 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6567d-1438-441b-b41b-cae3cb581684 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:21.479760 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6567d-1438-441b-b41b-cae3cb581684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:21.513971 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-7db6567d-1438-441b-b41b-cae3cb581684 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:21.515247 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-7db6567d-1438-441b-b41b-cae3cb581684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:21.537056 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 947/1887] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:07:21.541932 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed26340f-26f7-4cbb-a610-06a734df5427 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:21.563909 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed26340f-26f7-4cbb-a610-06a734df5427 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:21.569207 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c61b56-b57b-478f-9892-29d3bb0c88d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:21.572008 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c61b56-b57b-478f-9892-29d3bb0c88d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:21.572331 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c61b56-b57b-478f-9892-29d3bb0c88d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:21.572612 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c61b56-b57b-478f-9892-29d3bb0c88d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:21.574693 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c61b56-b57b-478f-9892-29d3bb0c88d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:07:21.575010 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c61b56-b57b-478f-9892-29d3bb0c88d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:21.580788 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c61b56-b57b-478f-9892-29d3bb0c88d3 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:21.610949 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 941/1888] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:07:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:07:21.615961 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db6567d-1438-441b-b41b-cae3cb581684 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:21.630741 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db6567d-1438-441b-b41b-cae3cb581684 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:21.643523 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2972e-1298-43f4-abf9-e60a67d6adc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:21.644240 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2972e-1298-43f4-abf9-e60a67d6adc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:21.644582 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2972e-1298-43f4-abf9-e60a67d6adc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:21.645244 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2972e-1298-43f4-abf9-e60a67d6adc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:21.645578 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d2972e-1298-43f4-abf9-e60a67d6adc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:21.649068 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d2972e-1298-43f4-abf9-e60a67d6adc8 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:21.729985 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 948/1889] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:07:21 2022] POST /identity/v3/projects => generated 361 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:07:21.731141 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c61b56-b57b-478f-9892-29d3bb0c88d3 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:21.745334 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c61b56-b57b-478f-9892-29d3bb0c88d3 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:21.789681 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2972e-1298-43f4-abf9-e60a67d6adc8 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:21.791464 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-b8d2972e-1298-43f4-abf9-e60a67d6adc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:21.879904 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1956e-2ef0-4d17-84bb-1a6cc112c270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:21.880890 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1956e-2ef0-4d17-84bb-1a6cc112c270 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:21.883251 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1956e-2ef0-4d17-84bb-1a6cc112c270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:21.883606 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1956e-2ef0-4d17-84bb-1a6cc112c270 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:21.884622 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1956e-2ef0-4d17-84bb-1a6cc112c270 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:21.890392 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1956e-2ef0-4d17-84bb-1a6cc112c270 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:21.920826 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2972e-1298-43f4-abf9-e60a67d6adc8 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:21.926484 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 942/1890] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:07:21 2022] POST /identity/v3/users => generated 281 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:07:21.927324 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1956e-2ef0-4d17-84bb-1a6cc112c270 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:21.929699 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f91e0b-1476-42bd-8502-74dde9d8c5c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:21.930605 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-1bb1956e-2ef0-4d17-84bb-1a6cc112c270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:21.930892 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f91e0b-1476-42bd-8502-74dde9d8c5c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:21.931381 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f91e0b-1476-42bd-8502-74dde9d8c5c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:21.932216 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f91e0b-1476-42bd-8502-74dde9d8c5c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:21.934622 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-a2f91e0b-1476-42bd-8502-74dde9d8c5c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:21.943502 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1956e-2ef0-4d17-84bb-1a6cc112c270 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:21.968113 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913ccb3-fe34-471c-950d-eb41c3047647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:21.968959 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913ccb3-fe34-471c-950d-eb41c3047647 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:21.969258 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913ccb3-fe34-471c-950d-eb41c3047647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:21.969527 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913ccb3-fe34-471c-950d-eb41c3047647 admin admin] PATH_INFO: `/v3/users/a863f31c8aa34ba49f84cdacf39af095` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:21.973069 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a913ccb3-fe34-471c-950d-eb41c3047647 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a863f31c8aa34ba49f84cdacf39af095)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:21.974960 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a913ccb3-fe34-471c-950d-eb41c3047647 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:21.980506 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:22.029895 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f91e0b-1476-42bd-8502-74dde9d8c5c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:22.031684 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f91e0b-1476-42bd-8502-74dde9d8c5c6 service cinder] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:22.046720 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 949/1891] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:07:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 12:07:22.047734 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f91e0b-1476-42bd-8502-74dde9d8c5c6 service cinder] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:22.064718 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f91e0b-1476-42bd-8502-74dde9d8c5c6 service cinder] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:22.075068 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad10c3-2d66-44a2-aedf-6311d8ccf869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:22.076453 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad10c3-2d66-44a2-aedf-6311d8ccf869 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:22.076810 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad10c3-2d66-44a2-aedf-6311d8ccf869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:22.077318 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad10c3-2d66-44a2-aedf-6311d8ccf869 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:22.078100 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad10c3-2d66-44a2-aedf-6311d8ccf869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:22.080281 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad10c3-2d66-44a2-aedf-6311d8ccf869 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:22.098167 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 950/1892] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:07:22.102340 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad10c3-2d66-44a2-aedf-6311d8ccf869 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:22.103042 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a913ccb3-fe34-471c-950d-eb41c3047647 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a863f31c8aa34ba49f84cdacf39af095'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:22.104790 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a913ccb3-fe34-471c-950d-eb41c3047647 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a863f31c8aa34ba49f84cdacf39af095'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:22.107907 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-c8ad10c3-2d66-44a2-aedf-6311d8ccf869 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:22.108542 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a913ccb3-fe34-471c-950d-eb41c3047647 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a863f31c8aa34ba49f84cdacf39af095'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:22.124986 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a913ccb3-fe34-471c-950d-eb41c3047647 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a863f31c8aa34ba49f84cdacf39af095'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:22.139798 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:22.161071 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a913ccb3-fe34-471c-950d-eb41c3047647 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a863f31c8aa34ba49f84cdacf39af095'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:22.172624 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad10c3-2d66-44a2-aedf-6311d8ccf869 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:22.183122 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 943/1893] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:07:21 2022] DELETE /identity/v3/users/a863f31c8aa34ba49f84cdacf39af095 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:07:22.187869 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104fda40-988d-41f6-a0b8-cba934133cce None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:22.187989 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a1ff9-b8f4-4bc2-8523-4f59fceb9056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:22.188263 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104fda40-988d-41f6-a0b8-cba934133cce None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:22.188708 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104fda40-988d-41f6-a0b8-cba934133cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:22.189821 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a1ff9-b8f4-4bc2-8523-4f59fceb9056 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:22.190446 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a1ff9-b8f4-4bc2-8523-4f59fceb9056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:22.191214 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a1ff9-b8f4-4bc2-8523-4f59fceb9056 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:22.193494 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20a1ff9-b8f4-4bc2-8523-4f59fceb9056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:22.197410 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20a1ff9-b8f4-4bc2-8523-4f59fceb9056 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:22.223964 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-104fda40-988d-41f6-a0b8-cba934133cce None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:22.224659 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 951/1894] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:07:22.225325 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-104fda40-988d-41f6-a0b8-cba934133cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:22.226012 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a1ff9-b8f4-4bc2-8523-4f59fceb9056 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:22.260947 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a1ff9-b8f4-4bc2-8523-4f59fceb9056 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:22.357424 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 944/1895] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:07:22.372033 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104fda40-988d-41f6-a0b8-cba934133cce None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:22.373842 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-104fda40-988d-41f6-a0b8-cba934133cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:22.393369 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59f8a7c-c83d-406d-bf94-e87a68b7ea84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:22.395806 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f8a7c-c83d-406d-bf94-e87a68b7ea84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:22.397402 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f8a7c-c83d-406d-bf94-e87a68b7ea84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:22.398603 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f8a7c-c83d-406d-bf94-e87a68b7ea84 admin admin] PATH_INFO: `/v3/projects/7a352924abb140a4960e644fc33d9852/users/5178f9f06e1c438c96ff64b0581ca11d/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:22.456904 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59f8a7c-c83d-406d-bf94-e87a68b7ea84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a352924abb140a4960e644fc33d9852, user_id=5178f9f06e1c438c96ff64b0581ca11d, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:22.466109 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59f8a7c-c83d-406d-bf94-e87a68b7ea84 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:22.515448 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 952/1896] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:07:22 2022] PUT /identity/v3/projects/7a352924abb140a4960e644fc33d9852/users/5178f9f06e1c438c96ff64b0581ca11d/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:07:22.530393 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e77d6-3aaf-48cc-a3e1-aaa76a4e48cc None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:22.530664 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e77d6-3aaf-48cc-a3e1-aaa76a4e48cc None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:22.531100 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e77d6-3aaf-48cc-a3e1-aaa76a4e48cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:22.560632 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104fda40-988d-41f6-a0b8-cba934133cce None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:22.608688 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-9a2e77d6-3aaf-48cc-a3e1-aaa76a4e48cc None None] MFA Rules not processed for user `5178f9f06e1c438c96ff64b0581ca11d`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:22.614091 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-9a2e77d6-3aaf-48cc-a3e1-aaa76a4e48cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:22.752131 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6509d5a-4949-4a82-a1aa-52a9a2018118 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:22.752847 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6509d5a-4949-4a82-a1aa-52a9a2018118 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:22.753193 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6509d5a-4949-4a82-a1aa-52a9a2018118 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:22.753389 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6509d5a-4949-4a82-a1aa-52a9a2018118 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:22.818623 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 953/1897] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:22 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:07:22.858667 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e77d6-3aaf-48cc-a3e1-aaa76a4e48cc None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:22.860099 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-9a2e77d6-3aaf-48cc-a3e1-aaa76a4e48cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:22.930187 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:22.952497 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:22.982100 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6509d5a-4949-4a82-a1aa-52a9a2018118 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:22.983581 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6509d5a-4949-4a82-a1aa-52a9a2018118 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:23.016280 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 945/1898] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:07:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 645 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 12:07:23.060498 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e77d6-3aaf-48cc-a3e1-aaa76a4e48cc None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:23.072371 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c3ed3-a8a6-416a-933c-5aa7ee92dccb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:23.073080 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c3ed3-a8a6-416a-933c-5aa7ee92dccb service cinder] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:23.075130 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c3ed3-a8a6-416a-933c-5aa7ee92dccb service cinder] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:23.076717 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c3ed3-a8a6-416a-933c-5aa7ee92dccb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:23.113063 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800c3ed3-a8a6-416a-933c-5aa7ee92dccb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:23.113856 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800c3ed3-a8a6-416a-933c-5aa7ee92dccb service cinder] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:23.135335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 954/1899] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:07:22 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 12:07:23.151731 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6509d5a-4949-4a82-a1aa-52a9a2018118 service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:23.168398 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6509d5a-4949-4a82-a1aa-52a9a2018118 service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:23.188229 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb9b1e-2905-4d78-b904-a275f1b41fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:23.189140 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb9b1e-2905-4d78-b904-a275f1b41fbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:23.189422 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb9b1e-2905-4d78-b904-a275f1b41fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:23.189703 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb9b1e-2905-4d78-b904-a275f1b41fbb admin admin] PATH_INFO: `/v3/users/5178f9f06e1c438c96ff64b0581ca11d` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:23.191363 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bb9b1e-2905-4d78-b904-a275f1b41fbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5178f9f06e1c438c96ff64b0581ca11d)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:23.193642 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bb9b1e-2905-4d78-b904-a275f1b41fbb admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:23.310695 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d9bb9b1e-2905-4d78-b904-a275f1b41fbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5178f9f06e1c438c96ff64b0581ca11d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:23.310862 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d9bb9b1e-2905-4d78-b904-a275f1b41fbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5178f9f06e1c438c96ff64b0581ca11d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:23.311489 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d9bb9b1e-2905-4d78-b904-a275f1b41fbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5178f9f06e1c438c96ff64b0581ca11d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:23.340497 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d9bb9b1e-2905-4d78-b904-a275f1b41fbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5178f9f06e1c438c96ff64b0581ca11d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:23.379502 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d9bb9b1e-2905-4d78-b904-a275f1b41fbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5178f9f06e1c438c96ff64b0581ca11d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:23.405020 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 946/1900] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:07:23 2022] DELETE /identity/v3/users/5178f9f06e1c438c96ff64b0581ca11d => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:07:23.409893 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ebeeea-5fe9-48a5-8c5f-9477f532abf8 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:23.410307 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ebeeea-5fe9-48a5-8c5f-9477f532abf8 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:23.410462 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ebeeea-5fe9-48a5-8c5f-9477f532abf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:23.452032 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-17ebeeea-5fe9-48a5-8c5f-9477f532abf8 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:23.453290 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-17ebeeea-5fe9-48a5-8c5f-9477f532abf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:23.550553 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 955/1901] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:07:23.601870 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb9b1e-2905-4d78-b904-a275f1b41fbb admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:23.604025 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-d9bb9b1e-2905-4d78-b904-a275f1b41fbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:23.736667 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb9b1e-2905-4d78-b904-a275f1b41fbb admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:23.746938 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f2a71d-b87c-4578-8981-20937563d892 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:23.752433 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2a71d-b87c-4578-8981-20937563d892 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:23.752802 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2a71d-b87c-4578-8981-20937563d892 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:23.753417 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2a71d-b87c-4578-8981-20937563d892 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:23.806211 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f2a71d-b87c-4578-8981-20937563d892 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:23.808810 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f2a71d-b87c-4578-8981-20937563d892 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:23.852149 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 947/1902] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:07:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:07:24.902814 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ebeeea-5fe9-48a5-8c5f-9477f532abf8 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:24.905020 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-17ebeeea-5fe9-48a5-8c5f-9477f532abf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:24.926785 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ebeeea-5fe9-48a5-8c5f-9477f532abf8 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:24.949352 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af266e6b-32b4-467d-9706-74566c7e370c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:24.951668 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af266e6b-32b4-467d-9706-74566c7e370c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:24.952420 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af266e6b-32b4-467d-9706-74566c7e370c admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:24.954374 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af266e6b-32b4-467d-9706-74566c7e370c admin admin] PATH_INFO: `/v3/projects/3d7433abba484c0b87da4d93f5a57724` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:24.956438 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af266e6b-32b4-467d-9706-74566c7e370c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d7433abba484c0b87da4d93f5a57724)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:24.959402 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af266e6b-32b4-467d-9706-74566c7e370c admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:25.086559 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-af266e6b-32b4-467d-9706-74566c7e370c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d7433abba484c0b87da4d93f5a57724', 'request_id': 'req-af266e6b-32b4-467d-9706-74566c7e370c'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:25.112445 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-af266e6b-32b4-467d-9706-74566c7e370c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d7433abba484c0b87da4d93f5a57724', 'request_id': 'req-af266e6b-32b4-467d-9706-74566c7e370c'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:25.130866 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-af266e6b-32b4-467d-9706-74566c7e370c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d7433abba484c0b87da4d93f5a57724', 'request_id': 'req-af266e6b-32b4-467d-9706-74566c7e370c'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:25.144054 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-af266e6b-32b4-467d-9706-74566c7e370c admin admin] The token cache is being invalidate because project 3d7433abba484c0b87da4d93f5a57724 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:07:25.144379 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-af266e6b-32b4-467d-9706-74566c7e370c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:25.145040 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-af266e6b-32b4-467d-9706-74566c7e370c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:25.146609 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 956/1903] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:07:24 2022] DELETE /identity/v3/projects/3d7433abba484c0b87da4d93f5a57724 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:07:25.150746 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f2a71d-b87c-4578-8981-20937563d892 service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:25.163149 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f2a71d-b87c-4578-8981-20937563d892 service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:25.230500 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf2201a-9ea6-4f30-8455-ea84be1523c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:25.231400 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2201a-9ea6-4f30-8455-ea84be1523c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:25.231885 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2201a-9ea6-4f30-8455-ea84be1523c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:25.232156 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2201a-9ea6-4f30-8455-ea84be1523c4 admin admin] PATH_INFO: `/v3/users/b4ebcfa6df1b4ba6ac76e5bc502e6244` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:25.233456 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf2201a-9ea6-4f30-8455-ea84be1523c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4ebcfa6df1b4ba6ac76e5bc502e6244)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:25.235444 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf2201a-9ea6-4f30-8455-ea84be1523c4 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:25.240476 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:25.300083 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-6bf2201a-9ea6-4f30-8455-ea84be1523c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4ebcfa6df1b4ba6ac76e5bc502e6244'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:25.300843 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-6bf2201a-9ea6-4f30-8455-ea84be1523c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4ebcfa6df1b4ba6ac76e5bc502e6244'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:25.301472 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-6bf2201a-9ea6-4f30-8455-ea84be1523c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4ebcfa6df1b4ba6ac76e5bc502e6244'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:25.310048 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-6bf2201a-9ea6-4f30-8455-ea84be1523c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4ebcfa6df1b4ba6ac76e5bc502e6244'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:25.329049 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-6bf2201a-9ea6-4f30-8455-ea84be1523c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4ebcfa6df1b4ba6ac76e5bc502e6244'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:25.361182 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 948/1904] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:07:25 2022] DELETE /identity/v3/users/b4ebcfa6df1b4ba6ac76e5bc502e6244 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:07:25.422536 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af266e6b-32b4-467d-9706-74566c7e370c admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:25.424259 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-af266e6b-32b4-467d-9706-74566c7e370c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:25.447819 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af266e6b-32b4-467d-9706-74566c7e370c admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:25.537735 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:25.571860 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdb451f-0c84-4113-bf8e-95723c876e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:25.573072 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb451f-0c84-4113-bf8e-95723c876e16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:25.573360 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb451f-0c84-4113-bf8e-95723c876e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:25.573640 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb451f-0c84-4113-bf8e-95723c876e16 admin admin] PATH_INFO: `/v3/users/9bb8d92318ad4eccbd072f94258c70a7` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:25.576903 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdb451f-0c84-4113-bf8e-95723c876e16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bb8d92318ad4eccbd072f94258c70a7)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:25.583102 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdb451f-0c84-4113-bf8e-95723c876e16 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:25.696558 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-dcdb451f-0c84-4113-bf8e-95723c876e16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bb8d92318ad4eccbd072f94258c70a7'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:25.711528 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-dcdb451f-0c84-4113-bf8e-95723c876e16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bb8d92318ad4eccbd072f94258c70a7'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:25.713365 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-dcdb451f-0c84-4113-bf8e-95723c876e16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bb8d92318ad4eccbd072f94258c70a7'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:25.714359 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-dcdb451f-0c84-4113-bf8e-95723c876e16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bb8d92318ad4eccbd072f94258c70a7'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:25.750032 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-dcdb451f-0c84-4113-bf8e-95723c876e16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bb8d92318ad4eccbd072f94258c70a7'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:25.771366 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 957/1905] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:07:25 2022] DELETE /identity/v3/users/9bb8d92318ad4eccbd072f94258c70a7 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:07:25.776536 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9deda00-1639-4479-acf0-e7a77b970db0 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:25.776920 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9deda00-1639-4479-acf0-e7a77b970db0 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:25.777390 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9deda00-1639-4479-acf0-e7a77b970db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:25.803312 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-c9deda00-1639-4479-acf0-e7a77b970db0 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:25.805805 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-c9deda00-1639-4479-acf0-e7a77b970db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:25.845474 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdb451f-0c84-4113-bf8e-95723c876e16 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:25.847002 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-dcdb451f-0c84-4113-bf8e-95723c876e16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:25.933606 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 949/1906] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:07:25.953394 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9deda00-1639-4479-acf0-e7a77b970db0 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:25.956679 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-c9deda00-1639-4479-acf0-e7a77b970db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:26.006010 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdb451f-0c84-4113-bf8e-95723c876e16 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:26.020581 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd73cddb-fb2a-45a4-aabe-005c636c79f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:26.021502 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73cddb-fb2a-45a4-aabe-005c636c79f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:26.021924 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73cddb-fb2a-45a4-aabe-005c636c79f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:26.022212 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73cddb-fb2a-45a4-aabe-005c636c79f9 admin admin] PATH_INFO: `/v3/projects/09aae0e5e32c427a8a3ae24e175faeb6` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:26.023650 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd73cddb-fb2a-45a4-aabe-005c636c79f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09aae0e5e32c427a8a3ae24e175faeb6)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:26.025879 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd73cddb-fb2a-45a4-aabe-005c636c79f9 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:26.093335 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9deda00-1639-4479-acf0-e7a77b970db0 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:26.094127 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-fd73cddb-fb2a-45a4-aabe-005c636c79f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09aae0e5e32c427a8a3ae24e175faeb6', 'request_id': 'req-fd73cddb-fb2a-45a4-aabe-005c636c79f9'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:26.107355 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-fd73cddb-fb2a-45a4-aabe-005c636c79f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09aae0e5e32c427a8a3ae24e175faeb6', 'request_id': 'req-fd73cddb-fb2a-45a4-aabe-005c636c79f9'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:26.115708 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-fd73cddb-fb2a-45a4-aabe-005c636c79f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09aae0e5e32c427a8a3ae24e175faeb6', 'request_id': 'req-fd73cddb-fb2a-45a4-aabe-005c636c79f9'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:26.116797 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:26.146760 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-fd73cddb-fb2a-45a4-aabe-005c636c79f9 admin admin] The token cache is being invalidate because project 09aae0e5e32c427a8a3ae24e175faeb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:07:26.147057 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-fd73cddb-fb2a-45a4-aabe-005c636c79f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:26.148024 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-fd73cddb-fb2a-45a4-aabe-005c636c79f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:26.152928 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 958/1907] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:07:25 2022] DELETE /identity/v3/projects/09aae0e5e32c427a8a3ae24e175faeb6 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:07:26.155862 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ccbc6a-d0c1-4fbc-b02b-54954396636f None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:26.156157 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ccbc6a-d0c1-4fbc-b02b-54954396636f None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:26.156458 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ccbc6a-d0c1-4fbc-b02b-54954396636f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:26.182746 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:26.208556 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90abf97-6213-499a-a671-a8ca7cd0116f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:26.209243 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90abf97-6213-499a-a671-a8ca7cd0116f service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:26.209588 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90abf97-6213-499a-a671-a8ca7cd0116f service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:26.210031 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90abf97-6213-499a-a671-a8ca7cd0116f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:26.212113 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b90abf97-6213-499a-a671-a8ca7cd0116f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:26.227115 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-05ccbc6a-d0c1-4fbc-b02b-54954396636f None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:26.234640 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-05ccbc6a-d0c1-4fbc-b02b-54954396636f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:26.294673 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90abf97-6213-499a-a671-a8ca7cd0116f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:26.296290 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90abf97-6213-499a-a671-a8ca7cd0116f service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:26.316107 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 950/1908] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:07:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 12:07:26.317002 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90abf97-6213-499a-a671-a8ca7cd0116f service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:26.321752 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b90abf97-6213-499a-a671-a8ca7cd0116f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:26.325193 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 959/1909] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:07:26.335467 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84898be-1138-4993-9cd0-56a406ba7b3f None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:26.336755 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84898be-1138-4993-9cd0-56a406ba7b3f None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:26.337395 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84898be-1138-4993-9cd0-56a406ba7b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:26.341624 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90abf97-6213-499a-a671-a8ca7cd0116f service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:26.347695 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393671e8-a4e8-4dbf-8cc1-d5e39743bf28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:26.348704 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393671e8-a4e8-4dbf-8cc1-d5e39743bf28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:26.349446 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393671e8-a4e8-4dbf-8cc1-d5e39743bf28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:26.349446 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393671e8-a4e8-4dbf-8cc1-d5e39743bf28 admin admin] PATH_INFO: `/v3/projects/7a352924abb140a4960e644fc33d9852` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:26.351264 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393671e8-a4e8-4dbf-8cc1-d5e39743bf28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a352924abb140a4960e644fc33d9852)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:26.353613 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393671e8-a4e8-4dbf-8cc1-d5e39743bf28 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:26.381267 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-e84898be-1138-4993-9cd0-56a406ba7b3f None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:26.384974 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-e84898be-1138-4993-9cd0-56a406ba7b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:26.406086 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 960/1910] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:07:26.407386 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84898be-1138-4993-9cd0-56a406ba7b3f None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:26.419856 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84898be-1138-4993-9cd0-56a406ba7b3f None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:26.427727 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-393671e8-a4e8-4dbf-8cc1-d5e39743bf28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a352924abb140a4960e644fc33d9852', 'request_id': 'req-393671e8-a4e8-4dbf-8cc1-d5e39743bf28'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:26.440807 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-393671e8-a4e8-4dbf-8cc1-d5e39743bf28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a352924abb140a4960e644fc33d9852', 'request_id': 'req-393671e8-a4e8-4dbf-8cc1-d5e39743bf28'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:26.448450 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-393671e8-a4e8-4dbf-8cc1-d5e39743bf28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a352924abb140a4960e644fc33d9852', 'request_id': 'req-393671e8-a4e8-4dbf-8cc1-d5e39743bf28'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:26.463534 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-393671e8-a4e8-4dbf-8cc1-d5e39743bf28 admin admin] The token cache is being invalidate because project 7a352924abb140a4960e644fc33d9852 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:07:26.463938 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-393671e8-a4e8-4dbf-8cc1-d5e39743bf28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:26.464705 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-393671e8-a4e8-4dbf-8cc1-d5e39743bf28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:26.470157 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 951/1911] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:07:26 2022] DELETE /identity/v3/projects/7a352924abb140a4960e644fc33d9852 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:07:26.472314 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a211c-e6af-498a-a4a8-b56d895a7d99 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:26.473120 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a211c-e6af-498a-a4a8-b56d895a7d99 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:26.473120 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a211c-e6af-498a-a4a8-b56d895a7d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:26.498011 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b6b7b-b672-4e7d-ab51-afaa99734c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:26.498619 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-234a211c-e6af-498a-a4a8-b56d895a7d99 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:26.499278 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b6b7b-b672-4e7d-ab51-afaa99734c67 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:26.499845 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b6b7b-b672-4e7d-ab51-afaa99734c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:26.500058 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-234a211c-e6af-498a-a4a8-b56d895a7d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:26.500381 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b6b7b-b672-4e7d-ab51-afaa99734c67 admin admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:26.501719 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8b6b7b-b672-4e7d-ab51-afaa99734c67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:07:26.502040 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8b6b7b-b672-4e7d-ab51-afaa99734c67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:26.504570 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8b6b7b-b672-4e7d-ab51-afaa99734c67 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:26.520229 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 952/1912] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:07:26.524331 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 961/1913] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:07:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:07:26.525759 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198cede8-37c9-46b8-9ccb-53cf15e84ae8 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:26.526691 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198cede8-37c9-46b8-9ccb-53cf15e84ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:26.526972 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198cede8-37c9-46b8-9ccb-53cf15e84ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:26.528866 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b6b7b-b672-4e7d-ab51-afaa99734c67 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:26.531093 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-6a8b6b7b-b672-4e7d-ab51-afaa99734c67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:26.544554 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b6b7b-b672-4e7d-ab51-afaa99734c67 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:26.546653 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-198cede8-37c9-46b8-9ccb-53cf15e84ae8 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:26.548114 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-198cede8-37c9-46b8-9ccb-53cf15e84ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:26.549479 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f55d88-52b0-482d-a31d-10b4700bd2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:26.550179 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f55d88-52b0-482d-a31d-10b4700bd2d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:26.550462 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f55d88-52b0-482d-a31d-10b4700bd2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:26.550737 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f55d88-52b0-482d-a31d-10b4700bd2d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:26.551448 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f55d88-52b0-482d-a31d-10b4700bd2d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:26.553391 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f55d88-52b0-482d-a31d-10b4700bd2d1 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:26.557747 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 953/1914] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:07:26.561710 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198cede8-37c9-46b8-9ccb-53cf15e84ae8 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:26.572254 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198cede8-37c9-46b8-9ccb-53cf15e84ae8 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:26.581211 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f97ca-fd3c-4bf2-af5e-c778da656edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:26.581211 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f97ca-fd3c-4bf2-af5e-c778da656edb admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:26.581211 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f97ca-fd3c-4bf2-af5e-c778da656edb admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:26.584377 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f97ca-fd3c-4bf2-af5e-c778da656edb admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:26.586058 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f97ca-fd3c-4bf2-af5e-c778da656edb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:07:26.586416 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f97ca-fd3c-4bf2-af5e-c778da656edb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:26.588336 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f97ca-fd3c-4bf2-af5e-c778da656edb admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:26.597420 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 962/1915] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:07:26 2022] POST /identity/v3/projects => generated 385 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:07:26.599162 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f55d88-52b0-482d-a31d-10b4700bd2d1 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:26.607137 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 954/1916] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:07:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:07:26.608125 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f97ca-fd3c-4bf2-af5e-c778da656edb admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:26.620046 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f97ca-fd3c-4bf2-af5e-c778da656edb admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:26.693576 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:26.713648 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f55d88-52b0-482d-a31d-10b4700bd2d1 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:26.719902 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc14349-41a4-4791-a064-d021230cb578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:26.720751 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc14349-41a4-4791-a064-d021230cb578 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:26.721042 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc14349-41a4-4791-a064-d021230cb578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:26.721464 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc14349-41a4-4791-a064-d021230cb578 admin admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:26.722186 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc14349-41a4-4791-a064-d021230cb578 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:26.723407 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9908eb7-5216-4311-b965-fe6cf1e009e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:26.724367 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc14349-41a4-4791-a064-d021230cb578 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:26.724968 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9908eb7-5216-4311-b965-fe6cf1e009e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:26.725709 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9908eb7-5216-4311-b965-fe6cf1e009e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:26.726533 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9908eb7-5216-4311-b965-fe6cf1e009e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:26.727643 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9908eb7-5216-4311-b965-fe6cf1e009e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:26.730567 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9908eb7-5216-4311-b965-fe6cf1e009e4 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:26.732522 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:26.754964 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 963/1917] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:07:26 2022] POST /identity/v3/users => generated 293 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:07:26.755817 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc14349-41a4-4791-a064-d021230cb578 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:26.768678 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc14349-41a4-4791-a064-d021230cb578 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:26.774487 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ca2a5-eb44-4653-9af2-13d2504719d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:26.775267 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ca2a5-eb44-4653-9af2-13d2504719d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:26.775776 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ca2a5-eb44-4653-9af2-13d2504719d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:26.776134 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ca2a5-eb44-4653-9af2-13d2504719d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:26.777143 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5ca2a5-eb44-4653-9af2-13d2504719d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:26.778935 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5ca2a5-eb44-4653-9af2-13d2504719d1 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:26.787231 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 955/1918] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:07:26 2022] POST /identity/v3/projects => generated 371 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:07:26.791562 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9908eb7-5216-4311-b965-fe6cf1e009e4 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:26.796347 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 964/1919] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:07:26.797686 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ca2a5-eb44-4653-9af2-13d2504719d1 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:26.800779 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-8a5ca2a5-eb44-4653-9af2-13d2504719d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:26.835280 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ca2a5-eb44-4653-9af2-13d2504719d1 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:26.885400 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9908eb7-5216-4311-b965-fe6cf1e009e4 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:26.892048 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bd692a-24d9-4557-9817-10cd7b5d8008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:26.892770 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd692a-24d9-4557-9817-10cd7b5d8008 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:26.893059 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd692a-24d9-4557-9817-10cd7b5d8008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:26.893496 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd692a-24d9-4557-9817-10cd7b5d8008 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:26.894688 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bd692a-24d9-4557-9817-10cd7b5d8008 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:26.897575 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bd692a-24d9-4557-9817-10cd7b5d8008 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:26.906357 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e22dd-bd5f-4f6d-ab88-88f17680c021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:26.907237 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e22dd-bd5f-4f6d-ab88-88f17680c021 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:26.907522 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e22dd-bd5f-4f6d-ab88-88f17680c021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:26.908160 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e22dd-bd5f-4f6d-ab88-88f17680c021 admin admin] PATH_INFO: `/v3/projects/e66929d0d3a745ad94ccdbcc0a5788ab` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:26.909190 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e22dd-bd5f-4f6d-ab88-88f17680c021 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e66929d0d3a745ad94ccdbcc0a5788ab)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:26.911545 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e22dd-bd5f-4f6d-ab88-88f17680c021 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:26.923244 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 956/1920] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:07:26 2022] POST /identity/v3/users => generated 286 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 12:07:26.923964 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bd692a-24d9-4557-9817-10cd7b5d8008 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:26.935668 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bd692a-24d9-4557-9817-10cd7b5d8008 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:26.941248 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c581c862-b91b-45d4-a891-b525e1912711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:26.941955 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581c862-b91b-45d4-a891-b525e1912711 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:26.942243 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581c862-b91b-45d4-a891-b525e1912711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:26.942525 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581c862-b91b-45d4-a891-b525e1912711 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:26.943283 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c581c862-b91b-45d4-a891-b525e1912711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:26.945515 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c581c862-b91b-45d4-a891-b525e1912711 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:26.959813 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 957/1921] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:07:26.959813 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c581c862-b91b-45d4-a891-b525e1912711 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:26.968010 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c581c862-b91b-45d4-a891-b525e1912711 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:26.972373 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-c86e22dd-bd5f-4f6d-ab88-88f17680c021 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e66929d0d3a745ad94ccdbcc0a5788ab', 'request_id': 'req-c86e22dd-bd5f-4f6d-ab88-88f17680c021'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:26.981148 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-c86e22dd-bd5f-4f6d-ab88-88f17680c021 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e66929d0d3a745ad94ccdbcc0a5788ab', 'request_id': 'req-c86e22dd-bd5f-4f6d-ab88-88f17680c021'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:26.988031 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-c86e22dd-bd5f-4f6d-ab88-88f17680c021 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e66929d0d3a745ad94ccdbcc0a5788ab', 'request_id': 'req-c86e22dd-bd5f-4f6d-ab88-88f17680c021'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:27.000436 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-c86e22dd-bd5f-4f6d-ab88-88f17680c021 admin admin] The token cache is being invalidate because project e66929d0d3a745ad94ccdbcc0a5788ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:07:27.000727 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-c86e22dd-bd5f-4f6d-ab88-88f17680c021 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:27.001394 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-c86e22dd-bd5f-4f6d-ab88-88f17680c021 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:27.002962 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 965/1922] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:07:26 2022] DELETE /identity/v3/projects/e66929d0d3a745ad94ccdbcc0a5788ab => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:07:27.005900 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e22dd-bd5f-4f6d-ab88-88f17680c021 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:27.005900 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-c86e22dd-bd5f-4f6d-ab88-88f17680c021 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:27.028162 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0be6945-2f58-4da7-afcb-6477a9fc98c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:27.028868 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be6945-2f58-4da7-afcb-6477a9fc98c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:27.029156 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be6945-2f58-4da7-afcb-6477a9fc98c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:27.029436 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be6945-2f58-4da7-afcb-6477a9fc98c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:27.030161 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0be6945-2f58-4da7-afcb-6477a9fc98c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:27.031903 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0be6945-2f58-4da7-afcb-6477a9fc98c1 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:27.044782 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 958/1923] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:07:27.049096 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0be6945-2f58-4da7-afcb-6477a9fc98c1 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:27.051381 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-e0be6945-2f58-4da7-afcb-6477a9fc98c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:27.068473 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0be6945-2f58-4da7-afcb-6477a9fc98c1 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:27.074654 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f9ad3-faac-43c6-baf8-e340c9e81256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:27.075550 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f9ad3-faac-43c6-baf8-e340c9e81256 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:27.076126 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f9ad3-faac-43c6-baf8-e340c9e81256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:27.076450 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f9ad3-faac-43c6-baf8-e340c9e81256 admin admin] PATH_INFO: `/v3/users/b5f2b18c7c9b4ad88be411a219d0fe5f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:27.078246 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31f9ad3-faac-43c6-baf8-e340c9e81256 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5f2b18c7c9b4ad88be411a219d0fe5f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:27.080656 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31f9ad3-faac-43c6-baf8-e340c9e81256 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:27.082533 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e22dd-bd5f-4f6d-ab88-88f17680c021 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:27.091920 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f2153-b510-4ca7-a4fb-bcb4eecdbf33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:27.092899 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f2153-b510-4ca7-a4fb-bcb4eecdbf33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:27.093194 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f2153-b510-4ca7-a4fb-bcb4eecdbf33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:27.093458 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f2153-b510-4ca7-a4fb-bcb4eecdbf33 admin admin] PATH_INFO: `/v3/projects/7dd50b952f5943e78fcd575dc47e7e2f/users/eeb73fb8b2954f24a762c79c481bae53/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:27.116841 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:27.121140 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7f2153-b510-4ca7-a4fb-bcb4eecdbf33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dd50b952f5943e78fcd575dc47e7e2f, user_id=eeb73fb8b2954f24a762c79c481bae53, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:27.124756 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7f2153-b510-4ca7-a4fb-bcb4eecdbf33 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:27.142030 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:27.152212 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 966/1924] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:07:27 2022] PUT /identity/v3/projects/7dd50b952f5943e78fcd575dc47e7e2f/users/eeb73fb8b2954f24a762c79c481bae53/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:07:27.152212 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f2153-b510-4ca7-a4fb-bcb4eecdbf33 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:27.152212 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-4f7f2153-b510-4ca7-a4fb-bcb4eecdbf33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:27.160378 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d31f9ad3-faac-43c6-baf8-e340c9e81256 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5f2b18c7c9b4ad88be411a219d0fe5f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:27.161331 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d31f9ad3-faac-43c6-baf8-e340c9e81256 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5f2b18c7c9b4ad88be411a219d0fe5f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:27.161973 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d31f9ad3-faac-43c6-baf8-e340c9e81256 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5f2b18c7c9b4ad88be411a219d0fe5f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:27.169458 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d31f9ad3-faac-43c6-baf8-e340c9e81256 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5f2b18c7c9b4ad88be411a219d0fe5f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:27.182819 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d31f9ad3-faac-43c6-baf8-e340c9e81256 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5f2b18c7c9b4ad88be411a219d0fe5f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:27.204511 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 959/1925] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:07:27 2022] DELETE /identity/v3/users/b5f2b18c7c9b4ad88be411a219d0fe5f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:07:27.205879 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c557e-2c09-4f63-9ff9-8e10b5c3b3f8 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:27.206174 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c557e-2c09-4f63-9ff9-8e10b5c3b3f8 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:27.206460 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c557e-2c09-4f63-9ff9-8e10b5c3b3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:27.230105 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f2153-b510-4ca7-a4fb-bcb4eecdbf33 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:27.234917 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-7e8c557e-2c09-4f63-9ff9-8e10b5c3b3f8 None None] MFA Rules not processed for user `eeb73fb8b2954f24a762c79c481bae53`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:27.236646 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-7e8c557e-2c09-4f63-9ff9-8e10b5c3b3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:27.299695 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87196e0c-a676-4fdf-af48-45c417756a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:27.300479 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87196e0c-a676-4fdf-af48-45c417756a98 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:27.300767 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87196e0c-a676-4fdf-af48-45c417756a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:27.301045 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87196e0c-a676-4fdf-af48-45c417756a98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:27.301778 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87196e0c-a676-4fdf-af48-45c417756a98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:27.303477 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87196e0c-a676-4fdf-af48-45c417756a98 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:27.315628 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 967/1926] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:07:27.318703 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 960/1927] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:07:27.320922 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87196e0c-a676-4fdf-af48-45c417756a98 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:27.322778 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-87196e0c-a676-4fdf-af48-45c417756a98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:27.323762 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c557e-2c09-4f63-9ff9-8e10b5c3b3f8 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:27.325391 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-7e8c557e-2c09-4f63-9ff9-8e10b5c3b3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:27.336841 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87196e0c-a676-4fdf-af48-45c417756a98 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:27.342029 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6986e430-af8f-4fad-a658-3e375c0d8fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:27.342583 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c557e-2c09-4f63-9ff9-8e10b5c3b3f8 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:27.342940 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986e430-af8f-4fad-a658-3e375c0d8fba admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:27.343226 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986e430-af8f-4fad-a658-3e375c0d8fba admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:27.343501 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986e430-af8f-4fad-a658-3e375c0d8fba admin admin] PATH_INFO: `/v3/projects/19f7e415ffbf4c6fbf00e42efb7000f4/users/2ce251095f13444c9e96c0ba58ac47aa/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:27.348750 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b9d16-2e41-4a1e-9368-86c545e1aa8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:27.349700 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b9d16-2e41-4a1e-9368-86c545e1aa8c admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:27.350200 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b9d16-2e41-4a1e-9368-86c545e1aa8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:27.351721 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b9d16-2e41-4a1e-9368-86c545e1aa8c admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:27.352745 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15b9d16-2e41-4a1e-9368-86c545e1aa8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:27.355128 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15b9d16-2e41-4a1e-9368-86c545e1aa8c admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:27.360400 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6986e430-af8f-4fad-a658-3e375c0d8fba admin admin] RBAC: Authorizing `identity:create_grant(project_id=19f7e415ffbf4c6fbf00e42efb7000f4, user_id=2ce251095f13444c9e96c0ba58ac47aa, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:27.363052 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6986e430-af8f-4fad-a658-3e375c0d8fba admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:27.387161 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 968/1928] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:07:27 2022] PUT /identity/v3/projects/19f7e415ffbf4c6fbf00e42efb7000f4/users/2ce251095f13444c9e96c0ba58ac47aa/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:07:27.393733 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 961/1929] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:07:27 2022] POST /identity/v3/projects => generated 383 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:07:27.396623 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6986e430-af8f-4fad-a658-3e375c0d8fba admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:27.397849 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09037a9f-62f9-4c73-9bf1-4fa2079de7b2 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:27.398290 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09037a9f-62f9-4c73-9bf1-4fa2079de7b2 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:27.398759 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09037a9f-62f9-4c73-9bf1-4fa2079de7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:27.431230 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-09037a9f-62f9-4c73-9bf1-4fa2079de7b2 None None] MFA Rules not processed for user `2ce251095f13444c9e96c0ba58ac47aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:27.432543 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-09037a9f-62f9-4c73-9bf1-4fa2079de7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:27.489701 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6986e430-af8f-4fad-a658-3e375c0d8fba admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:27.532637 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 962/1930] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:07:27.533582 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09037a9f-62f9-4c73-9bf1-4fa2079de7b2 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:27.534184 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:27.536137 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-09037a9f-62f9-4c73-9bf1-4fa2079de7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:27.584590 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:27.623788 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c3277-31aa-40b9-84ef-a591901e58f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:27.624520 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c3277-31aa-40b9-84ef-a591901e58f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:27.624809 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c3277-31aa-40b9-84ef-a591901e58f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:27.625087 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c3277-31aa-40b9-84ef-a591901e58f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:27.625799 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16c3277-31aa-40b9-84ef-a591901e58f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:27.627743 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16c3277-31aa-40b9-84ef-a591901e58f3 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:27.653559 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09037a9f-62f9-4c73-9bf1-4fa2079de7b2 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:27.661277 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 969/1931] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:07:27 2022] POST /identity/v3/users => generated 298 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 12:07:27.661560 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76626a0-1b7f-4769-94ef-b466b634fbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:27.662526 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76626a0-1b7f-4769-94ef-b466b634fbd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:27.662812 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76626a0-1b7f-4769-94ef-b466b634fbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:27.663609 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76626a0-1b7f-4769-94ef-b466b634fbd0 admin admin] PATH_INFO: `/v3/projects/eefc9cb6ce4f42adb65db74773cac86c` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:27.665154 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76626a0-1b7f-4769-94ef-b466b634fbd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eefc9cb6ce4f42adb65db74773cac86c)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:27.665569 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c3277-31aa-40b9-84ef-a591901e58f3 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:27.667067 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76626a0-1b7f-4769-94ef-b466b634fbd0 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:27.667635 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-c16c3277-31aa-40b9-84ef-a591901e58f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:27.730624 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f76626a0-1b7f-4769-94ef-b466b634fbd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eefc9cb6ce4f42adb65db74773cac86c', 'request_id': 'req-f76626a0-1b7f-4769-94ef-b466b634fbd0'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:27.739164 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f76626a0-1b7f-4769-94ef-b466b634fbd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eefc9cb6ce4f42adb65db74773cac86c', 'request_id': 'req-f76626a0-1b7f-4769-94ef-b466b634fbd0'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:27.745575 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f76626a0-1b7f-4769-94ef-b466b634fbd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eefc9cb6ce4f42adb65db74773cac86c', 'request_id': 'req-f76626a0-1b7f-4769-94ef-b466b634fbd0'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:27.746775 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c3277-31aa-40b9-84ef-a591901e58f3 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:27.757778 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f76626a0-1b7f-4769-94ef-b466b634fbd0 admin admin] The token cache is being invalidate because project eefc9cb6ce4f42adb65db74773cac86c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:07:27.758397 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f76626a0-1b7f-4769-94ef-b466b634fbd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:27.759119 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f76626a0-1b7f-4769-94ef-b466b634fbd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:27.760719 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 963/1932] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:07:27 2022] DELETE /identity/v3/projects/eefc9cb6ce4f42adb65db74773cac86c => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:07:27.761475 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76626a0-1b7f-4769-94ef-b466b634fbd0 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:27.762758 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f76626a0-1b7f-4769-94ef-b466b634fbd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:27.814219 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f7c57-3b7b-4e4b-8e2a-dab90da06f5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:27.814890 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f7c57-3b7b-4e4b-8e2a-dab90da06f5f service cinder] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:27.815277 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f7c57-3b7b-4e4b-8e2a-dab90da06f5f service cinder] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:27.815561 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f7c57-3b7b-4e4b-8e2a-dab90da06f5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:27.817381 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-383f7c57-3b7b-4e4b-8e2a-dab90da06f5f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:27.834034 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76626a0-1b7f-4769-94ef-b466b634fbd0 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:27.839499 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017def7a-966a-46c9-b61d-1193075b8260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:27.840180 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017def7a-966a-46c9-b61d-1193075b8260 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:27.840486 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017def7a-966a-46c9-b61d-1193075b8260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:27.840908 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017def7a-966a-46c9-b61d-1193075b8260 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:27.841638 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017def7a-966a-46c9-b61d-1193075b8260 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:27.843232 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017def7a-966a-46c9-b61d-1193075b8260 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:27.854611 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 964/1933] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:07:27.855446 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017def7a-966a-46c9-b61d-1193075b8260 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:27.857077 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-017def7a-966a-46c9-b61d-1193075b8260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:27.869858 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017def7a-966a-46c9-b61d-1193075b8260 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:27.874461 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f114c6f3-30f7-4326-916a-5a467b5b28cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:27.875311 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114c6f3-30f7-4326-916a-5a467b5b28cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:27.875598 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114c6f3-30f7-4326-916a-5a467b5b28cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:27.875962 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114c6f3-30f7-4326-916a-5a467b5b28cc admin admin] PATH_INFO: `/v3/users/a888d277382d4d78ac165147e7823736` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:27.877081 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f114c6f3-30f7-4326-916a-5a467b5b28cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a888d277382d4d78ac165147e7823736)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:27.878969 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f114c6f3-30f7-4326-916a-5a467b5b28cc admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:27.879160 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383f7c57-3b7b-4e4b-8e2a-dab90da06f5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:27.880663 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383f7c57-3b7b-4e4b-8e2a-dab90da06f5f service cinder] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:27.889603 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 970/1934] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:07:27 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:07:27.890249 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f7c57-3b7b-4e4b-8e2a-dab90da06f5f service cinder] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:27.904234 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f7c57-3b7b-4e4b-8e2a-dab90da06f5f service cinder] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:27.910601 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab4f23b-cf48-44f7-bc5f-2f8bc4fbe53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:27.911491 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4f23b-cf48-44f7-bc5f-2f8bc4fbe53e admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:27.911774 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4f23b-cf48-44f7-bc5f-2f8bc4fbe53e admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:27.912267 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4f23b-cf48-44f7-bc5f-2f8bc4fbe53e admin admin] PATH_INFO: `/v3/projects/8c09faa94cde4f448822a93efc5f7963/users/e1d44dc4e2cb4703b03e35b57d92a64c/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:27.926751 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:27.931454 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab4f23b-cf48-44f7-bc5f-2f8bc4fbe53e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c09faa94cde4f448822a93efc5f7963, user_id=e1d44dc4e2cb4703b03e35b57d92a64c, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:27.934270 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab4f23b-cf48-44f7-bc5f-2f8bc4fbe53e admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:27.937858 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:27.939518 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f114c6f3-30f7-4326-916a-5a467b5b28cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a888d277382d4d78ac165147e7823736'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:27.940357 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f114c6f3-30f7-4326-916a-5a467b5b28cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a888d277382d4d78ac165147e7823736'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:27.941733 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f114c6f3-30f7-4326-916a-5a467b5b28cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a888d277382d4d78ac165147e7823736'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:27.949742 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f114c6f3-30f7-4326-916a-5a467b5b28cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a888d277382d4d78ac165147e7823736'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:27.951558 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 971/1935] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:07:27 2022] PUT /identity/v3/projects/8c09faa94cde4f448822a93efc5f7963/users/e1d44dc4e2cb4703b03e35b57d92a64c/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:07:27.956619 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab4f23b-cf48-44f7-bc5f-2f8bc4fbe53e admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:27.959121 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-8ab4f23b-cf48-44f7-bc5f-2f8bc4fbe53e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:27.963008 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f114c6f3-30f7-4326-916a-5a467b5b28cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a888d277382d4d78ac165147e7823736'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:27.986114 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 965/1936] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:07:27 2022] DELETE /identity/v3/users/a888d277382d4d78ac165147e7823736 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:07:28.041791 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab4f23b-cf48-44f7-bc5f-2f8bc4fbe53e admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:28.142919 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5768f1a-159e-4c14-be6a-22a5b5a53d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:28.144437 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5768f1a-159e-4c14-be6a-22a5b5a53d2a admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:28.144972 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5768f1a-159e-4c14-be6a-22a5b5a53d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:28.145753 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5768f1a-159e-4c14-be6a-22a5b5a53d2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:28.146830 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5768f1a-159e-4c14-be6a-22a5b5a53d2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:28.150029 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5768f1a-159e-4c14-be6a-22a5b5a53d2a admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:28.171646 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 972/1937] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 12:07:28.173044 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f114c6f3-30f7-4326-916a-5a467b5b28cc admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:28.190727 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f114c6f3-30f7-4326-916a-5a467b5b28cc admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:28.197815 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b536add-613a-4a89-b9b3-8b6443c89908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:28.198828 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b536add-613a-4a89-b9b3-8b6443c89908 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:28.199176 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b536add-613a-4a89-b9b3-8b6443c89908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:28.199529 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b536add-613a-4a89-b9b3-8b6443c89908 admin admin] PATH_INFO: `/v3/projects/8c09faa94cde4f448822a93efc5f7963/users/e1d44dc4e2cb4703b03e35b57d92a64c/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:28.202212 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b536add-613a-4a89-b9b3-8b6443c89908 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c09faa94cde4f448822a93efc5f7963, user_id=e1d44dc4e2cb4703b03e35b57d92a64c, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:28.214413 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b536add-613a-4a89-b9b3-8b6443c89908 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:28.221175 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 966/1938] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:07:28 2022] PUT /identity/v3/projects/8c09faa94cde4f448822a93efc5f7963/users/e1d44dc4e2cb4703b03e35b57d92a64c/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:07:28.232691 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc2e62-f520-47af-9ee8-e87e473a3655 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:28.232835 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc2e62-f520-47af-9ee8-e87e473a3655 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:28.232999 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc2e62-f520-47af-9ee8-e87e473a3655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:28.275485 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-83dc2e62-f520-47af-9ee8-e87e473a3655 None None] MFA Rules not processed for user `e1d44dc4e2cb4703b03e35b57d92a64c`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:28.277270 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-83dc2e62-f520-47af-9ee8-e87e473a3655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:28.355857 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b536add-613a-4a89-b9b3-8b6443c89908 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:28.358195 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-4b536add-613a-4a89-b9b3-8b6443c89908 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:28.413967 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 973/1939] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:28 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:07:28.429199 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc2e62-f520-47af-9ee8-e87e473a3655 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:28.430649 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-83dc2e62-f520-47af-9ee8-e87e473a3655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:28.459935 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b536add-613a-4a89-b9b3-8b6443c89908 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:28.465030 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:28.465503 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af74ac5d-42db-4613-a98e-471abc280021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:28.466379 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af74ac5d-42db-4613-a98e-471abc280021 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:28.466764 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af74ac5d-42db-4613-a98e-471abc280021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:28.466955 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af74ac5d-42db-4613-a98e-471abc280021 admin admin] PATH_INFO: `/v3/projects/809798260a4f4c2daf32a002b897451e` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:28.468642 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af74ac5d-42db-4613-a98e-471abc280021 admin admin] RBAC: Authorizing `identity:delete_project(project_id=809798260a4f4c2daf32a002b897451e)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:28.470660 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af74ac5d-42db-4613-a98e-471abc280021 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:28.502282 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc2e62-f520-47af-9ee8-e87e473a3655 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:28.506441 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436b40a8-d2f2-43fd-b731-8b78eab9a5df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:28.507328 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b40a8-d2f2-43fd-b731-8b78eab9a5df service cinder] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:28.507625 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b40a8-d2f2-43fd-b731-8b78eab9a5df service cinder] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:28.507897 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b40a8-d2f2-43fd-b731-8b78eab9a5df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:28.509726 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-436b40a8-d2f2-43fd-b731-8b78eab9a5df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:28.522919 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-af74ac5d-42db-4613-a98e-471abc280021 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '809798260a4f4c2daf32a002b897451e', 'request_id': 'req-af74ac5d-42db-4613-a98e-471abc280021'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:28.530628 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-af74ac5d-42db-4613-a98e-471abc280021 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '809798260a4f4c2daf32a002b897451e', 'request_id': 'req-af74ac5d-42db-4613-a98e-471abc280021'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:28.536599 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-af74ac5d-42db-4613-a98e-471abc280021 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '809798260a4f4c2daf32a002b897451e', 'request_id': 'req-af74ac5d-42db-4613-a98e-471abc280021'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:28.549299 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-af74ac5d-42db-4613-a98e-471abc280021 admin admin] The token cache is being invalidate because project 809798260a4f4c2daf32a002b897451e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:07:28.549588 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-af74ac5d-42db-4613-a98e-471abc280021 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:28.550278 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-af74ac5d-42db-4613-a98e-471abc280021 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:28.552249 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 967/1940] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:07:28 2022] DELETE /identity/v3/projects/809798260a4f4c2daf32a002b897451e => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:07:28.558688 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe748e-edeb-44ed-b4f2-79e4cb7a6143 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:28.558986 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe748e-edeb-44ed-b4f2-79e4cb7a6143 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:28.559267 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe748e-edeb-44ed-b4f2-79e4cb7a6143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:28.570146 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436b40a8-d2f2-43fd-b731-8b78eab9a5df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:28.571591 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436b40a8-d2f2-43fd-b731-8b78eab9a5df service cinder] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:28.576827 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-8bfe748e-edeb-44ed-b4f2-79e4cb7a6143 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:28.578032 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-8bfe748e-edeb-44ed-b4f2-79e4cb7a6143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:28.586043 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 974/1941] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:07:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 12:07:28.611946 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:28.652920 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 968/1942] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:07:28.661871 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205ebad-567f-4d0e-b03b-e5101692a063 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:28.661871 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205ebad-567f-4d0e-b03b-e5101692a063 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:28.662230 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205ebad-567f-4d0e-b03b-e5101692a063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:28.682787 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-a205ebad-567f-4d0e-b03b-e5101692a063 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:28.683937 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-a205ebad-567f-4d0e-b03b-e5101692a063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:28.692139 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 975/1943] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:07:28.696653 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe748e-edeb-44ed-b4f2-79e4cb7a6143 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:28.709241 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe748e-edeb-44ed-b4f2-79e4cb7a6143 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:28.715680 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ee3bd-ee55-4c3d-bb55-355098517c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:28.716614 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ee3bd-ee55-4c3d-bb55-355098517c98 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:28.717006 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ee3bd-ee55-4c3d-bb55-355098517c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:28.717395 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ee3bd-ee55-4c3d-bb55-355098517c98 admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:28.718280 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07ee3bd-ee55-4c3d-bb55-355098517c98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:07:28.718763 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07ee3bd-ee55-4c3d-bb55-355098517c98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:28.721803 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07ee3bd-ee55-4c3d-bb55-355098517c98 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:28.735093 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 969/1944] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:07:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:07:28.739526 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205ebad-567f-4d0e-b03b-e5101692a063 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:28.749460 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205ebad-567f-4d0e-b03b-e5101692a063 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:28.754499 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e2c63-4516-4906-858c-8a5b50805ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:28.755178 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e2c63-4516-4906-858c-8a5b50805ebc admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:28.755469 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e2c63-4516-4906-858c-8a5b50805ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:28.755957 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e2c63-4516-4906-858c-8a5b50805ebc admin admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:28.769837 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34e2c63-4516-4906-858c-8a5b50805ebc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:28.771977 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34e2c63-4516-4906-858c-8a5b50805ebc admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:28.818184 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 976/1945] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:07:28 2022] POST /identity/v3/projects => generated 377 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:07:28.822330 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ee3bd-ee55-4c3d-bb55-355098517c98 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:28.836897 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ee3bd-ee55-4c3d-bb55-355098517c98 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:28.908936 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b8ab49-d2b9-4c4b-8d73-7add17cdc533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:28.909896 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b8ab49-d2b9-4c4b-8d73-7add17cdc533 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:28.910186 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b8ab49-d2b9-4c4b-8d73-7add17cdc533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:28.910457 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b8ab49-d2b9-4c4b-8d73-7add17cdc533 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:28.911175 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b8ab49-d2b9-4c4b-8d73-7add17cdc533 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:28.913488 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b8ab49-d2b9-4c4b-8d73-7add17cdc533 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:28.953287 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 970/1946] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:07:28 2022] POST /identity/v3/users => generated 289 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 12:07:28.955660 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e2c63-4516-4906-858c-8a5b50805ebc admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:28.973598 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e2c63-4516-4906-858c-8a5b50805ebc admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:28.979172 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584ef53d-7473-4d19-9518-ac2c474828d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:28.980349 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ef53d-7473-4d19-9518-ac2c474828d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:28.988763 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ef53d-7473-4d19-9518-ac2c474828d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:28.989308 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ef53d-7473-4d19-9518-ac2c474828d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:28.990200 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584ef53d-7473-4d19-9518-ac2c474828d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:28.992958 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584ef53d-7473-4d19-9518-ac2c474828d4 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:29.004934 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 977/1947] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:07:29.009944 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b8ab49-d2b9-4c4b-8d73-7add17cdc533 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:29.020134 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b8ab49-d2b9-4c4b-8d73-7add17cdc533 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:29.025749 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce8613-4c25-419c-a376-da93f237a7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:29.026414 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce8613-4c25-419c-a376-da93f237a7d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:29.026695 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce8613-4c25-419c-a376-da93f237a7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:29.026974 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce8613-4c25-419c-a376-da93f237a7d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:29.027705 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce8613-4c25-419c-a376-da93f237a7d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:29.029373 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce8613-4c25-419c-a376-da93f237a7d4 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:29.040966 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 971/1948] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:07:29.045198 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584ef53d-7473-4d19-9518-ac2c474828d4 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:29.055785 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584ef53d-7473-4d19-9518-ac2c474828d4 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:29.060678 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48f0895-6f04-403b-bb36-a509173f056d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:29.061562 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f0895-6f04-403b-bb36-a509173f056d admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:29.061846 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f0895-6f04-403b-bb36-a509173f056d admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:29.062121 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f0895-6f04-403b-bb36-a509173f056d admin admin] PATH_INFO: `/v3/projects/a8671f01d1ab47eaaaae1b332fc798ea/users/9b9050dbbbcc44e88f93a9b191120e78/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:29.077448 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48f0895-6f04-403b-bb36-a509173f056d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8671f01d1ab47eaaaae1b332fc798ea, user_id=9b9050dbbbcc44e88f93a9b191120e78, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:29.080137 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48f0895-6f04-403b-bb36-a509173f056d admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:29.093938 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 978/1949] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:07:29 2022] PUT /identity/v3/projects/a8671f01d1ab47eaaaae1b332fc798ea/users/9b9050dbbbcc44e88f93a9b191120e78/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:07:29.105989 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d11d82-d8ad-419b-9a2f-9065309992ce None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:29.106283 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d11d82-d8ad-419b-9a2f-9065309992ce None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:29.106565 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d11d82-d8ad-419b-9a2f-9065309992ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:29.135098 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-93d11d82-d8ad-419b-9a2f-9065309992ce None None] MFA Rules not processed for user `9b9050dbbbcc44e88f93a9b191120e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:29.137022 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-93d11d82-d8ad-419b-9a2f-9065309992ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:29.211301 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 972/1950] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:07:29.226922 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48f0895-6f04-403b-bb36-a509173f056d admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:29.229882 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-f48f0895-6f04-403b-bb36-a509173f056d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:29.324396 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48f0895-6f04-403b-bb36-a509173f056d admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:29.330194 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0134a1e-a7c4-45fb-9725-c114f5e32729 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2f8b5040a048c5bf4eef36f2ecd678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:29.330896 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0134a1e-a7c4-45fb-9725-c114f5e32729 service glance] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:29.331183 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0134a1e-a7c4-45fb-9725-c114f5e32729 service glance] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:29.331464 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0134a1e-a7c4-45fb-9725-c114f5e32729 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:29.345454 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0134a1e-a7c4-45fb-9725-c114f5e32729 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:29.346746 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0134a1e-a7c4-45fb-9725-c114f5e32729 service glance] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:29.358025 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 979/1951] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:07:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:07:29.442859 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048a774-eb76-4cd4-a1b7-71a81bc6a847 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:29.443159 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048a774-eb76-4cd4-a1b7-71a81bc6a847 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:29.443442 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048a774-eb76-4cd4-a1b7-71a81bc6a847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:29.463241 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-d048a774-eb76-4cd4-a1b7-71a81bc6a847 None None] MFA Rules not processed for user `2ce251095f13444c9e96c0ba58ac47aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:29.464427 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-d048a774-eb76-4cd4-a1b7-71a81bc6a847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:29.487527 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:29.532621 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 973/1952] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:07:33.318799 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0134a1e-a7c4-45fb-9725-c114f5e32729 service glance] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:33.321079 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-c0134a1e-a7c4-45fb-9725-c114f5e32729 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:33.340592 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:33.380454 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0134a1e-a7c4-45fb-9725-c114f5e32729 service glance] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:33.388434 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e8d80-1492-41ca-996a-9ecb029b3f44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:33.389980 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e8d80-1492-41ca-996a-9ecb029b3f44 service cinder] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:33.390272 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e8d80-1492-41ca-996a-9ecb029b3f44 service cinder] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:33.390553 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e8d80-1492-41ca-996a-9ecb029b3f44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:33.392430 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-106e8d80-1492-41ca-996a-9ecb029b3f44 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:33.457548 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e8d80-1492-41ca-996a-9ecb029b3f44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:33.459038 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e8d80-1492-41ca-996a-9ecb029b3f44 service cinder] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:33.469927 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 980/1953] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:07:33 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:07:38.424219 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048a774-eb76-4cd4-a1b7-71a81bc6a847 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:38.425856 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-d048a774-eb76-4cd4-a1b7-71a81bc6a847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:38.549662 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048a774-eb76-4cd4-a1b7-71a81bc6a847 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:38.565596 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf99510-cd84-4623-b169-cd7aa8a8fe46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:38.568793 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf99510-cd84-4623-b169-cd7aa8a8fe46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:38.569557 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf99510-cd84-4623-b169-cd7aa8a8fe46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:38.571200 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf99510-cd84-4623-b169-cd7aa8a8fe46 admin admin] PATH_INFO: `/v3/users/eeb73fb8b2954f24a762c79c481bae53` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:38.575651 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf99510-cd84-4623-b169-cd7aa8a8fe46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eeb73fb8b2954f24a762c79c481bae53)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:38.580680 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf99510-cd84-4623-b169-cd7aa8a8fe46 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:38.694831 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ebf99510-cd84-4623-b169-cd7aa8a8fe46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eeb73fb8b2954f24a762c79c481bae53'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:38.695598 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ebf99510-cd84-4623-b169-cd7aa8a8fe46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eeb73fb8b2954f24a762c79c481bae53'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:38.696382 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ebf99510-cd84-4623-b169-cd7aa8a8fe46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eeb73fb8b2954f24a762c79c481bae53'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:38.704730 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ebf99510-cd84-4623-b169-cd7aa8a8fe46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eeb73fb8b2954f24a762c79c481bae53'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:38.720705 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ebf99510-cd84-4623-b169-cd7aa8a8fe46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eeb73fb8b2954f24a762c79c481bae53'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:38.747621 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 974/1954] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:07:38 2022] DELETE /identity/v3/users/eeb73fb8b2954f24a762c79c481bae53 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:07:38.751898 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdacfe8-a81e-41c6-9964-39c63db72fa7 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:38.752459 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdacfe8-a81e-41c6-9964-39c63db72fa7 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:38.752568 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdacfe8-a81e-41c6-9964-39c63db72fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:38.775168 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-efdacfe8-a81e-41c6-9964-39c63db72fa7 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:38.776532 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-efdacfe8-a81e-41c6-9964-39c63db72fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:38.857059 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 981/1955] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:07:38.867720 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf99510-cd84-4623-b169-cd7aa8a8fe46 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:38.869206 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ebf99510-cd84-4623-b169-cd7aa8a8fe46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:38.932606 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf99510-cd84-4623-b169-cd7aa8a8fe46 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:38.936591 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f32e5-5f51-41d2-8590-ea2da390fcd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:38.937278 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f32e5-5f51-41d2-8590-ea2da390fcd2 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:38.937558 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f32e5-5f51-41d2-8590-ea2da390fcd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:38.937829 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f32e5-5f51-41d2-8590-ea2da390fcd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:38.944754 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:38.950102 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13f32e5-5f51-41d2-8590-ea2da390fcd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:38.952875 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13f32e5-5f51-41d2-8590-ea2da390fcd2 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:38.964030 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 975/1956] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:07:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:07:39.628235 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdacfe8-a81e-41c6-9964-39c63db72fa7 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:39.629912 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-efdacfe8-a81e-41c6-9964-39c63db72fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:39.650432 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdacfe8-a81e-41c6-9964-39c63db72fa7 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:39.656078 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de3d6b-b6cd-496b-8763-09476f2769cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:39.657318 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de3d6b-b6cd-496b-8763-09476f2769cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:39.657597 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de3d6b-b6cd-496b-8763-09476f2769cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:39.657865 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de3d6b-b6cd-496b-8763-09476f2769cd admin admin] PATH_INFO: `/v3/projects/7dd50b952f5943e78fcd575dc47e7e2f` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:39.659336 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65de3d6b-b6cd-496b-8763-09476f2769cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dd50b952f5943e78fcd575dc47e7e2f)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:39.661576 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65de3d6b-b6cd-496b-8763-09476f2769cd admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:39.728127 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-65de3d6b-b6cd-496b-8763-09476f2769cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dd50b952f5943e78fcd575dc47e7e2f', 'request_id': 'req-65de3d6b-b6cd-496b-8763-09476f2769cd'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:39.738267 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-65de3d6b-b6cd-496b-8763-09476f2769cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dd50b952f5943e78fcd575dc47e7e2f', 'request_id': 'req-65de3d6b-b6cd-496b-8763-09476f2769cd'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:39.742946 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:39.745922 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-65de3d6b-b6cd-496b-8763-09476f2769cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dd50b952f5943e78fcd575dc47e7e2f', 'request_id': 'req-65de3d6b-b6cd-496b-8763-09476f2769cd'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:39.759944 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-65de3d6b-b6cd-496b-8763-09476f2769cd admin admin] The token cache is being invalidate because project 7dd50b952f5943e78fcd575dc47e7e2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:07:39.760591 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-65de3d6b-b6cd-496b-8763-09476f2769cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:39.763007 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-65de3d6b-b6cd-496b-8763-09476f2769cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:39.767731 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 982/1957] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:07:39 2022] DELETE /identity/v3/projects/7dd50b952f5943e78fcd575dc47e7e2f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:07:39.768882 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f32e5-5f51-41d2-8590-ea2da390fcd2 service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:39.779445 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f32e5-5f51-41d2-8590-ea2da390fcd2 service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:39.852473 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced81f38-d77b-4858-9888-53fba93ee688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:39.853372 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced81f38-d77b-4858-9888-53fba93ee688 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:39.853667 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced81f38-d77b-4858-9888-53fba93ee688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:39.853979 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced81f38-d77b-4858-9888-53fba93ee688 admin admin] PATH_INFO: `/v3/users/e1d44dc4e2cb4703b03e35b57d92a64c` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:39.855483 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced81f38-d77b-4858-9888-53fba93ee688 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1d44dc4e2cb4703b03e35b57d92a64c)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:39.857485 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced81f38-d77b-4858-9888-53fba93ee688 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:39.915707 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ced81f38-d77b-4858-9888-53fba93ee688 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1d44dc4e2cb4703b03e35b57d92a64c'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:39.916402 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ced81f38-d77b-4858-9888-53fba93ee688 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1d44dc4e2cb4703b03e35b57d92a64c'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:39.917019 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ced81f38-d77b-4858-9888-53fba93ee688 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1d44dc4e2cb4703b03e35b57d92a64c'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:39.924638 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ced81f38-d77b-4858-9888-53fba93ee688 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1d44dc4e2cb4703b03e35b57d92a64c'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:39.938173 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ced81f38-d77b-4858-9888-53fba93ee688 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1d44dc4e2cb4703b03e35b57d92a64c'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:39.958966 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 976/1958] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:07:39 2022] DELETE /identity/v3/users/e1d44dc4e2cb4703b03e35b57d92a64c => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:07:40.248911 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de3d6b-b6cd-496b-8763-09476f2769cd admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:40.250806 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-65de3d6b-b6cd-496b-8763-09476f2769cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:40.270254 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de3d6b-b6cd-496b-8763-09476f2769cd admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:40.336099 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee9bb4-631b-4dc4-aa96-05dddc4c8108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:40.337217 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee9bb4-631b-4dc4-aa96-05dddc4c8108 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:40.337511 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee9bb4-631b-4dc4-aa96-05dddc4c8108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:40.337900 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee9bb4-631b-4dc4-aa96-05dddc4c8108 admin admin] PATH_INFO: `/v3/projects/8c09faa94cde4f448822a93efc5f7963` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:40.339144 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ee9bb4-631b-4dc4-aa96-05dddc4c8108 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c09faa94cde4f448822a93efc5f7963)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:40.341143 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ee9bb4-631b-4dc4-aa96-05dddc4c8108 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:40.400110 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-f0ee9bb4-631b-4dc4-aa96-05dddc4c8108 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c09faa94cde4f448822a93efc5f7963', 'request_id': 'req-f0ee9bb4-631b-4dc4-aa96-05dddc4c8108'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:40.421807 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-f0ee9bb4-631b-4dc4-aa96-05dddc4c8108 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c09faa94cde4f448822a93efc5f7963', 'request_id': 'req-f0ee9bb4-631b-4dc4-aa96-05dddc4c8108'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:40.430636 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-f0ee9bb4-631b-4dc4-aa96-05dddc4c8108 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c09faa94cde4f448822a93efc5f7963', 'request_id': 'req-f0ee9bb4-631b-4dc4-aa96-05dddc4c8108'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:40.447141 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-f0ee9bb4-631b-4dc4-aa96-05dddc4c8108 admin admin] The token cache is being invalidate because project 8c09faa94cde4f448822a93efc5f7963 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:07:40.447361 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-f0ee9bb4-631b-4dc4-aa96-05dddc4c8108 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:40.448020 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-f0ee9bb4-631b-4dc4-aa96-05dddc4c8108 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:40.449897 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 983/1959] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:07:40 2022] DELETE /identity/v3/projects/8c09faa94cde4f448822a93efc5f7963 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:07:40.455979 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef826d17-8831-4996-abb7-0ad8907d4605 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:40.456300 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef826d17-8831-4996-abb7-0ad8907d4605 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:40.456582 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef826d17-8831-4996-abb7-0ad8907d4605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:40.481084 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-ef826d17-8831-4996-abb7-0ad8907d4605 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:40.482411 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ef826d17-8831-4996-abb7-0ad8907d4605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:40.551067 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 977/1960] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:07:40.561450 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4abad5-82a9-472a-a551-508916b0104e None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:40.562820 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4abad5-82a9-472a-a551-508916b0104e None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:40.563311 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4abad5-82a9-472a-a551-508916b0104e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:40.596741 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-5e4abad5-82a9-472a-a551-508916b0104e None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:40.598038 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-5e4abad5-82a9-472a-a551-508916b0104e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:40.611373 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 984/1961] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:07:40.615336 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef826d17-8831-4996-abb7-0ad8907d4605 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:40.628218 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef826d17-8831-4996-abb7-0ad8907d4605 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:40.634065 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda96db1-e04d-48ac-9ac5-91faf188b466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:40.634741 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda96db1-e04d-48ac-9ac5-91faf188b466 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:40.635025 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda96db1-e04d-48ac-9ac5-91faf188b466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:40.635295 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda96db1-e04d-48ac-9ac5-91faf188b466 admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:40.636024 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda96db1-e04d-48ac-9ac5-91faf188b466 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:07:40.636380 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda96db1-e04d-48ac-9ac5-91faf188b466 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:40.637982 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda96db1-e04d-48ac-9ac5-91faf188b466 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:40.648834 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:40.653074 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 978/1962] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:07:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:07:40.658349 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4abad5-82a9-472a-a551-508916b0104e None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:40.668815 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4abad5-82a9-472a-a551-508916b0104e None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:40.673669 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77564f03-9cb3-4bd0-a90b-13c0ce8a0ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:40.674356 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77564f03-9cb3-4bd0-a90b-13c0ce8a0ace admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:40.674646 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77564f03-9cb3-4bd0-a90b-13c0ce8a0ace admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:40.674927 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77564f03-9cb3-4bd0-a90b-13c0ce8a0ace admin admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:40.675653 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77564f03-9cb3-4bd0-a90b-13c0ce8a0ace admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:40.677950 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77564f03-9cb3-4bd0-a90b-13c0ce8a0ace admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:40.706131 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 985/1963] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:07:40 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 12:07:40.710497 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda96db1-e04d-48ac-9ac5-91faf188b466 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:40.720825 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda96db1-e04d-48ac-9ac5-91faf188b466 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:40.805533 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5506dcf1-7897-495a-9fde-3a89f5034066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:40.806870 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506dcf1-7897-495a-9fde-3a89f5034066 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:40.807162 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506dcf1-7897-495a-9fde-3a89f5034066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:40.807444 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506dcf1-7897-495a-9fde-3a89f5034066 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:40.808161 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5506dcf1-7897-495a-9fde-3a89f5034066 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:40.810130 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5506dcf1-7897-495a-9fde-3a89f5034066 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:40.837600 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 979/1964] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:07:40 2022] POST /identity/v3/users => generated 289 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 12:07:40.840284 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77564f03-9cb3-4bd0-a90b-13c0ce8a0ace admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:40.863460 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77564f03-9cb3-4bd0-a90b-13c0ce8a0ace admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:40.870387 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5fc3d8-48f2-4740-bbc3-9f8c05507879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:40.871421 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5fc3d8-48f2-4740-bbc3-9f8c05507879 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:40.871707 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5fc3d8-48f2-4740-bbc3-9f8c05507879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:40.872038 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5fc3d8-48f2-4740-bbc3-9f8c05507879 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:40.872860 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5fc3d8-48f2-4740-bbc3-9f8c05507879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:40.874858 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5fc3d8-48f2-4740-bbc3-9f8c05507879 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:40.886498 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 986/1965] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:07:40.891253 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5506dcf1-7897-495a-9fde-3a89f5034066 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:40.907005 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5506dcf1-7897-495a-9fde-3a89f5034066 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:40.924683 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04028e3-f215-4bc3-973f-00793106c9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:40.925880 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04028e3-f215-4bc3-973f-00793106c9bb admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:40.926339 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04028e3-f215-4bc3-973f-00793106c9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:40.926837 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04028e3-f215-4bc3-973f-00793106c9bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:40.928143 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04028e3-f215-4bc3-973f-00793106c9bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:40.930037 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04028e3-f215-4bc3-973f-00793106c9bb admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:40.942895 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 980/1966] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:07:40.947141 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5fc3d8-48f2-4740-bbc3-9f8c05507879 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:40.960898 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5fc3d8-48f2-4740-bbc3-9f8c05507879 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:40.966956 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6304f1-cb8a-4d76-a598-48517e16cdf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:40.969454 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6304f1-cb8a-4d76-a598-48517e16cdf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:40.969747 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6304f1-cb8a-4d76-a598-48517e16cdf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:40.970031 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6304f1-cb8a-4d76-a598-48517e16cdf3 admin admin] PATH_INFO: `/v3/projects/db0fcc1a0ab94a609e74e132bec0dc2c/users/a783ad310702416db7d0963e43d6f3b5/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:40.993290 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6304f1-cb8a-4d76-a598-48517e16cdf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db0fcc1a0ab94a609e74e132bec0dc2c, user_id=a783ad310702416db7d0963e43d6f3b5, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:40.996356 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6304f1-cb8a-4d76-a598-48517e16cdf3 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:41.025415 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 987/1967] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:07:40 2022] PUT /identity/v3/projects/db0fcc1a0ab94a609e74e132bec0dc2c/users/a783ad310702416db7d0963e43d6f3b5/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:07:41.036618 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52def03e-87c6-462a-9d6e-f0f0eb9eefff None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:41.036914 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52def03e-87c6-462a-9d6e-f0f0eb9eefff None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:41.037202 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52def03e-87c6-462a-9d6e-f0f0eb9eefff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:41.071680 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-52def03e-87c6-462a-9d6e-f0f0eb9eefff None None] MFA Rules not processed for user `a783ad310702416db7d0963e43d6f3b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:41.072936 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-52def03e-87c6-462a-9d6e-f0f0eb9eefff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:41.147903 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 981/1968] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:07:41.152418 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6304f1-cb8a-4d76-a598-48517e16cdf3 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:41.173677 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:41.231845 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6304f1-cb8a-4d76-a598-48517e16cdf3 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:41.236674 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bcbafd-84a0-435f-87f3-f6d42f54c761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:41.237499 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bcbafd-84a0-435f-87f3-f6d42f54c761 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:41.237611 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bcbafd-84a0-435f-87f3-f6d42f54c761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:41.237893 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bcbafd-84a0-435f-87f3-f6d42f54c761 admin admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:41.238600 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bcbafd-84a0-435f-87f3-f6d42f54c761 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:41.240712 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bcbafd-84a0-435f-87f3-f6d42f54c761 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:41.271652 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 988/1969] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:07:41 2022] POST /identity/v3/projects => generated 375 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:07:41.275874 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52def03e-87c6-462a-9d6e-f0f0eb9eefff None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:41.288875 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52def03e-87c6-462a-9d6e-f0f0eb9eefff None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:41.360065 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35127dff-2a0a-49cd-855e-ccb0f1fcdcc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:41.360989 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35127dff-2a0a-49cd-855e-ccb0f1fcdcc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:41.361343 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35127dff-2a0a-49cd-855e-ccb0f1fcdcc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:41.361691 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35127dff-2a0a-49cd-855e-ccb0f1fcdcc7 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:41.362494 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35127dff-2a0a-49cd-855e-ccb0f1fcdcc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:41.364541 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35127dff-2a0a-49cd-855e-ccb0f1fcdcc7 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:41.381984 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:41.391688 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 982/1970] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:07:41 2022] POST /identity/v3/users => generated 288 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 12:07:41.393010 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bcbafd-84a0-435f-87f3-f6d42f54c761 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:41.403843 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bcbafd-84a0-435f-87f3-f6d42f54c761 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:41.408803 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68ab4c-bbb4-4a95-ae68-5f9c3ecdb623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:41.409475 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68ab4c-bbb4-4a95-ae68-5f9c3ecdb623 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:41.409761 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68ab4c-bbb4-4a95-ae68-5f9c3ecdb623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:41.410045 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68ab4c-bbb4-4a95-ae68-5f9c3ecdb623 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:41.410772 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff68ab4c-bbb4-4a95-ae68-5f9c3ecdb623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:41.412538 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff68ab4c-bbb4-4a95-ae68-5f9c3ecdb623 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:41.430519 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 989/1971] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:07:41.434602 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35127dff-2a0a-49cd-855e-ccb0f1fcdcc7 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:41.444966 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35127dff-2a0a-49cd-855e-ccb0f1fcdcc7 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:41.462562 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f16c3-e5e2-4168-ba64-45c63dea29c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:41.463863 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f16c3-e5e2-4168-ba64-45c63dea29c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:41.463863 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f16c3-e5e2-4168-ba64-45c63dea29c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:41.464055 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f16c3-e5e2-4168-ba64-45c63dea29c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:41.465388 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2f16c3-e5e2-4168-ba64-45c63dea29c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:41.467506 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2f16c3-e5e2-4168-ba64-45c63dea29c7 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:41.480690 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 983/1972] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:07:41.484612 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68ab4c-bbb4-4a95-ae68-5f9c3ecdb623 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:41.496844 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68ab4c-bbb4-4a95-ae68-5f9c3ecdb623 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:41.503392 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c91e8d-f4eb-4afc-9862-64937074369e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:41.504338 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c91e8d-f4eb-4afc-9862-64937074369e admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:41.504624 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c91e8d-f4eb-4afc-9862-64937074369e admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:41.504899 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c91e8d-f4eb-4afc-9862-64937074369e admin admin] PATH_INFO: `/v3/projects/7ee0f2dcff674e509b830454d2359abf/users/1bb5f78aee0c43a183bea0cab7e32ad7/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:41.521522 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c91e8d-f4eb-4afc-9862-64937074369e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ee0f2dcff674e509b830454d2359abf, user_id=1bb5f78aee0c43a183bea0cab7e32ad7, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:41.524489 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c91e8d-f4eb-4afc-9862-64937074369e admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:41.540265 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 990/1973] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:07:41 2022] PUT /identity/v3/projects/7ee0f2dcff674e509b830454d2359abf/users/1bb5f78aee0c43a183bea0cab7e32ad7/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:07:41.550657 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca44a8-0a1a-4711-a51f-5746ef49103e None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:41.550958 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca44a8-0a1a-4711-a51f-5746ef49103e None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:41.551241 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca44a8-0a1a-4711-a51f-5746ef49103e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:41.586480 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-b3ca44a8-0a1a-4711-a51f-5746ef49103e None None] MFA Rules not processed for user `1bb5f78aee0c43a183bea0cab7e32ad7`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:41.587815 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b3ca44a8-0a1a-4711-a51f-5746ef49103e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:41.654552 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 984/1974] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:07:41.658999 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c91e8d-f4eb-4afc-9862-64937074369e admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:41.724939 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c91e8d-f4eb-4afc-9862-64937074369e admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:41.730093 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a621b49-40ef-478a-b9b3-291a18190a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:41.730768 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a621b49-40ef-478a-b9b3-291a18190a68 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:41.731055 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a621b49-40ef-478a-b9b3-291a18190a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:41.731335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a621b49-40ef-478a-b9b3-291a18190a68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:41.732040 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a621b49-40ef-478a-b9b3-291a18190a68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:41.735563 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a621b49-40ef-478a-b9b3-291a18190a68 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:41.768733 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 991/1975] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:07:41 2022] POST /identity/v3/projects => generated 375 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:07:41.772769 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca44a8-0a1a-4711-a51f-5746ef49103e None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:41.783860 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca44a8-0a1a-4711-a51f-5746ef49103e None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:41.843816 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a6a62-2c80-405b-90e0-4da96b679c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:41.844544 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a6a62-2c80-405b-90e0-4da96b679c20 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:41.844830 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a6a62-2c80-405b-90e0-4da96b679c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:41.845137 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a6a62-2c80-405b-90e0-4da96b679c20 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:41.845833 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6a6a62-2c80-405b-90e0-4da96b679c20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:41.847777 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6a6a62-2c80-405b-90e0-4da96b679c20 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:41.871403 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 985/1976] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:07:41 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 12:07:41.875503 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a621b49-40ef-478a-b9b3-291a18190a68 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:41.886325 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a621b49-40ef-478a-b9b3-291a18190a68 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:41.891058 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e7608-ceac-4030-951a-570fac609233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:41.891738 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e7608-ceac-4030-951a-570fac609233 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:41.892020 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e7608-ceac-4030-951a-570fac609233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:41.892397 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e7608-ceac-4030-951a-570fac609233 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:41.893129 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1e7608-ceac-4030-951a-570fac609233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:41.894738 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1e7608-ceac-4030-951a-570fac609233 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:41.909408 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 992/1977] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 12:07:41.910254 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a6a62-2c80-405b-90e0-4da96b679c20 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:41.921608 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a6a62-2c80-405b-90e0-4da96b679c20 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:41.936332 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef9e39-4e8d-4242-b425-4f0b945b6c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:41.937284 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef9e39-4e8d-4242-b425-4f0b945b6c15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:41.937786 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef9e39-4e8d-4242-b425-4f0b945b6c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:41.937916 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef9e39-4e8d-4242-b425-4f0b945b6c15 admin admin] PATH_INFO: `/v3/projects/9ad1b9daf14446529004c8d936051d6d/users/3e5c7183b51142a1bc6107216c362885/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:41.964195 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ef9e39-4e8d-4242-b425-4f0b945b6c15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ad1b9daf14446529004c8d936051d6d, user_id=3e5c7183b51142a1bc6107216c362885, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:41.967419 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ef9e39-4e8d-4242-b425-4f0b945b6c15 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:41.989372 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 986/1978] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:07:41 2022] PUT /identity/v3/projects/9ad1b9daf14446529004c8d936051d6d/users/3e5c7183b51142a1bc6107216c362885/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:07:41.992102 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e7608-ceac-4030-951a-570fac609233 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:42.002559 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e7608-ceac-4030-951a-570fac609233 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:42.054742 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:42.081334 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2e993-633d-4a61-accc-db21d9e8f4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:42.082221 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2e993-633d-4a61-accc-db21d9e8f4b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:42.082729 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2e993-633d-4a61-accc-db21d9e8f4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:42.083090 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2e993-633d-4a61-accc-db21d9e8f4b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:42.095947 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2e993-633d-4a61-accc-db21d9e8f4b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:42.101381 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2e993-633d-4a61-accc-db21d9e8f4b2 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:42.125438 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 993/1979] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:07:42.125641 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef9e39-4e8d-4242-b425-4f0b945b6c15 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:42.147422 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef9e39-4e8d-4242-b425-4f0b945b6c15 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:42.165477 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297489d3-91c0-4782-9501-cd383a5c2b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:42.165864 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297489d3-91c0-4782-9501-cd383a5c2b69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:42.166153 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297489d3-91c0-4782-9501-cd383a5c2b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:42.166578 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297489d3-91c0-4782-9501-cd383a5c2b69 admin admin] PATH_INFO: `/v3/projects/9ad1b9daf14446529004c8d936051d6d/users/3e5c7183b51142a1bc6107216c362885/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:42.169592 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297489d3-91c0-4782-9501-cd383a5c2b69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ad1b9daf14446529004c8d936051d6d, user_id=3e5c7183b51142a1bc6107216c362885, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:42.172909 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297489d3-91c0-4782-9501-cd383a5c2b69 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:42.217094 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 987/1980] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:07:42 2022] PUT /identity/v3/projects/9ad1b9daf14446529004c8d936051d6d/users/3e5c7183b51142a1bc6107216c362885/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:07:42.219884 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7a7c2-19d2-403c-af32-b967d74adfcd None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:42.220409 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7a7c2-19d2-403c-af32-b967d74adfcd None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:42.220869 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7a7c2-19d2-403c-af32-b967d74adfcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:42.255538 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-45c7a7c2-19d2-403c-af32-b967d74adfcd None None] MFA Rules not processed for user `3e5c7183b51142a1bc6107216c362885`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:42.257365 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-45c7a7c2-19d2-403c-af32-b967d74adfcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:42.347347 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 994/1981] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:42 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:07:42.361401 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297489d3-91c0-4782-9501-cd383a5c2b69 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:42.363095 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-297489d3-91c0-4782-9501-cd383a5c2b69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:42.398339 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:42.435066 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297489d3-91c0-4782-9501-cd383a5c2b69 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:42.438694 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee5981b-81d2-45b0-bf01-127878aa80f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:42.439349 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5981b-81d2-45b0-bf01-127878aa80f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:42.439631 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5981b-81d2-45b0-bf01-127878aa80f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:42.439904 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5981b-81d2-45b0-bf01-127878aa80f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:42.503909 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee5981b-81d2-45b0-bf01-127878aa80f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:42.505854 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee5981b-81d2-45b0-bf01-127878aa80f9 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:42.521436 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 988/1982] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:07:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:07:45.174553 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c7a7c2-19d2-403c-af32-b967d74adfcd None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:45.192160 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c7a7c2-19d2-403c-af32-b967d74adfcd None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:45.196780 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f290ceb9-d894-4de8-89dc-18456579d3e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:45.197707 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f290ceb9-d894-4de8-89dc-18456579d3e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:45.198185 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f290ceb9-d894-4de8-89dc-18456579d3e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:45.198616 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f290ceb9-d894-4de8-89dc-18456579d3e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:45.298403 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f290ceb9-d894-4de8-89dc-18456579d3e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:45.299865 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f290ceb9-d894-4de8-89dc-18456579d3e7 service cinder] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:45.310645 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 995/1983] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:07:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:07:46.083357 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee5981b-81d2-45b0-bf01-127878aa80f9 service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:46.093636 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee5981b-81d2-45b0-bf01-127878aa80f9 service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:46.097493 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d473eff6-3570-49ce-9591-02ed2a6f2e55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:46.098183 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473eff6-3570-49ce-9591-02ed2a6f2e55 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:46.098433 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473eff6-3570-49ce-9591-02ed2a6f2e55 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:46.098709 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473eff6-3570-49ce-9591-02ed2a6f2e55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:46.111449 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d473eff6-3570-49ce-9591-02ed2a6f2e55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:46.113205 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d473eff6-3570-49ce-9591-02ed2a6f2e55 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:46.139857 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 989/1984] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:07:46 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:07:51.204666 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f290ceb9-d894-4de8-89dc-18456579d3e7 service cinder] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:51.270521 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f290ceb9-d894-4de8-89dc-18456579d3e7 service cinder] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:51.276369 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c20a6-ba0c-4648-a6b6-22f759ff2a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:51.277349 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c20a6-ba0c-4648-a6b6-22f759ff2a63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:51.277700 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c20a6-ba0c-4648-a6b6-22f759ff2a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:51.278046 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c20a6-ba0c-4648-a6b6-22f759ff2a63 admin admin] PATH_INFO: `/v3/users/a783ad310702416db7d0963e43d6f3b5` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:51.279322 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884c20a6-ba0c-4648-a6b6-22f759ff2a63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a783ad310702416db7d0963e43d6f3b5)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:51.281431 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884c20a6-ba0c-4648-a6b6-22f759ff2a63 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:51.283174 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:51.338734 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-884c20a6-ba0c-4648-a6b6-22f759ff2a63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a783ad310702416db7d0963e43d6f3b5'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:51.345821 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-884c20a6-ba0c-4648-a6b6-22f759ff2a63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a783ad310702416db7d0963e43d6f3b5'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:51.346530 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-884c20a6-ba0c-4648-a6b6-22f759ff2a63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a783ad310702416db7d0963e43d6f3b5'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:51.347173 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-884c20a6-ba0c-4648-a6b6-22f759ff2a63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a783ad310702416db7d0963e43d6f3b5'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:51.359955 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-884c20a6-ba0c-4648-a6b6-22f759ff2a63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a783ad310702416db7d0963e43d6f3b5'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:51.373334 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 996/1985] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:07:51 2022] DELETE /identity/v3/users/a783ad310702416db7d0963e43d6f3b5 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:07:51.377938 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da52d07-ddfb-4f35-a68e-42bee63cb78f None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:51.378406 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da52d07-ddfb-4f35-a68e-42bee63cb78f None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:51.378514 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da52d07-ddfb-4f35-a68e-42bee63cb78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:51.399074 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-6da52d07-ddfb-4f35-a68e-42bee63cb78f None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:51.400207 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-6da52d07-ddfb-4f35-a68e-42bee63cb78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:51.489678 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 990/1986] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:07:51.499640 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c20a6-ba0c-4648-a6b6-22f759ff2a63 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:51.501024 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-884c20a6-ba0c-4648-a6b6-22f759ff2a63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:51.560315 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c20a6-ba0c-4648-a6b6-22f759ff2a63 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:51.563948 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aabd18e-29bc-4878-b5e6-8af8570c89a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:51.564635 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabd18e-29bc-4878-b5e6-8af8570c89a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:51.564918 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabd18e-29bc-4878-b5e6-8af8570c89a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:51.565194 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabd18e-29bc-4878-b5e6-8af8570c89a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:51.575140 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aabd18e-29bc-4878-b5e6-8af8570c89a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:51.576629 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aabd18e-29bc-4878-b5e6-8af8570c89a7 service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:51.588749 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 997/1987] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:07:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:07:52.240690 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da52d07-ddfb-4f35-a68e-42bee63cb78f None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:52.242579 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-6da52d07-ddfb-4f35-a68e-42bee63cb78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:52.258076 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da52d07-ddfb-4f35-a68e-42bee63cb78f None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:52.263032 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd36f6d-14c1-4603-840e-20beb33e17d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:52.263919 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd36f6d-14c1-4603-840e-20beb33e17d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:52.264234 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd36f6d-14c1-4603-840e-20beb33e17d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:52.264499 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd36f6d-14c1-4603-840e-20beb33e17d3 admin admin] PATH_INFO: `/v3/projects/db0fcc1a0ab94a609e74e132bec0dc2c` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:52.270198 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd36f6d-14c1-4603-840e-20beb33e17d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db0fcc1a0ab94a609e74e132bec0dc2c)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:52.272320 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd36f6d-14c1-4603-840e-20beb33e17d3 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:52.324974 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-4dd36f6d-14c1-4603-840e-20beb33e17d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db0fcc1a0ab94a609e74e132bec0dc2c', 'request_id': 'req-4dd36f6d-14c1-4603-840e-20beb33e17d3'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:52.334535 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-4dd36f6d-14c1-4603-840e-20beb33e17d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db0fcc1a0ab94a609e74e132bec0dc2c', 'request_id': 'req-4dd36f6d-14c1-4603-840e-20beb33e17d3'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:52.340524 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-4dd36f6d-14c1-4603-840e-20beb33e17d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db0fcc1a0ab94a609e74e132bec0dc2c', 'request_id': 'req-4dd36f6d-14c1-4603-840e-20beb33e17d3'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:52.341703 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:52.355378 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-4dd36f6d-14c1-4603-840e-20beb33e17d3 admin admin] The token cache is being invalidate because project db0fcc1a0ab94a609e74e132bec0dc2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:07:52.356104 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-4dd36f6d-14c1-4603-840e-20beb33e17d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:52.357393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-4dd36f6d-14c1-4603-840e-20beb33e17d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:52.358967 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 991/1988] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:07:52 2022] DELETE /identity/v3/projects/db0fcc1a0ab94a609e74e132bec0dc2c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:07:52.362930 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aabd18e-29bc-4878-b5e6-8af8570c89a7 service neutron] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:52.373005 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aabd18e-29bc-4878-b5e6-8af8570c89a7 service neutron] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:52.432145 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468b60d-840d-438d-a7e4-2091e83977e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:52.432954 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468b60d-840d-438d-a7e4-2091e83977e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:52.433242 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468b60d-840d-438d-a7e4-2091e83977e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:52.433595 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468b60d-840d-438d-a7e4-2091e83977e7 admin admin] PATH_INFO: `/v3/users/1bb5f78aee0c43a183bea0cab7e32ad7` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:52.435122 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2468b60d-840d-438d-a7e4-2091e83977e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bb5f78aee0c43a183bea0cab7e32ad7)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:52.437089 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2468b60d-840d-438d-a7e4-2091e83977e7 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:52.468019 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:52.515639 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-2468b60d-840d-438d-a7e4-2091e83977e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bb5f78aee0c43a183bea0cab7e32ad7'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:52.525616 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-2468b60d-840d-438d-a7e4-2091e83977e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bb5f78aee0c43a183bea0cab7e32ad7'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:52.528246 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-2468b60d-840d-438d-a7e4-2091e83977e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bb5f78aee0c43a183bea0cab7e32ad7'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:52.529226 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-2468b60d-840d-438d-a7e4-2091e83977e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bb5f78aee0c43a183bea0cab7e32ad7'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:52.551785 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-2468b60d-840d-438d-a7e4-2091e83977e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bb5f78aee0c43a183bea0cab7e32ad7'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:52.586918 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 998/1989] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:07:52 2022] DELETE /identity/v3/users/1bb5f78aee0c43a183bea0cab7e32ad7 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:07:53.039965 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd36f6d-14c1-4603-840e-20beb33e17d3 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:53.041834 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-4dd36f6d-14c1-4603-840e-20beb33e17d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:53.070890 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd36f6d-14c1-4603-840e-20beb33e17d3 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:53.155150 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2610e0-620d-45d6-b45c-07a22cc9863e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:53.158267 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2610e0-620d-45d6-b45c-07a22cc9863e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:53.158267 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2610e0-620d-45d6-b45c-07a22cc9863e admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:53.158521 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2610e0-620d-45d6-b45c-07a22cc9863e admin admin] PATH_INFO: `/v3/projects/7ee0f2dcff674e509b830454d2359abf` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:53.159749 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2610e0-620d-45d6-b45c-07a22cc9863e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ee0f2dcff674e509b830454d2359abf)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:53.162607 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2610e0-620d-45d6-b45c-07a22cc9863e admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:53.232374 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-7f2610e0-620d-45d6-b45c-07a22cc9863e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ee0f2dcff674e509b830454d2359abf', 'request_id': 'req-7f2610e0-620d-45d6-b45c-07a22cc9863e'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:53.244062 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-7f2610e0-620d-45d6-b45c-07a22cc9863e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ee0f2dcff674e509b830454d2359abf', 'request_id': 'req-7f2610e0-620d-45d6-b45c-07a22cc9863e'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:53.253281 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-7f2610e0-620d-45d6-b45c-07a22cc9863e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ee0f2dcff674e509b830454d2359abf', 'request_id': 'req-7f2610e0-620d-45d6-b45c-07a22cc9863e'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:53.270042 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-7f2610e0-620d-45d6-b45c-07a22cc9863e admin admin] The token cache is being invalidate because project 7ee0f2dcff674e509b830454d2359abf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:07:53.270622 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-7f2610e0-620d-45d6-b45c-07a22cc9863e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:53.271997 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-7f2610e0-620d-45d6-b45c-07a22cc9863e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:53.274699 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 992/1990] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:07:53 2022] DELETE /identity/v3/projects/7ee0f2dcff674e509b830454d2359abf => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:07:53.278450 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468b60d-840d-438d-a7e4-2091e83977e7 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:53.280593 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-2468b60d-840d-438d-a7e4-2091e83977e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:53.308711 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468b60d-840d-438d-a7e4-2091e83977e7 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:53.379790 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007b23b-25af-4bad-83d8-11d16761fe19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:53.380782 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007b23b-25af-4bad-83d8-11d16761fe19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:53.381078 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007b23b-25af-4bad-83d8-11d16761fe19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:53.381351 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007b23b-25af-4bad-83d8-11d16761fe19 admin admin] PATH_INFO: `/v3/users/3e5c7183b51142a1bc6107216c362885` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:53.382581 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9007b23b-25af-4bad-83d8-11d16761fe19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e5c7183b51142a1bc6107216c362885)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:53.384876 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9007b23b-25af-4bad-83d8-11d16761fe19 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:53.454000 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-9007b23b-25af-4bad-83d8-11d16761fe19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e5c7183b51142a1bc6107216c362885'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:53.463499 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-9007b23b-25af-4bad-83d8-11d16761fe19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e5c7183b51142a1bc6107216c362885'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:53.464471 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-9007b23b-25af-4bad-83d8-11d16761fe19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e5c7183b51142a1bc6107216c362885'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:53.465158 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-9007b23b-25af-4bad-83d8-11d16761fe19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e5c7183b51142a1bc6107216c362885'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:53.487756 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-9007b23b-25af-4bad-83d8-11d16761fe19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e5c7183b51142a1bc6107216c362885'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:53.504502 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 999/1991] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:07:53 2022] DELETE /identity/v3/users/3e5c7183b51142a1bc6107216c362885 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:07:53.821617 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2610e0-620d-45d6-b45c-07a22cc9863e admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:53.824494 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-7f2610e0-620d-45d6-b45c-07a22cc9863e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:53.847349 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2610e0-620d-45d6-b45c-07a22cc9863e admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:53.913511 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c8a48b-9147-4a00-b54b-eedb35eb2b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:53.914447 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8a48b-9147-4a00-b54b-eedb35eb2b4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:53.914735 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8a48b-9147-4a00-b54b-eedb35eb2b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:53.915017 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8a48b-9147-4a00-b54b-eedb35eb2b4f admin admin] PATH_INFO: `/v3/projects/9ad1b9daf14446529004c8d936051d6d` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:53.916310 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c8a48b-9147-4a00-b54b-eedb35eb2b4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ad1b9daf14446529004c8d936051d6d)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:53.918200 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c8a48b-9147-4a00-b54b-eedb35eb2b4f admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:53.952788 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:53.983312 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-25c8a48b-9147-4a00-b54b-eedb35eb2b4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ad1b9daf14446529004c8d936051d6d', 'request_id': 'req-25c8a48b-9147-4a00-b54b-eedb35eb2b4f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:53.991426 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-25c8a48b-9147-4a00-b54b-eedb35eb2b4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ad1b9daf14446529004c8d936051d6d', 'request_id': 'req-25c8a48b-9147-4a00-b54b-eedb35eb2b4f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:53.997722 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-25c8a48b-9147-4a00-b54b-eedb35eb2b4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ad1b9daf14446529004c8d936051d6d', 'request_id': 'req-25c8a48b-9147-4a00-b54b-eedb35eb2b4f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:54.010361 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-25c8a48b-9147-4a00-b54b-eedb35eb2b4f admin admin] The token cache is being invalidate because project 9ad1b9daf14446529004c8d936051d6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:07:54.010807 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-25c8a48b-9147-4a00-b54b-eedb35eb2b4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:54.011582 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-25c8a48b-9147-4a00-b54b-eedb35eb2b4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:54.013437 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 993/1992] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:07:53 2022] DELETE /identity/v3/projects/9ad1b9daf14446529004c8d936051d6d => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:07:54.019374 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df4d12-9b6d-4971-985a-ea28095e3594 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:54.019676 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df4d12-9b6d-4971-985a-ea28095e3594 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:54.019959 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df4d12-9b6d-4971-985a-ea28095e3594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:54.044740 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-83df4d12-9b6d-4971-985a-ea28095e3594 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:54.045975 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-83df4d12-9b6d-4971-985a-ea28095e3594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:54.061353 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:54.128330 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1000/1993] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:07:54.134238 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d2522-cfaf-41bb-a6da-5db86dd3e981 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:54.135575 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d2522-cfaf-41bb-a6da-5db86dd3e981 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:54.136115 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d2522-cfaf-41bb-a6da-5db86dd3e981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:54.159118 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-ce1d2522-cfaf-41bb-a6da-5db86dd3e981 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:54.160385 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ce1d2522-cfaf-41bb-a6da-5db86dd3e981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:54.169533 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 994/1994] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:07:54.173716 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df4d12-9b6d-4971-985a-ea28095e3594 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:54.183493 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df4d12-9b6d-4971-985a-ea28095e3594 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:54.188033 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f75c0d6-6506-4ed1-926f-847bf495ca93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:54.188728 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75c0d6-6506-4ed1-926f-847bf495ca93 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:54.189013 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75c0d6-6506-4ed1-926f-847bf495ca93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:54.189321 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75c0d6-6506-4ed1-926f-847bf495ca93 admin admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:54.190051 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f75c0d6-6506-4ed1-926f-847bf495ca93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:07:54.190359 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f75c0d6-6506-4ed1-926f-847bf495ca93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:54.191962 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f75c0d6-6506-4ed1-926f-847bf495ca93 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:54.203341 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1001/1995] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:07:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:07:54.207491 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d2522-cfaf-41bb-a6da-5db86dd3e981 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:54.217800 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d2522-cfaf-41bb-a6da-5db86dd3e981 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:54.222359 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34005f6-403d-4e84-b238-66466f57329c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:54.223034 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34005f6-403d-4e84-b238-66466f57329c admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:54.223315 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34005f6-403d-4e84-b238-66466f57329c admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:54.223589 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34005f6-403d-4e84-b238-66466f57329c admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:54.224318 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34005f6-403d-4e84-b238-66466f57329c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:54.227197 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34005f6-403d-4e84-b238-66466f57329c admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:54.254251 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 995/1996] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:07:54 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:07:54.258405 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f75c0d6-6506-4ed1-926f-847bf495ca93 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:54.268399 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f75c0d6-6506-4ed1-926f-847bf495ca93 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:54.325453 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3067efb-7189-4d1d-bae5-fe9927fdab9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:54.326141 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3067efb-7189-4d1d-bae5-fe9927fdab9f admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:54.326453 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3067efb-7189-4d1d-bae5-fe9927fdab9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:54.326733 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3067efb-7189-4d1d-bae5-fe9927fdab9f admin admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:54.327433 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3067efb-7189-4d1d-bae5-fe9927fdab9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:54.329422 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3067efb-7189-4d1d-bae5-fe9927fdab9f admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:54.349931 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1002/1997] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:07:54 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:07:54.353719 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34005f6-403d-4e84-b238-66466f57329c admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:54.364312 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34005f6-403d-4e84-b238-66466f57329c admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:54.369760 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f611704e-03e1-4872-817c-8eab77627b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:54.370441 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611704e-03e1-4872-817c-8eab77627b8d admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:54.370723 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611704e-03e1-4872-817c-8eab77627b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:54.371010 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611704e-03e1-4872-817c-8eab77627b8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:54.371741 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f611704e-03e1-4872-817c-8eab77627b8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:54.373370 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f611704e-03e1-4872-817c-8eab77627b8d admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:54.385697 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 996/1998] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:07:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 12:07:54.389684 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3067efb-7189-4d1d-bae5-fe9927fdab9f admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:54.399586 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3067efb-7189-4d1d-bae5-fe9927fdab9f admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:54.404192 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e951e0-9738-474a-a63b-82f4cfe2ddfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:54.404873 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e951e0-9738-474a-a63b-82f4cfe2ddfb admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:54.405162 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e951e0-9738-474a-a63b-82f4cfe2ddfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:54.405438 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e951e0-9738-474a-a63b-82f4cfe2ddfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:54.406191 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e951e0-9738-474a-a63b-82f4cfe2ddfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:54.407783 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e951e0-9738-474a-a63b-82f4cfe2ddfb admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:54.424332 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1003/1999] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:07:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:07:54.426182 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f611704e-03e1-4872-817c-8eab77627b8d admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:54.437548 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f611704e-03e1-4872-817c-8eab77627b8d admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:54.442263 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d6400d-8112-4fe4-89e7-957e25a34d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:54.443708 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6400d-8112-4fe4-89e7-957e25a34d35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:54.444005 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6400d-8112-4fe4-89e7-957e25a34d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:54.444323 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6400d-8112-4fe4-89e7-957e25a34d35 admin admin] PATH_INFO: `/v3/projects/ca0dedc1449649b4a9ad5e1dc60f8cdc/users/f7605df9ac1f4d2a98d1bdc47ea55332/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:54.459928 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d6400d-8112-4fe4-89e7-957e25a34d35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca0dedc1449649b4a9ad5e1dc60f8cdc, user_id=f7605df9ac1f4d2a98d1bdc47ea55332, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:54.462759 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d6400d-8112-4fe4-89e7-957e25a34d35 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:54.477514 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 997/2000] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:07:54 2022] PUT /identity/v3/projects/ca0dedc1449649b4a9ad5e1dc60f8cdc/users/f7605df9ac1f4d2a98d1bdc47ea55332/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:07:54.488818 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d6e8c-e430-45ba-ac2b-1d4bb8b73435 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:54.489114 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d6e8c-e430-45ba-ac2b-1d4bb8b73435 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:54.489397 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d6e8c-e430-45ba-ac2b-1d4bb8b73435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:54.516435 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-f62d6e8c-e430-45ba-ac2b-1d4bb8b73435 None None] MFA Rules not processed for user `f7605df9ac1f4d2a98d1bdc47ea55332`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:54.517573 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-f62d6e8c-e430-45ba-ac2b-1d4bb8b73435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:54.586300 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1004/2001] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:07:54.597504 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d6400d-8112-4fe4-89e7-957e25a34d35 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:54.599230 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-47d6400d-8112-4fe4-89e7-957e25a34d35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:54.632048 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d6e8c-e430-45ba-ac2b-1d4bb8b73435 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:54.633607 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-f62d6e8c-e430-45ba-ac2b-1d4bb8b73435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:54.658382 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:54.669236 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d6400d-8112-4fe4-89e7-957e25a34d35 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:54.672839 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d9fb53-460a-490e-9e45-25ec485025e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:54.673487 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d9fb53-460a-490e-9e45-25ec485025e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:54.673764 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d9fb53-460a-490e-9e45-25ec485025e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:54.674036 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d9fb53-460a-490e-9e45-25ec485025e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:54.682663 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d9fb53-460a-490e-9e45-25ec485025e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:54.684086 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d9fb53-460a-490e-9e45-25ec485025e1 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:54.692896 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 998/2002] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:07:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:07:54.706559 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d6e8c-e430-45ba-ac2b-1d4bb8b73435 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:54.711824 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9df5f-33a5-4db9-8dbb-b02024bd89f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:54.712750 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9df5f-33a5-4db9-8dbb-b02024bd89f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:54.713036 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9df5f-33a5-4db9-8dbb-b02024bd89f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:54.713312 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9df5f-33a5-4db9-8dbb-b02024bd89f5 admin admin] PATH_INFO: `/v3/users/9b9050dbbbcc44e88f93a9b191120e78` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:54.714517 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d9df5f-33a5-4db9-8dbb-b02024bd89f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b9050dbbbcc44e88f93a9b191120e78)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:54.716957 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d9df5f-33a5-4db9-8dbb-b02024bd89f5 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:54.719336 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d9fb53-460a-490e-9e45-25ec485025e1 service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:54.730340 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d9fb53-460a-490e-9e45-25ec485025e1 service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:54.735391 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81585ec-a9da-4efa-8875-5b4fff820cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:54.736292 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81585ec-a9da-4efa-8875-5b4fff820cc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:54.736573 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81585ec-a9da-4efa-8875-5b4fff820cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:54.736844 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81585ec-a9da-4efa-8875-5b4fff820cc8 admin admin] PATH_INFO: `/v3/users/f7605df9ac1f4d2a98d1bdc47ea55332` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:54.738031 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81585ec-a9da-4efa-8875-5b4fff820cc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7605df9ac1f4d2a98d1bdc47ea55332)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:54.739951 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81585ec-a9da-4efa-8875-5b4fff820cc8 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:54.764546 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-05d9df5f-33a5-4db9-8dbb-b02024bd89f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b9050dbbbcc44e88f93a9b191120e78'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:54.772230 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-05d9df5f-33a5-4db9-8dbb-b02024bd89f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b9050dbbbcc44e88f93a9b191120e78'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:54.772931 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-05d9df5f-33a5-4db9-8dbb-b02024bd89f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b9050dbbbcc44e88f93a9b191120e78'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:54.773840 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-05d9df5f-33a5-4db9-8dbb-b02024bd89f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b9050dbbbcc44e88f93a9b191120e78'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:54.788032 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-05d9df5f-33a5-4db9-8dbb-b02024bd89f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b9050dbbbcc44e88f93a9b191120e78'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:54.789138 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d81585ec-a9da-4efa-8875-5b4fff820cc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7605df9ac1f4d2a98d1bdc47ea55332'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:54.789822 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d81585ec-a9da-4efa-8875-5b4fff820cc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7605df9ac1f4d2a98d1bdc47ea55332'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:54.790464 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d81585ec-a9da-4efa-8875-5b4fff820cc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7605df9ac1f4d2a98d1bdc47ea55332'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:54.791807 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:54.798892 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d81585ec-a9da-4efa-8875-5b4fff820cc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7605df9ac1f4d2a98d1bdc47ea55332'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:54.801437 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1005/2003] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:07:54 2022] DELETE /identity/v3/users/9b9050dbbbcc44e88f93a9b191120e78 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:07:54.806302 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ea86c-25e6-4aa8-862e-e757775e1a12 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:54.806604 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ea86c-25e6-4aa8-862e-e757775e1a12 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:54.806885 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ea86c-25e6-4aa8-862e-e757775e1a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:54.812615 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d81585ec-a9da-4efa-8875-5b4fff820cc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7605df9ac1f4d2a98d1bdc47ea55332'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:54.824678 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-d09ea86c-25e6-4aa8-862e-e757775e1a12 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:54.825887 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-d09ea86c-25e6-4aa8-862e-e757775e1a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:54.827441 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 999/2004] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:07:54 2022] DELETE /identity/v3/users/f7605df9ac1f4d2a98d1bdc47ea55332 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:07:54.831765 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b88ac4-1a54-4f4f-848d-d046261eb76f None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:54.832054 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b88ac4-1a54-4f4f-848d-d046261eb76f None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:54.832358 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b88ac4-1a54-4f4f-848d-d046261eb76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:54.850243 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-41b88ac4-1a54-4f4f-848d-d046261eb76f None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:54.851590 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-41b88ac4-1a54-4f4f-848d-d046261eb76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:54.890508 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1006/2005] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:07:54.900810 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ea86c-25e6-4aa8-862e-e757775e1a12 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:54.902250 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-d09ea86c-25e6-4aa8-862e-e757775e1a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:54.910779 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1000/2006] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:07:54.920358 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b88ac4-1a54-4f4f-848d-d046261eb76f None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:54.921836 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-41b88ac4-1a54-4f4f-848d-d046261eb76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:54.946651 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:54.971230 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ea86c-25e6-4aa8-862e-e757775e1a12 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:54.975539 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea72a8-4bd7-4728-8305-fe0a4e570393 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:54.976264 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea72a8-4bd7-4728-8305-fe0a4e570393 service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:54.976550 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea72a8-4bd7-4728-8305-fe0a4e570393 service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:54.976829 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea72a8-4bd7-4728-8305-fe0a4e570393 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:54.982245 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b88ac4-1a54-4f4f-848d-d046261eb76f None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:54.986290 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a231a2e-cc6e-45c1-8303-7f93cbd3af4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:54.986947 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a231a2e-cc6e-45c1-8303-7f93cbd3af4c service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:54.987231 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a231a2e-cc6e-45c1-8303-7f93cbd3af4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:54.987511 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a231a2e-cc6e-45c1-8303-7f93cbd3af4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:54.987887 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ea72a8-4bd7-4728-8305-fe0a4e570393 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:54.989434 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ea72a8-4bd7-4728-8305-fe0a4e570393 service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:54.997999 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a231a2e-cc6e-45c1-8303-7f93cbd3af4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:54.999453 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a231a2e-cc6e-45c1-8303-7f93cbd3af4c service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:55.000940 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1007/2007] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:07:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 12:07:55.012350 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1001/2008] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:07:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 12:07:55.461408 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea72a8-4bd7-4728-8305-fe0a4e570393 service neutron] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:55.463300 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-23ea72a8-4bd7-4728-8305-fe0a4e570393 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:55.478124 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea72a8-4bd7-4728-8305-fe0a4e570393 service neutron] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:55.478996 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a231a2e-cc6e-45c1-8303-7f93cbd3af4c service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:55.480801 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-3a231a2e-cc6e-45c1-8303-7f93cbd3af4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:55.485987 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb923d-1079-433e-bc94-2693652a1e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:55.486880 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb923d-1079-433e-bc94-2693652a1e80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:55.487168 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb923d-1079-433e-bc94-2693652a1e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:55.488403 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb923d-1079-433e-bc94-2693652a1e80 admin admin] PATH_INFO: `/v3/projects/a8671f01d1ab47eaaaae1b332fc798ea` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:55.500038 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb923d-1079-433e-bc94-2693652a1e80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8671f01d1ab47eaaaae1b332fc798ea)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:55.502438 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb923d-1079-433e-bc94-2693652a1e80 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:55.513869 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a231a2e-cc6e-45c1-8303-7f93cbd3af4c service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:55.523238 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d737227a-a709-41ae-a9e2-bdfe7543a26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:55.525359 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737227a-a709-41ae-a9e2-bdfe7543a26d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:55.525728 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737227a-a709-41ae-a9e2-bdfe7543a26d admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:55.526080 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737227a-a709-41ae-a9e2-bdfe7543a26d admin admin] PATH_INFO: `/v3/projects/ca0dedc1449649b4a9ad5e1dc60f8cdc` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:55.527477 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d737227a-a709-41ae-a9e2-bdfe7543a26d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca0dedc1449649b4a9ad5e1dc60f8cdc)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:55.529939 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d737227a-a709-41ae-a9e2-bdfe7543a26d admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:55.565114 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-6bcb923d-1079-433e-bc94-2693652a1e80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8671f01d1ab47eaaaae1b332fc798ea', 'request_id': 'req-6bcb923d-1079-433e-bc94-2693652a1e80'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:55.575772 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-6bcb923d-1079-433e-bc94-2693652a1e80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8671f01d1ab47eaaaae1b332fc798ea', 'request_id': 'req-6bcb923d-1079-433e-bc94-2693652a1e80'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:55.587723 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-6bcb923d-1079-433e-bc94-2693652a1e80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8671f01d1ab47eaaaae1b332fc798ea', 'request_id': 'req-6bcb923d-1079-433e-bc94-2693652a1e80'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:55.594178 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d737227a-a709-41ae-a9e2-bdfe7543a26d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca0dedc1449649b4a9ad5e1dc60f8cdc', 'request_id': 'req-d737227a-a709-41ae-a9e2-bdfe7543a26d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:55.604268 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d737227a-a709-41ae-a9e2-bdfe7543a26d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca0dedc1449649b4a9ad5e1dc60f8cdc', 'request_id': 'req-d737227a-a709-41ae-a9e2-bdfe7543a26d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:55.607638 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-6bcb923d-1079-433e-bc94-2693652a1e80 admin admin] The token cache is being invalidate because project a8671f01d1ab47eaaaae1b332fc798ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:07:55.607983 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-6bcb923d-1079-433e-bc94-2693652a1e80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:55.608736 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-6bcb923d-1079-433e-bc94-2693652a1e80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:55.610598 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1008/2009] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:07:55 2022] DELETE /identity/v3/projects/a8671f01d1ab47eaaaae1b332fc798ea => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:07:55.613186 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:55.617202 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d737227a-a709-41ae-a9e2-bdfe7543a26d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca0dedc1449649b4a9ad5e1dc60f8cdc', 'request_id': 'req-d737227a-a709-41ae-a9e2-bdfe7543a26d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:55.617552 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3158fd0-f4a5-40d3-a2f0-7e0ae173cd9b None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:55.617838 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3158fd0-f4a5-40d3-a2f0-7e0ae173cd9b None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:55.618117 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3158fd0-f4a5-40d3-a2f0-7e0ae173cd9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:55.633938 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d737227a-a709-41ae-a9e2-bdfe7543a26d admin admin] The token cache is being invalidate because project ca0dedc1449649b4a9ad5e1dc60f8cdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:07:55.634457 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d737227a-a709-41ae-a9e2-bdfe7543a26d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:55.635112 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d737227a-a709-41ae-a9e2-bdfe7543a26d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:07:55.637458 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1002/2010] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:07:55 2022] DELETE /identity/v3/projects/ca0dedc1449649b4a9ad5e1dc60f8cdc => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:07:55.641770 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-c3158fd0-f4a5-40d3-a2f0-7e0ae173cd9b None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:55.643156 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-c3158fd0-f4a5-40d3-a2f0-7e0ae173cd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:55.748484 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1009/2011] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:07:55.757923 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6df9c-45ec-4650-8344-3252ed534be1 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:55.758276 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6df9c-45ec-4650-8344-3252ed534be1 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:55.758636 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6df9c-45ec-4650-8344-3252ed534be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:55.783529 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-48e6df9c-45ec-4650-8344-3252ed534be1 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:55.785961 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-48e6df9c-45ec-4650-8344-3252ed534be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:55.800543 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1003/2012] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:07:55.802069 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3158fd0-f4a5-40d3-a2f0-7e0ae173cd9b None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:55.814727 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3158fd0-f4a5-40d3-a2f0-7e0ae173cd9b None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:55.834892 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b8068-c467-44bd-bf04-e12a791047e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:55.835898 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b8068-c467-44bd-bf04-e12a791047e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:55.837122 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b8068-c467-44bd-bf04-e12a791047e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:55.837512 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b8068-c467-44bd-bf04-e12a791047e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:55.838397 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6b8068-c467-44bd-bf04-e12a791047e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:07:55.838816 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6b8068-c467-44bd-bf04-e12a791047e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:55.840705 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6b8068-c467-44bd-bf04-e12a791047e8 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:55.862080 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1010/2013] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:07:55.867700 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e6df9c-45ec-4650-8344-3252ed534be1 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:55.877555 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e6df9c-45ec-4650-8344-3252ed534be1 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:55.883672 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6066fa6-13ca-4448-bd0e-f5ed49a1c585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:55.884383 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6066fa6-13ca-4448-bd0e-f5ed49a1c585 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:55.884666 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6066fa6-13ca-4448-bd0e-f5ed49a1c585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:55.884942 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6066fa6-13ca-4448-bd0e-f5ed49a1c585 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:55.885632 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6066fa6-13ca-4448-bd0e-f5ed49a1c585 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:55.887552 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6066fa6-13ca-4448-bd0e-f5ed49a1c585 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:55.924870 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1004/2014] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:07:55 2022] POST /identity/v3/projects => generated 367 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:07:55.926119 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b8068-c467-44bd-bf04-e12a791047e8 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:55.938965 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b8068-c467-44bd-bf04-e12a791047e8 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:55.993343 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:07:56.007575 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14efea9-c4ba-43f4-9609-d0494bf80646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:56.008281 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14efea9-c4ba-43f4-9609-d0494bf80646 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:56.008569 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14efea9-c4ba-43f4-9609-d0494bf80646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:56.008856 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14efea9-c4ba-43f4-9609-d0494bf80646 admin admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:56.009525 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14efea9-c4ba-43f4-9609-d0494bf80646 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:56.011440 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14efea9-c4ba-43f4-9609-d0494bf80646 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:56.030696 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1011/2015] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:07:55 2022] POST /identity/v3/users => generated 284 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:07:56.035043 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6066fa6-13ca-4448-bd0e-f5ed49a1c585 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:56.046097 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6066fa6-13ca-4448-bd0e-f5ed49a1c585 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:56.050905 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064d4da4-61cc-4a1e-a208-a7bd62539db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:56.051562 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d4da4-61cc-4a1e-a208-a7bd62539db9 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:56.051845 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d4da4-61cc-4a1e-a208-a7bd62539db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:56.052118 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d4da4-61cc-4a1e-a208-a7bd62539db9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:56.053536 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064d4da4-61cc-4a1e-a208-a7bd62539db9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:56.055120 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064d4da4-61cc-4a1e-a208-a7bd62539db9 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:56.065699 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1005/2016] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:07:56.069994 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14efea9-c4ba-43f4-9609-d0494bf80646 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:56.080149 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14efea9-c4ba-43f4-9609-d0494bf80646 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:56.085154 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239fa5b-e292-4586-b7f4-109544bcb46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:56.085695 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239fa5b-e292-4586-b7f4-109544bcb46b admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:56.085981 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239fa5b-e292-4586-b7f4-109544bcb46b admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:56.086258 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239fa5b-e292-4586-b7f4-109544bcb46b admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:56.086983 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2239fa5b-e292-4586-b7f4-109544bcb46b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:56.088641 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2239fa5b-e292-4586-b7f4-109544bcb46b admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:56.100906 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1012/2017] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:07:56.105254 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064d4da4-61cc-4a1e-a208-a7bd62539db9 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:56.115860 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064d4da4-61cc-4a1e-a208-a7bd62539db9 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:56.120516 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6817fa-c0be-42c0-acf3-ffc475f60f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:56.121390 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6817fa-c0be-42c0-acf3-ffc475f60f39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:56.121678 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6817fa-c0be-42c0-acf3-ffc475f60f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:56.121957 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6817fa-c0be-42c0-acf3-ffc475f60f39 admin admin] PATH_INFO: `/v3/projects/6aec5969ef0b4fa3ba022900d1011146/users/0877f7b1e61d49f692cf7e1658b4f974/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:56.144898 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6817fa-c0be-42c0-acf3-ffc475f60f39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aec5969ef0b4fa3ba022900d1011146, user_id=0877f7b1e61d49f692cf7e1658b4f974, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:56.147792 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6817fa-c0be-42c0-acf3-ffc475f60f39 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:56.183414 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1006/2018] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:07:56 2022] PUT /identity/v3/projects/6aec5969ef0b4fa3ba022900d1011146/users/0877f7b1e61d49f692cf7e1658b4f974/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:07:56.185132 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fece0-ef7a-4e9c-a09c-e9759c32a955 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:56.185429 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fece0-ef7a-4e9c-a09c-e9759c32a955 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:56.185712 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fece0-ef7a-4e9c-a09c-e9759c32a955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:56.226968 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-4b1fece0-ef7a-4e9c-a09c-e9759c32a955 None None] MFA Rules not processed for user `0877f7b1e61d49f692cf7e1658b4f974`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:07:56.228317 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-4b1fece0-ef7a-4e9c-a09c-e9759c32a955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:56.310485 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1013/2019] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:07:56 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:07:56.323861 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6817fa-c0be-42c0-acf3-ffc475f60f39 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:07:56.325992 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ad6817fa-c0be-42c0-acf3-ffc475f60f39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:07:56.400058 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6817fa-c0be-42c0-acf3-ffc475f60f39 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:07:56.403755 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1cc1c7-1d2d-4421-85e2-01f20fdfc5b5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2f8b5040a048c5bf4eef36f2ecd678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:07:56.404456 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1cc1c7-1d2d-4421-85e2-01f20fdfc5b5 service glance] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:07:56.404761 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1cc1c7-1d2d-4421-85e2-01f20fdfc5b5 service glance] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:07:56.405025 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1cc1c7-1d2d-4421-85e2-01f20fdfc5b5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:07:56.415143 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1cc1c7-1d2d-4421-85e2-01f20fdfc5b5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:07:56.416673 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1cc1c7-1d2d-4421-85e2-01f20fdfc5b5 service glance] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:07:56.429365 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1007/2020] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:07:56 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:08:01.603474 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd464d6d-07d0-4909-b50b-14a4f1153813 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:01.603975 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd464d6d-07d0-4909-b50b-14a4f1153813 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:01.604073 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd464d6d-07d0-4909-b50b-14a4f1153813 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:01.605782 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1014/2021] 10.222.0.39 () {54 vars in 921 bytes} [Wed Jun 8 12:08:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:08:01.634930 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb686942-f7c0-4abc-9021-384c22813f6e None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:01.635439 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb686942-f7c0-4abc-9021-384c22813f6e None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:01.635551 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb686942-f7c0-4abc-9021-384c22813f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:01.658272 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-cb686942-f7c0-4abc-9021-384c22813f6e None None] MFA Rules not processed for user `e9009560a846414b849d42efa8625ff5`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:08:01.660218 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-cb686942-f7c0-4abc-9021-384c22813f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:08:01.669261 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd464d6d-07d0-4909-b50b-14a4f1153813 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:01.670951 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-fd464d6d-07d0-4909-b50b-14a4f1153813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:08:01.735547 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1008/2022] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Jun 8 12:08:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:08:01.747728 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb686942-f7c0-4abc-9021-384c22813f6e None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:01.749172 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-cb686942-f7c0-4abc-9021-384c22813f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:08:01.764674 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb686942-f7c0-4abc-9021-384c22813f6e None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:01.764925 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd464d6d-07d0-4909-b50b-14a4f1153813 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:01.770003 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c0949-40e7-454f-b4ee-f62f86c37df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:01.770901 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c0949-40e7-454f-b4ee-f62f86c37df6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:01.771775 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c4658-54b8-440c-b965-591af3342095 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9009560a846414b849d42efa8625ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:01.771914 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c0949-40e7-454f-b4ee-f62f86c37df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:01.772232 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c0949-40e7-454f-b4ee-f62f86c37df6 admin admin] PATH_INFO: `/v3/users/ed8d512bc7984e959510e80687f9ba74` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:01.773816 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c0949-40e7-454f-b4ee-f62f86c37df6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed8d512bc7984e959510e80687f9ba74)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:01.774038 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c4658-54b8-440c-b965-591af3342095 service placement] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:01.774693 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c4658-54b8-440c-b965-591af3342095 service placement] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:01.775023 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c4658-54b8-440c-b965-591af3342095 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:01.776240 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c0949-40e7-454f-b4ee-f62f86c37df6 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:01.792696 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0c4658-54b8-440c-b965-591af3342095 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:01.796000 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0c4658-54b8-440c-b965-591af3342095 service placement] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:01.809112 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1009/2023] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:08:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 12:08:01.835938 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-c08c0949-40e7-454f-b4ee-f62f86c37df6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed8d512bc7984e959510e80687f9ba74'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:01.845567 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-c08c0949-40e7-454f-b4ee-f62f86c37df6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed8d512bc7984e959510e80687f9ba74'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:01.846504 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-c08c0949-40e7-454f-b4ee-f62f86c37df6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed8d512bc7984e959510e80687f9ba74'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:01.847209 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-c08c0949-40e7-454f-b4ee-f62f86c37df6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed8d512bc7984e959510e80687f9ba74'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:01.849994 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:08:01.864269 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-c08c0949-40e7-454f-b4ee-f62f86c37df6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed8d512bc7984e959510e80687f9ba74'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:01.877871 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1015/2024] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:08:01 2022] DELETE /identity/v3/users/ed8d512bc7984e959510e80687f9ba74 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:08:02.060743 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c4658-54b8-440c-b965-591af3342095 service placement] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:02.079721 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c4658-54b8-440c-b965-591af3342095 service placement] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:02.090438 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:08:02.139210 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2516a8-f891-4e27-a867-54394d54a130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:02.140544 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2516a8-f891-4e27-a867-54394d54a130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:02.140837 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2516a8-f891-4e27-a867-54394d54a130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:02.141121 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2516a8-f891-4e27-a867-54394d54a130 admin admin] PATH_INFO: `/v3/projects/d57cfed8817e4ff9970a29b9cfbc8e11` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:02.142436 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2516a8-f891-4e27-a867-54394d54a130 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d57cfed8817e4ff9970a29b9cfbc8e11)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:02.144450 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2516a8-f891-4e27-a867-54394d54a130 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:02.191446 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-bf2516a8-f891-4e27-a867-54394d54a130 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd57cfed8817e4ff9970a29b9cfbc8e11', 'request_id': 'req-bf2516a8-f891-4e27-a867-54394d54a130'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:02.198743 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-bf2516a8-f891-4e27-a867-54394d54a130 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd57cfed8817e4ff9970a29b9cfbc8e11', 'request_id': 'req-bf2516a8-f891-4e27-a867-54394d54a130'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:02.204313 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-bf2516a8-f891-4e27-a867-54394d54a130 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd57cfed8817e4ff9970a29b9cfbc8e11', 'request_id': 'req-bf2516a8-f891-4e27-a867-54394d54a130'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:02.221702 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-bf2516a8-f891-4e27-a867-54394d54a130 admin admin] The token cache is being invalidate because project d57cfed8817e4ff9970a29b9cfbc8e11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:08:02.221995 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-bf2516a8-f891-4e27-a867-54394d54a130 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:02.222676 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-bf2516a8-f891-4e27-a867-54394d54a130 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:02.226284 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1010/2025] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:08:02 2022] DELETE /identity/v3/projects/d57cfed8817e4ff9970a29b9cfbc8e11 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:08:02.230910 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30adb78-fc6c-48c2-867d-d4ffbbef922e None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:02.231230 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30adb78-fc6c-48c2-867d-d4ffbbef922e None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:02.231512 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30adb78-fc6c-48c2-867d-d4ffbbef922e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:02.251033 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-f30adb78-fc6c-48c2-867d-d4ffbbef922e None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:08:02.252246 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-f30adb78-fc6c-48c2-867d-d4ffbbef922e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:08:02.314448 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1016/2026] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:08:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:08:02.322689 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546987d-35eb-4cdb-ad66-bef00d53857a None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:02.322978 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546987d-35eb-4cdb-ad66-bef00d53857a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:02.323646 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546987d-35eb-4cdb-ad66-bef00d53857a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:02.341345 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-e546987d-35eb-4cdb-ad66-bef00d53857a None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:08:02.342553 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-e546987d-35eb-4cdb-ad66-bef00d53857a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:08:02.351361 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1011/2027] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:08:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:08:02.355935 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30adb78-fc6c-48c2-867d-d4ffbbef922e None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:02.366697 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30adb78-fc6c-48c2-867d-d4ffbbef922e None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:02.371587 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00110f34-9e3e-433c-b770-d5d00c27707a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:02.372407 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00110f34-9e3e-433c-b770-d5d00c27707a admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:02.372695 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00110f34-9e3e-433c-b770-d5d00c27707a admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:02.372978 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00110f34-9e3e-433c-b770-d5d00c27707a admin admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:02.373709 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00110f34-9e3e-433c-b770-d5d00c27707a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:08:02.374017 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00110f34-9e3e-433c-b770-d5d00c27707a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:02.375635 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00110f34-9e3e-433c-b770-d5d00c27707a admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:02.388437 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1017/2028] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:08:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:08:02.392982 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e546987d-35eb-4cdb-ad66-bef00d53857a None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:02.403097 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e546987d-35eb-4cdb-ad66-bef00d53857a None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:02.407818 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fabf39-a74f-474a-b27b-056f2a06026f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:02.408527 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fabf39-a74f-474a-b27b-056f2a06026f admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:02.408810 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fabf39-a74f-474a-b27b-056f2a06026f admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:02.409084 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fabf39-a74f-474a-b27b-056f2a06026f admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:02.409775 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fabf39-a74f-474a-b27b-056f2a06026f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:02.412326 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fabf39-a74f-474a-b27b-056f2a06026f admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:02.443741 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1012/2029] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:08:02 2022] POST /identity/v3/projects => generated 367 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:08:02.444789 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00110f34-9e3e-433c-b770-d5d00c27707a admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:02.455589 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00110f34-9e3e-433c-b770-d5d00c27707a admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:02.525581 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac42b9-ef3b-45ff-8c2d-c77e9981e07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:02.526301 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac42b9-ef3b-45ff-8c2d-c77e9981e07f admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:02.526597 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac42b9-ef3b-45ff-8c2d-c77e9981e07f admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:02.526900 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac42b9-ef3b-45ff-8c2d-c77e9981e07f admin admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:02.527676 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac42b9-ef3b-45ff-8c2d-c77e9981e07f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:02.530021 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac42b9-ef3b-45ff-8c2d-c77e9981e07f admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:02.549800 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1018/2030] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:08:02 2022] POST /identity/v3/users => generated 284 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 12:08:02.553990 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fabf39-a74f-474a-b27b-056f2a06026f admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:02.564543 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fabf39-a74f-474a-b27b-056f2a06026f admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:02.570337 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117482a-2e94-4686-ac98-2778e61b4654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:02.571401 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117482a-2e94-4686-ac98-2778e61b4654 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:02.571694 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117482a-2e94-4686-ac98-2778e61b4654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:02.571974 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117482a-2e94-4686-ac98-2778e61b4654 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:02.573019 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3117482a-2e94-4686-ac98-2778e61b4654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:02.574651 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3117482a-2e94-4686-ac98-2778e61b4654 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:02.586404 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1013/2031] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:08:02.590839 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac42b9-ef3b-45ff-8c2d-c77e9981e07f admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:02.605460 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac42b9-ef3b-45ff-8c2d-c77e9981e07f admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:02.610579 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b2a48-f86b-48c9-81c1-8b592fca14ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:02.611448 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b2a48-f86b-48c9-81c1-8b592fca14ab admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:02.611766 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b2a48-f86b-48c9-81c1-8b592fca14ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:02.612794 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b2a48-f86b-48c9-81c1-8b592fca14ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:02.613533 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992b2a48-f86b-48c9-81c1-8b592fca14ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:02.615416 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992b2a48-f86b-48c9-81c1-8b592fca14ab admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:02.626812 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1019/2032] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:08:02.630814 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117482a-2e94-4686-ac98-2778e61b4654 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:02.642601 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117482a-2e94-4686-ac98-2778e61b4654 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:02.648773 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9397f9-8c1d-4b5e-a44e-645c7c546c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:02.649673 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9397f9-8c1d-4b5e-a44e-645c7c546c48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:02.649958 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9397f9-8c1d-4b5e-a44e-645c7c546c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:02.650235 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9397f9-8c1d-4b5e-a44e-645c7c546c48 admin admin] PATH_INFO: `/v3/projects/e42ef3dfef2240ebae20ddae36d933a9/users/641aa8a2aacf4bcdae069032813e4226/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:02.666474 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9397f9-8c1d-4b5e-a44e-645c7c546c48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e42ef3dfef2240ebae20ddae36d933a9, user_id=641aa8a2aacf4bcdae069032813e4226, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:02.669155 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9397f9-8c1d-4b5e-a44e-645c7c546c48 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:02.683609 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1014/2033] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:08:02 2022] PUT /identity/v3/projects/e42ef3dfef2240ebae20ddae36d933a9/users/641aa8a2aacf4bcdae069032813e4226/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:08:02.694015 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72933db-4f01-436c-a578-cead4e4f3d44 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:02.694329 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72933db-4f01-436c-a578-cead4e4f3d44 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:02.694608 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72933db-4f01-436c-a578-cead4e4f3d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:02.720991 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-b72933db-4f01-436c-a578-cead4e4f3d44 None None] MFA Rules not processed for user `641aa8a2aacf4bcdae069032813e4226`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:08:02.722190 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-b72933db-4f01-436c-a578-cead4e4f3d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:08:02.751805 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:08:02.791822 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1020/2034] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:08:02 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:08:02.796450 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9397f9-8c1d-4b5e-a44e-645c7c546c48 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:02.841427 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:08:02.862743 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9397f9-8c1d-4b5e-a44e-645c7c546c48 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:02.867697 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df7acb0-5bfd-43c8-b341-83be9e821275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:02.868405 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df7acb0-5bfd-43c8-b341-83be9e821275 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:02.868694 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df7acb0-5bfd-43c8-b341-83be9e821275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:02.868974 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df7acb0-5bfd-43c8-b341-83be9e821275 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:02.869674 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df7acb0-5bfd-43c8-b341-83be9e821275 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:02.871587 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df7acb0-5bfd-43c8-b341-83be9e821275 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:02.901499 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1015/2035] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:08:02 2022] POST /identity/v3/projects => generated 367 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:08:02.902631 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72933db-4f01-436c-a578-cead4e4f3d44 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:02.913389 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72933db-4f01-436c-a578-cead4e4f3d44 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:02.979880 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a4f8a2-414f-4c08-934f-8ee439f2d20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:02.980652 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a4f8a2-414f-4c08-934f-8ee439f2d20c admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:02.980937 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a4f8a2-414f-4c08-934f-8ee439f2d20c admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:02.981222 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a4f8a2-414f-4c08-934f-8ee439f2d20c admin admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:02.981929 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a4f8a2-414f-4c08-934f-8ee439f2d20c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:02.984004 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a4f8a2-414f-4c08-934f-8ee439f2d20c admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:03.009163 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1021/2036] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:08:02 2022] POST /identity/v3/users => generated 290 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 12:08:03.010662 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df7acb0-5bfd-43c8-b341-83be9e821275 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:03.022143 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df7acb0-5bfd-43c8-b341-83be9e821275 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:03.026897 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b9c5c2-59c1-435c-923e-42cdb89e1f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:03.027581 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9c5c2-59c1-435c-923e-42cdb89e1f26 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:03.027869 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9c5c2-59c1-435c-923e-42cdb89e1f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:03.028149 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9c5c2-59c1-435c-923e-42cdb89e1f26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:03.028912 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b9c5c2-59c1-435c-923e-42cdb89e1f26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:03.030528 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b9c5c2-59c1-435c-923e-42cdb89e1f26 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:03.044722 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1016/2037] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:08:03.049231 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a4f8a2-414f-4c08-934f-8ee439f2d20c admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:03.059220 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a4f8a2-414f-4c08-934f-8ee439f2d20c admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:03.063884 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0ffd5-2061-46af-83a1-e1ca47c5851d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:03.064816 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0ffd5-2061-46af-83a1-e1ca47c5851d admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:03.065117 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0ffd5-2061-46af-83a1-e1ca47c5851d admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:03.065393 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0ffd5-2061-46af-83a1-e1ca47c5851d admin admin] PATH_INFO: `/v3/projects/1dcfa38a0ed44dbb98d528ffaaffd3fd/users/5e711ba4c72c44198255a0ccfe2a8c1f/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:03.082389 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd0ffd5-2061-46af-83a1-e1ca47c5851d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dcfa38a0ed44dbb98d528ffaaffd3fd, user_id=5e711ba4c72c44198255a0ccfe2a8c1f, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:03.085827 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd0ffd5-2061-46af-83a1-e1ca47c5851d admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:03.099095 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1022/2038] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:08:03 2022] PUT /identity/v3/projects/1dcfa38a0ed44dbb98d528ffaaffd3fd/users/5e711ba4c72c44198255a0ccfe2a8c1f/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:08:03.103359 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b9c5c2-59c1-435c-923e-42cdb89e1f26 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:03.113772 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b9c5c2-59c1-435c-923e-42cdb89e1f26 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:03.177888 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a010df1-a12f-4ad4-bf49-2b66255832c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:03.178956 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a010df1-a12f-4ad4-bf49-2b66255832c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:03.179244 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a010df1-a12f-4ad4-bf49-2b66255832c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:03.179514 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a010df1-a12f-4ad4-bf49-2b66255832c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:03.180265 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a010df1-a12f-4ad4-bf49-2b66255832c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:03.181892 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a010df1-a12f-4ad4-bf49-2b66255832c0 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:03.191578 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1017/2039] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:08:03.196587 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0ffd5-2061-46af-83a1-e1ca47c5851d admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:03.207064 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0ffd5-2061-46af-83a1-e1ca47c5851d admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:03.212539 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b13328-c3d0-43c0-a978-dbb122500dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:03.213444 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b13328-c3d0-43c0-a978-dbb122500dcc admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:03.213725 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b13328-c3d0-43c0-a978-dbb122500dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:03.214006 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b13328-c3d0-43c0-a978-dbb122500dcc admin admin] PATH_INFO: `/v3/projects/1dcfa38a0ed44dbb98d528ffaaffd3fd/users/5e711ba4c72c44198255a0ccfe2a8c1f/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:03.215954 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b13328-c3d0-43c0-a978-dbb122500dcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dcfa38a0ed44dbb98d528ffaaffd3fd, user_id=5e711ba4c72c44198255a0ccfe2a8c1f, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:03.218663 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b13328-c3d0-43c0-a978-dbb122500dcc admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:03.229881 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1023/2040] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:08:03 2022] PUT /identity/v3/projects/1dcfa38a0ed44dbb98d528ffaaffd3fd/users/5e711ba4c72c44198255a0ccfe2a8c1f/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:08:03.240509 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49afe1-851b-45cc-a066-18a1923d7921 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:03.240862 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49afe1-851b-45cc-a066-18a1923d7921 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:03.241131 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49afe1-851b-45cc-a066-18a1923d7921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:03.273031 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-4f49afe1-851b-45cc-a066-18a1923d7921 None None] MFA Rules not processed for user `5e711ba4c72c44198255a0ccfe2a8c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:08:03.274346 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-4f49afe1-851b-45cc-a066-18a1923d7921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:08:03.347523 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1018/2041] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:08:03 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:08:03.358923 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b13328-c3d0-43c0-a978-dbb122500dcc admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:03.360699 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-f9b13328-c3d0-43c0-a978-dbb122500dcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:08:03.421332 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b13328-c3d0-43c0-a978-dbb122500dcc admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:03.425982 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e32af5-8afc-4088-bc9f-765b5c19c1cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:03.426680 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e32af5-8afc-4088-bc9f-765b5c19c1cd service cinder] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:03.427000 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e32af5-8afc-4088-bc9f-765b5c19c1cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:03.427866 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e32af5-8afc-4088-bc9f-765b5c19c1cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:03.437605 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e32af5-8afc-4088-bc9f-765b5c19c1cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:03.439090 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e32af5-8afc-4088-bc9f-765b5c19c1cd service cinder] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:03.449636 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1024/2042] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:08:03 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:08:03.494917 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f49afe1-851b-45cc-a066-18a1923d7921 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:03.496341 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-4f49afe1-851b-45cc-a066-18a1923d7921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:08:03.511683 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f49afe1-851b-45cc-a066-18a1923d7921 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:03.515392 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a994e13e-006b-4e46-b912-440914cfcea9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:03.516055 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994e13e-006b-4e46-b912-440914cfcea9 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:03.516414 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994e13e-006b-4e46-b912-440914cfcea9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:03.516697 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994e13e-006b-4e46-b912-440914cfcea9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:03.558282 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:08:03.580096 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a994e13e-006b-4e46-b912-440914cfcea9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:03.582607 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a994e13e-006b-4e46-b912-440914cfcea9 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:03.593215 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1019/2043] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:08:03 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:08:07.088262 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e32af5-8afc-4088-bc9f-765b5c19c1cd service cinder] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:07.126250 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:08:07.168230 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e32af5-8afc-4088-bc9f-765b5c19c1cd service cinder] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:07.172746 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd022c-6e04-4f39-b62a-df26e2ee2460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:07.173805 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd022c-6e04-4f39-b62a-df26e2ee2460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:07.174291 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd022c-6e04-4f39-b62a-df26e2ee2460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:07.174579 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd022c-6e04-4f39-b62a-df26e2ee2460 admin admin] PATH_INFO: `/v3/users/641aa8a2aacf4bcdae069032813e4226` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:07.175782 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cd022c-6e04-4f39-b62a-df26e2ee2460 admin admin] RBAC: Authorizing `identity:delete_user(user_id=641aa8a2aacf4bcdae069032813e4226)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:07.178342 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cd022c-6e04-4f39-b62a-df26e2ee2460 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:07.231760 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-b2cd022c-6e04-4f39-b62a-df26e2ee2460 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '641aa8a2aacf4bcdae069032813e4226'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:07.238781 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-b2cd022c-6e04-4f39-b62a-df26e2ee2460 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '641aa8a2aacf4bcdae069032813e4226'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:07.239555 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-b2cd022c-6e04-4f39-b62a-df26e2ee2460 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '641aa8a2aacf4bcdae069032813e4226'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:07.240282 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-b2cd022c-6e04-4f39-b62a-df26e2ee2460 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '641aa8a2aacf4bcdae069032813e4226'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:07.260947 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-b2cd022c-6e04-4f39-b62a-df26e2ee2460 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '641aa8a2aacf4bcdae069032813e4226'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:07.273532 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1025/2044] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:08:07 2022] DELETE /identity/v3/users/641aa8a2aacf4bcdae069032813e4226 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:08:07.278504 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab1f05-e950-4de4-ba18-b7d3e51093f2 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:07.278970 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab1f05-e950-4de4-ba18-b7d3e51093f2 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:07.279060 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab1f05-e950-4de4-ba18-b7d3e51093f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:07.296985 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-c6ab1f05-e950-4de4-ba18-b7d3e51093f2 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:08:07.298169 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-c6ab1f05-e950-4de4-ba18-b7d3e51093f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:08:07.360247 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1020/2045] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:08:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:08:07.370365 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd022c-6e04-4f39-b62a-df26e2ee2460 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:07.371855 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-b2cd022c-6e04-4f39-b62a-df26e2ee2460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:08:07.438781 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd022c-6e04-4f39-b62a-df26e2ee2460 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:07.442795 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc0291-c480-48c6-a4f2-8cfbb411ccd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:07.443450 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc0291-c480-48c6-a4f2-8cfbb411ccd4 service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:07.443736 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc0291-c480-48c6-a4f2-8cfbb411ccd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:07.444544 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc0291-c480-48c6-a4f2-8cfbb411ccd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:07.454907 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdc0291-c480-48c6-a4f2-8cfbb411ccd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:07.456493 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdc0291-c480-48c6-a4f2-8cfbb411ccd4 service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:07.467337 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1026/2046] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:08:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:08:07.548888 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de66875-5fac-49e8-87fd-019c68ed460d None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:07.549180 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de66875-5fac-49e8-87fd-019c68ed460d None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:07.549816 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de66875-5fac-49e8-87fd-019c68ed460d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:07.569815 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-6de66875-5fac-49e8-87fd-019c68ed460d None None] MFA Rules not processed for user `d52efc21c66d4300a8a979d92dbfeb47`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:08:07.571256 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-6de66875-5fac-49e8-87fd-019c68ed460d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:08:07.637732 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1021/2047] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Jun 8 12:08:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:08:07.685134 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc0291-c480-48c6-a4f2-8cfbb411ccd4 service neutron] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:07.686645 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-4cdc0291-c480-48c6-a4f2-8cfbb411ccd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:08:07.750375 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:08:07.779783 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc0291-c480-48c6-a4f2-8cfbb411ccd4 service neutron] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:07.785554 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b49a5-09b1-4515-8593-4b2ac7927a4c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753bde6a72d64045abd3ad44b9b0de04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:07.786583 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b49a5-09b1-4515-8593-4b2ac7927a4c service swift] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:07.787045 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b49a5-09b1-4515-8593-4b2ac7927a4c service swift] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:07.787584 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b49a5-09b1-4515-8593-4b2ac7927a4c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:07.802817 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014b49a5-09b1-4515-8593-4b2ac7927a4c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:07.805588 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014b49a5-09b1-4515-8593-4b2ac7927a4c service swift] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:07.815535 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1027/2048] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Jun 8 12:08:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 12:08:08.005935 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de66875-5fac-49e8-87fd-019c68ed460d None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:08.007969 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-6de66875-5fac-49e8-87fd-019c68ed460d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:08:08.024069 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de66875-5fac-49e8-87fd-019c68ed460d None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:08.029136 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9fa96-1df3-4d8c-ac1d-8cfee2b9efb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:08.030017 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9fa96-1df3-4d8c-ac1d-8cfee2b9efb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:08.030302 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9fa96-1df3-4d8c-ac1d-8cfee2b9efb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:08.030580 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9fa96-1df3-4d8c-ac1d-8cfee2b9efb1 admin admin] PATH_INFO: `/v3/projects/e42ef3dfef2240ebae20ddae36d933a9` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:08.031956 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf9fa96-1df3-4d8c-ac1d-8cfee2b9efb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e42ef3dfef2240ebae20ddae36d933a9)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:08.034106 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf9fa96-1df3-4d8c-ac1d-8cfee2b9efb1 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:08.098465 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-8cf9fa96-1df3-4d8c-ac1d-8cfee2b9efb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e42ef3dfef2240ebae20ddae36d933a9', 'request_id': 'req-8cf9fa96-1df3-4d8c-ac1d-8cfee2b9efb1'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:08.108628 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-8cf9fa96-1df3-4d8c-ac1d-8cfee2b9efb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e42ef3dfef2240ebae20ddae36d933a9', 'request_id': 'req-8cf9fa96-1df3-4d8c-ac1d-8cfee2b9efb1'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:08.121407 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-8cf9fa96-1df3-4d8c-ac1d-8cfee2b9efb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e42ef3dfef2240ebae20ddae36d933a9', 'request_id': 'req-8cf9fa96-1df3-4d8c-ac1d-8cfee2b9efb1'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:08.134034 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-8cf9fa96-1df3-4d8c-ac1d-8cfee2b9efb1 admin admin] The token cache is being invalidate because project e42ef3dfef2240ebae20ddae36d933a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:08:08.134322 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-8cf9fa96-1df3-4d8c-ac1d-8cfee2b9efb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:08.134981 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-8cf9fa96-1df3-4d8c-ac1d-8cfee2b9efb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:08.136566 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1022/2049] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:08:08 2022] DELETE /identity/v3/projects/e42ef3dfef2240ebae20ddae36d933a9 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:08:08.140411 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b49a5-09b1-4515-8593-4b2ac7927a4c service swift] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:08.151283 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b49a5-09b1-4515-8593-4b2ac7927a4c service swift] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:08.219239 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c152f177-f839-47b7-b6ce-0aa0bf65e777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:08.220387 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152f177-f839-47b7-b6ce-0aa0bf65e777 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:08.220673 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152f177-f839-47b7-b6ce-0aa0bf65e777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:08.220951 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152f177-f839-47b7-b6ce-0aa0bf65e777 admin admin] PATH_INFO: `/v3/users/5e711ba4c72c44198255a0ccfe2a8c1f` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:08.222170 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c152f177-f839-47b7-b6ce-0aa0bf65e777 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e711ba4c72c44198255a0ccfe2a8c1f)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:08.224094 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c152f177-f839-47b7-b6ce-0aa0bf65e777 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:08.276820 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-c152f177-f839-47b7-b6ce-0aa0bf65e777 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e711ba4c72c44198255a0ccfe2a8c1f'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:08.284078 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-c152f177-f839-47b7-b6ce-0aa0bf65e777 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e711ba4c72c44198255a0ccfe2a8c1f'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:08.284919 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-c152f177-f839-47b7-b6ce-0aa0bf65e777 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e711ba4c72c44198255a0ccfe2a8c1f'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:08.285641 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-c152f177-f839-47b7-b6ce-0aa0bf65e777 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e711ba4c72c44198255a0ccfe2a8c1f'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:08.298569 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-c152f177-f839-47b7-b6ce-0aa0bf65e777 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e711ba4c72c44198255a0ccfe2a8c1f'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:08.315020 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1028/2050] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:08:08 2022] DELETE /identity/v3/users/5e711ba4c72c44198255a0ccfe2a8c1f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:08:08.398619 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90a0f2-25b4-49e5-b87a-5aa3d6d8a7ad None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:08.399120 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90a0f2-25b4-49e5-b87a-5aa3d6d8a7ad None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:08.399591 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90a0f2-25b4-49e5-b87a-5aa3d6d8a7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:08.407072 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:08:08.423172 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-6a90a0f2-25b4-49e5-b87a-5aa3d6d8a7ad None None] MFA Rules not processed for user `d52efc21c66d4300a8a979d92dbfeb47`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:08:08.424383 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-6a90a0f2-25b4-49e5-b87a-5aa3d6d8a7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:08:08.500024 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1023/2051] 10.222.0.39 () {58 vars in 967 bytes} [Wed Jun 8 12:08:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:08:08.514402 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c152f177-f839-47b7-b6ce-0aa0bf65e777 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:08.515946 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-c152f177-f839-47b7-b6ce-0aa0bf65e777 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:08:08.574620 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:08:08.604134 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c152f177-f839-47b7-b6ce-0aa0bf65e777 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:08.610494 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ccda1-9077-401d-9314-ead70278f825 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753bde6a72d64045abd3ad44b9b0de04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:08.611640 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ccda1-9077-401d-9314-ead70278f825 service swift] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:08.612247 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ccda1-9077-401d-9314-ead70278f825 service swift] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:08.612929 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ccda1-9077-401d-9314-ead70278f825 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:08.628074 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0ccda1-9077-401d-9314-ead70278f825 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:08.628074 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0ccda1-9077-401d-9314-ead70278f825 service swift] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:08.629931 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a90a0f2-25b4-49e5-b87a-5aa3d6d8a7ad None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:08.632337 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-6a90a0f2-25b4-49e5-b87a-5aa3d6d8a7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:08:08.642378 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1029/2052] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Jun 8 12:08:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 12:08:08.727030 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a90a0f2-25b4-49e5-b87a-5aa3d6d8a7ad None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:08.731974 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f6a0b-714a-4371-aefe-2fc7ce147986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:08.732911 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f6a0b-714a-4371-aefe-2fc7ce147986 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:08.733197 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f6a0b-714a-4371-aefe-2fc7ce147986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:08.733467 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f6a0b-714a-4371-aefe-2fc7ce147986 admin admin] PATH_INFO: `/v3/projects/1dcfa38a0ed44dbb98d528ffaaffd3fd` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:08.734637 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7f6a0b-714a-4371-aefe-2fc7ce147986 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dcfa38a0ed44dbb98d528ffaaffd3fd)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:08.736702 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7f6a0b-714a-4371-aefe-2fc7ce147986 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:08.789633 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1a7f6a0b-714a-4371-aefe-2fc7ce147986 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dcfa38a0ed44dbb98d528ffaaffd3fd', 'request_id': 'req-1a7f6a0b-714a-4371-aefe-2fc7ce147986'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:08.797728 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1a7f6a0b-714a-4371-aefe-2fc7ce147986 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dcfa38a0ed44dbb98d528ffaaffd3fd', 'request_id': 'req-1a7f6a0b-714a-4371-aefe-2fc7ce147986'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:08.804735 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1a7f6a0b-714a-4371-aefe-2fc7ce147986 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dcfa38a0ed44dbb98d528ffaaffd3fd', 'request_id': 'req-1a7f6a0b-714a-4371-aefe-2fc7ce147986'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:08.816963 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1a7f6a0b-714a-4371-aefe-2fc7ce147986 admin admin] The token cache is being invalidate because project 1dcfa38a0ed44dbb98d528ffaaffd3fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:08:08.817256 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1a7f6a0b-714a-4371-aefe-2fc7ce147986 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:08.818232 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1a7f6a0b-714a-4371-aefe-2fc7ce147986 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:08.820442 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1024/2053] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:08:08 2022] DELETE /identity/v3/projects/1dcfa38a0ed44dbb98d528ffaaffd3fd => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:08:08.825767 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544c9bc-a14d-4a90-905d-ff6478a2ccb4 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:08.826215 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544c9bc-a14d-4a90-905d-ff6478a2ccb4 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:08.826547 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544c9bc-a14d-4a90-905d-ff6478a2ccb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:08.846470 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-0544c9bc-a14d-4a90-905d-ff6478a2ccb4 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:08:08.847689 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-0544c9bc-a14d-4a90-905d-ff6478a2ccb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:08:08.906459 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a6034-6efe-4aa2-8bd4-665b46d77def None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:08.906757 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a6034-6efe-4aa2-8bd4-665b46d77def None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:08.907040 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a6034-6efe-4aa2-8bd4-665b46d77def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:08.916199 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1030/2054] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:08:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:08:08.923133 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901e138-95c3-4de9-ad9c-5ddb55698cf3 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:08.923517 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901e138-95c3-4de9-ad9c-5ddb55698cf3 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:08.923858 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901e138-95c3-4de9-ad9c-5ddb55698cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:08.935356 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-924a6034-6efe-4aa2-8bd4-665b46d77def None None] MFA Rules not processed for user `d52efc21c66d4300a8a979d92dbfeb47`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:08:08.936835 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-924a6034-6efe-4aa2-8bd4-665b46d77def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:08:08.946242 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-5901e138-95c3-4de9-ad9c-5ddb55698cf3 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:08:08.947531 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-5901e138-95c3-4de9-ad9c-5ddb55698cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:08:08.956070 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1031/2055] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:08:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:08:08.961177 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5901e138-95c3-4de9-ad9c-5ddb55698cf3 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:08.971019 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5901e138-95c3-4de9-ad9c-5ddb55698cf3 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:08.977630 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a199c0e-1c53-4bfd-bb8b-c42e6ec8fc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:08.978260 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:08:08.979783 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a199c0e-1c53-4bfd-bb8b-c42e6ec8fc4f admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:08.980341 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a199c0e-1c53-4bfd-bb8b-c42e6ec8fc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:08.980657 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a199c0e-1c53-4bfd-bb8b-c42e6ec8fc4f admin admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:08.981446 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a199c0e-1c53-4bfd-bb8b-c42e6ec8fc4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:08:08.981756 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a199c0e-1c53-4bfd-bb8b-c42e6ec8fc4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:08.984235 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a199c0e-1c53-4bfd-bb8b-c42e6ec8fc4f admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:08.997786 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1032/2056] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:08:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:08:09.002026 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a199c0e-1c53-4bfd-bb8b-c42e6ec8fc4f admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:09.012587 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a199c0e-1c53-4bfd-bb8b-c42e6ec8fc4f admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:09.013285 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1025/2057] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Jun 8 12:08:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:08:09.019484 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e43ff2-bba2-4699-83f6-654d33526c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:09.020186 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e43ff2-bba2-4699-83f6-654d33526c62 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:09.020544 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e43ff2-bba2-4699-83f6-654d33526c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:09.020785 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e43ff2-bba2-4699-83f6-654d33526c62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:09.021577 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e43ff2-bba2-4699-83f6-654d33526c62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:09.024209 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e43ff2-bba2-4699-83f6-654d33526c62 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:09.025971 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a6034-6efe-4aa2-8bd4-665b46d77def None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:09.027703 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-924a6034-6efe-4aa2-8bd4-665b46d77def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:08:09.058534 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1033/2058] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:08:09 2022] POST /identity/v3/projects => generated 367 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 12:08:09.062610 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e43ff2-bba2-4699-83f6-654d33526c62 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:09.120057 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a6034-6efe-4aa2-8bd4-665b46d77def None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:09.130446 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e43ff2-bba2-4699-83f6-654d33526c62 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:09.135915 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc1ff6-f35a-407d-90e0-1a3951e27dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:09.136615 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc1ff6-f35a-407d-90e0-1a3951e27dcf admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:09.136895 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc1ff6-f35a-407d-90e0-1a3951e27dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:09.137199 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc1ff6-f35a-407d-90e0-1a3951e27dcf admin admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:09.137875 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc1ff6-f35a-407d-90e0-1a3951e27dcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:09.139823 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc1ff6-f35a-407d-90e0-1a3951e27dcf admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:09.165027 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1034/2059] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:08:09 2022] POST /identity/v3/users => generated 284 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 12:08:09.166204 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc1ff6-f35a-407d-90e0-1a3951e27dcf admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:09.176077 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc1ff6-f35a-407d-90e0-1a3951e27dcf admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:09.181606 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e198e7-ab89-4af5-a9ad-24bf73a57c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:09.182277 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e198e7-ab89-4af5-a9ad-24bf73a57c7d admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:09.182557 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e198e7-ab89-4af5-a9ad-24bf73a57c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:09.182831 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e198e7-ab89-4af5-a9ad-24bf73a57c7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:09.183568 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e198e7-ab89-4af5-a9ad-24bf73a57c7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:09.185268 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e198e7-ab89-4af5-a9ad-24bf73a57c7d admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:09.189277 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc95c3b7-8c54-4063-9236-d73b7ac58f0f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753bde6a72d64045abd3ad44b9b0de04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:09.189879 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95c3b7-8c54-4063-9236-d73b7ac58f0f service swift] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:09.190164 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95c3b7-8c54-4063-9236-d73b7ac58f0f service swift] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:09.190446 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95c3b7-8c54-4063-9236-d73b7ac58f0f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:09.200569 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1035/2060] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:08:09.201641 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e198e7-ab89-4af5-a9ad-24bf73a57c7d admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:09.211916 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e198e7-ab89-4af5-a9ad-24bf73a57c7d admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:09.216653 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb30c5e1-642a-4a3c-aea4-6bb4f94a22e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:09.217307 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30c5e1-642a-4a3c-aea4-6bb4f94a22e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:09.217593 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30c5e1-642a-4a3c-aea4-6bb4f94a22e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:09.217869 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30c5e1-642a-4a3c-aea4-6bb4f94a22e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:09.218591 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb30c5e1-642a-4a3c-aea4-6bb4f94a22e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:09.220203 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb30c5e1-642a-4a3c-aea4-6bb4f94a22e0 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:09.234694 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1036/2061] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 12:08:09.235839 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb30c5e1-642a-4a3c-aea4-6bb4f94a22e0 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:09.246044 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb30c5e1-642a-4a3c-aea4-6bb4f94a22e0 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:09.252565 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c3214-1b58-472e-94b7-c868f5699232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:09.253459 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c3214-1b58-472e-94b7-c868f5699232 admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:09.253747 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c3214-1b58-472e-94b7-c868f5699232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:09.254025 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c3214-1b58-472e-94b7-c868f5699232 admin admin] PATH_INFO: `/v3/projects/cba4c2e425d64be8bd83f72d13847930/users/46d9d2633f0b46a08489bb6b2769e6f7/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:09.265864 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc95c3b7-8c54-4063-9236-d73b7ac58f0f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:09.267523 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc95c3b7-8c54-4063-9236-d73b7ac58f0f service swift] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:09.268707 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:08:09.273334 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552c3214-1b58-472e-94b7-c868f5699232 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cba4c2e425d64be8bd83f72d13847930, user_id=46d9d2633f0b46a08489bb6b2769e6f7, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:09.276436 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1026/2062] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Jun 8 12:08:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 12:08:09.276795 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552c3214-1b58-472e-94b7-c868f5699232 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:09.293819 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1037/2063] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:08:09 2022] PUT /identity/v3/projects/cba4c2e425d64be8bd83f72d13847930/users/46d9d2633f0b46a08489bb6b2769e6f7/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:08:09.304698 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa63d2f-9e49-4a5f-9e4e-bb4f7231f99c None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:09.304973 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa63d2f-9e49-4a5f-9e4e-bb4f7231f99c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:09.305221 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa63d2f-9e49-4a5f-9e4e-bb4f7231f99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:09.336347 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-0fa63d2f-9e49-4a5f-9e4e-bb4f7231f99c None None] MFA Rules not processed for user `46d9d2633f0b46a08489bb6b2769e6f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:08:09.337814 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-0fa63d2f-9e49-4a5f-9e4e-bb4f7231f99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:08:09.353145 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:08:09.413499 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1027/2064] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:08:09 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:08:09.418525 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c3214-1b58-472e-94b7-c868f5699232 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:09.489051 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c3214-1b58-472e-94b7-c868f5699232 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:09.494420 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e3a4c0-9c15-48a9-8e7b-166d30571ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:09.495422 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3a4c0-9c15-48a9-8e7b-166d30571ea7 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:09.495739 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3a4c0-9c15-48a9-8e7b-166d30571ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:09.496042 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3a4c0-9c15-48a9-8e7b-166d30571ea7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:09.496776 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e3a4c0-9c15-48a9-8e7b-166d30571ea7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:09.498687 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e3a4c0-9c15-48a9-8e7b-166d30571ea7 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:09.526674 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1038/2065] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:08:09 2022] POST /identity/v3/projects => generated 367 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:08:09.531830 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa63d2f-9e49-4a5f-9e4e-bb4f7231f99c None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:09.547526 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa63d2f-9e49-4a5f-9e4e-bb4f7231f99c None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:09.618169 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2524c50-7c73-42ff-98ff-3d5efca5288c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:09.618793 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2524c50-7c73-42ff-98ff-3d5efca5288c admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:09.619074 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2524c50-7c73-42ff-98ff-3d5efca5288c admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:09.619376 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2524c50-7c73-42ff-98ff-3d5efca5288c admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:09.620087 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2524c50-7c73-42ff-98ff-3d5efca5288c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:09.622217 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2524c50-7c73-42ff-98ff-3d5efca5288c admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:09.625266 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7d143-1981-49ae-b345-752ef81f5e02 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:09.625681 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7d143-1981-49ae-b345-752ef81f5e02 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:09.626029 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7d143-1981-49ae-b345-752ef81f5e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:09.643457 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1028/2066] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:08:09 2022] POST /identity/v3/users => generated 290 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:08:09.646124 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-dee7d143-1981-49ae-b345-752ef81f5e02 None None] MFA Rules not processed for user `d52efc21c66d4300a8a979d92dbfeb47`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:08:09.647300 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2524c50-7c73-42ff-98ff-3d5efca5288c admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:09.647527 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-dee7d143-1981-49ae-b345-752ef81f5e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:08:09.669687 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2524c50-7c73-42ff-98ff-3d5efca5288c admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:09.680790 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5373a05a-bb91-4dea-8910-f4899ec0be66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:09.681974 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373a05a-bb91-4dea-8910-f4899ec0be66 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:09.682417 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373a05a-bb91-4dea-8910-f4899ec0be66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:09.682762 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373a05a-bb91-4dea-8910-f4899ec0be66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:09.684034 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5373a05a-bb91-4dea-8910-f4899ec0be66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:09.685886 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5373a05a-bb91-4dea-8910-f4899ec0be66 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:09.696926 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1029/2067] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 12:08:09.700956 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5373a05a-bb91-4dea-8910-f4899ec0be66 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:09.711119 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5373a05a-bb91-4dea-8910-f4899ec0be66 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:09.715857 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d216aa5-3fc8-4af7-8fce-c0cac78a831f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:09.716884 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d216aa5-3fc8-4af7-8fce-c0cac78a831f admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:09.717245 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d216aa5-3fc8-4af7-8fce-c0cac78a831f admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:09.717524 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d216aa5-3fc8-4af7-8fce-c0cac78a831f admin admin] PATH_INFO: `/v3/projects/4ce8dad08d99441b943ba337e74e88ff/users/dacfb09009c14e5fb1b713719b07eb50/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:09.718059 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1039/2068] 10.222.0.39 () {58 vars in 967 bytes} [Wed Jun 8 12:08:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:08:09.730993 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7d143-1981-49ae-b345-752ef81f5e02 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:09.733527 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d216aa5-3fc8-4af7-8fce-c0cac78a831f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ce8dad08d99441b943ba337e74e88ff, user_id=dacfb09009c14e5fb1b713719b07eb50, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:09.736199 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d216aa5-3fc8-4af7-8fce-c0cac78a831f admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:09.750901 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1030/2069] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:08:09 2022] PUT /identity/v3/projects/4ce8dad08d99441b943ba337e74e88ff/users/dacfb09009c14e5fb1b713719b07eb50/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:08:09.754601 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d216aa5-3fc8-4af7-8fce-c0cac78a831f admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:09.799265 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7d143-1981-49ae-b345-752ef81f5e02 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:09.817092 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d216aa5-3fc8-4af7-8fce-c0cac78a831f admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:09.818462 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:08:09.823580 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3405b219-0479-4e3e-aec2-112de3073ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:09.824413 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405b219-0479-4e3e-aec2-112de3073ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:09.824698 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405b219-0479-4e3e-aec2-112de3073ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:09.824971 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405b219-0479-4e3e-aec2-112de3073ba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:09.825698 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3405b219-0479-4e3e-aec2-112de3073ba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:09.827300 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3405b219-0479-4e3e-aec2-112de3073ba2 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:09.838706 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1031/2070] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 12:08:09.843744 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3405b219-0479-4e3e-aec2-112de3073ba2 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:09.856678 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3405b219-0479-4e3e-aec2-112de3073ba2 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:09.861931 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9338210d-052c-461a-a7d1-4ae66ce1520b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:09.862858 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338210d-052c-461a-a7d1-4ae66ce1520b admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:09.863294 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338210d-052c-461a-a7d1-4ae66ce1520b admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:09.863406 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338210d-052c-461a-a7d1-4ae66ce1520b admin admin] PATH_INFO: `/v3/projects/4ce8dad08d99441b943ba337e74e88ff/users/dacfb09009c14e5fb1b713719b07eb50/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:09.865501 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9338210d-052c-461a-a7d1-4ae66ce1520b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ce8dad08d99441b943ba337e74e88ff, user_id=dacfb09009c14e5fb1b713719b07eb50, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:09.868730 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9338210d-052c-461a-a7d1-4ae66ce1520b admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:09.870731 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522267b-8e8c-482d-b212-86f2da4af21d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753bde6a72d64045abd3ad44b9b0de04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:09.871285 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:08:09.871407 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522267b-8e8c-482d-b212-86f2da4af21d service swift] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:09.871649 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522267b-8e8c-482d-b212-86f2da4af21d service swift] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:09.871954 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522267b-8e8c-482d-b212-86f2da4af21d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:09.881531 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1032/2071] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:08:09 2022] PUT /identity/v3/projects/4ce8dad08d99441b943ba337e74e88ff/users/dacfb09009c14e5fb1b713719b07eb50/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:08:09.893109 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34fd068-a837-4685-b289-7efd479e41f6 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:09.893460 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34fd068-a837-4685-b289-7efd479e41f6 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:09.893821 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34fd068-a837-4685-b289-7efd479e41f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:09.920654 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-c34fd068-a837-4685-b289-7efd479e41f6 None None] MFA Rules not processed for user `dacfb09009c14e5fb1b713719b07eb50`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:08:09.921869 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-c34fd068-a837-4685-b289-7efd479e41f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:08:09.931790 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b522267b-8e8c-482d-b212-86f2da4af21d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:09.933471 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b522267b-8e8c-482d-b212-86f2da4af21d service swift] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:09.941528 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1040/2072] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Jun 8 12:08:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 08 12:08:09.993713 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1033/2073] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:08:09 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:08:10.005256 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522267b-8e8c-482d-b212-86f2da4af21d service swift] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:10.008021 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-b522267b-8e8c-482d-b212-86f2da4af21d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:08:10.067744 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522267b-8e8c-482d-b212-86f2da4af21d service swift] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:10.130997 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c4816c-7db9-45c7-8972-a361d0c90a9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:10.132626 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4816c-7db9-45c7-8972-a361d0c90a9f service cinder] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:10.132976 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4816c-7db9-45c7-8972-a361d0c90a9f service cinder] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:10.133429 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4816c-7db9-45c7-8972-a361d0c90a9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:10.144295 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c4816c-7db9-45c7-8972-a361d0c90a9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:10.146141 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c4816c-7db9-45c7-8972-a361d0c90a9f service cinder] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:10.164846 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1041/2074] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:08:10 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 12:08:10.260723 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34fd068-a837-4685-b289-7efd479e41f6 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:10.260723 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-c34fd068-a837-4685-b289-7efd479e41f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:08:10.275930 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34fd068-a837-4685-b289-7efd479e41f6 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:10.280517 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e5516c-4ac0-4f93-89fc-9753a24fb6d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:10.281199 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5516c-4ac0-4f93-89fc-9753a24fb6d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:10.281735 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5516c-4ac0-4f93-89fc-9753a24fb6d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:10.282007 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5516c-4ac0-4f93-89fc-9753a24fb6d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:10.347431 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e5516c-4ac0-4f93-89fc-9753a24fb6d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:10.348965 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e5516c-4ac0-4f93-89fc-9753a24fb6d9 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:10.358515 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1034/2075] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:08:10 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:08:13.091904 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c4816c-7db9-45c7-8972-a361d0c90a9f service cinder] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:13.093492 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-b4c4816c-7db9-45c7-8972-a361d0c90a9f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:08:13.123696 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:08:13.164324 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c4816c-7db9-45c7-8972-a361d0c90a9f service cinder] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:13.168922 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c91e4-3196-4179-a95d-fb3671527c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:13.169795 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c91e4-3196-4179-a95d-fb3671527c8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:13.170082 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c91e4-3196-4179-a95d-fb3671527c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:13.170358 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c91e4-3196-4179-a95d-fb3671527c8c admin admin] PATH_INFO: `/v3/users/2ce251095f13444c9e96c0ba58ac47aa` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:13.171538 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c91e4-3196-4179-a95d-fb3671527c8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ce251095f13444c9e96c0ba58ac47aa)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:13.173504 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c91e4-3196-4179-a95d-fb3671527c8c admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:13.218923 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-980c91e4-3196-4179-a95d-fb3671527c8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ce251095f13444c9e96c0ba58ac47aa'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:13.225837 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-980c91e4-3196-4179-a95d-fb3671527c8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ce251095f13444c9e96c0ba58ac47aa'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:13.226439 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-980c91e4-3196-4179-a95d-fb3671527c8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ce251095f13444c9e96c0ba58ac47aa'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:13.227053 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-980c91e4-3196-4179-a95d-fb3671527c8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ce251095f13444c9e96c0ba58ac47aa'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:13.238989 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-980c91e4-3196-4179-a95d-fb3671527c8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ce251095f13444c9e96c0ba58ac47aa'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:13.251704 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1042/2076] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:08:13 2022] DELETE /identity/v3/users/2ce251095f13444c9e96c0ba58ac47aa => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:08:13.257266 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791ecaf-ef76-490d-b62c-ec92e0cd526b None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:13.257740 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791ecaf-ef76-490d-b62c-ec92e0cd526b None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:13.257832 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791ecaf-ef76-490d-b62c-ec92e0cd526b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:13.274541 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-3791ecaf-ef76-490d-b62c-ec92e0cd526b None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:08:13.275756 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-3791ecaf-ef76-490d-b62c-ec92e0cd526b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:08:13.333133 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1035/2077] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:08:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:08:13.342605 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c91e4-3196-4179-a95d-fb3671527c8c admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:13.343997 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-980c91e4-3196-4179-a95d-fb3671527c8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:08:13.401332 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c91e4-3196-4179-a95d-fb3671527c8c admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:13.404973 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5735a1-bcfe-4ee6-9bf3-dac88fdce237 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:13.405626 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5735a1-bcfe-4ee6-9bf3-dac88fdce237 service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:13.405915 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5735a1-bcfe-4ee6-9bf3-dac88fdce237 service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:13.406198 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5735a1-bcfe-4ee6-9bf3-dac88fdce237 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:13.415785 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5735a1-bcfe-4ee6-9bf3-dac88fdce237 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:13.417253 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5735a1-bcfe-4ee6-9bf3-dac88fdce237 service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:13.426887 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1043/2078] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:08:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 12:08:13.597326 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3791ecaf-ef76-490d-b62c-ec92e0cd526b None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:13.598747 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-3791ecaf-ef76-490d-b62c-ec92e0cd526b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:08:13.614741 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3791ecaf-ef76-490d-b62c-ec92e0cd526b None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:13.620729 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575954fd-2843-48ab-aa87-7439b155ecee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:13.622038 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575954fd-2843-48ab-aa87-7439b155ecee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:13.622395 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575954fd-2843-48ab-aa87-7439b155ecee admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:13.622580 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575954fd-2843-48ab-aa87-7439b155ecee admin admin] PATH_INFO: `/v3/projects/19f7e415ffbf4c6fbf00e42efb7000f4` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:13.624321 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575954fd-2843-48ab-aa87-7439b155ecee admin admin] RBAC: Authorizing `identity:delete_project(project_id=19f7e415ffbf4c6fbf00e42efb7000f4)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:13.627008 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575954fd-2843-48ab-aa87-7439b155ecee admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:13.640181 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:08:13.682292 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-575954fd-2843-48ab-aa87-7439b155ecee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19f7e415ffbf4c6fbf00e42efb7000f4', 'request_id': 'req-575954fd-2843-48ab-aa87-7439b155ecee'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:13.689503 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-575954fd-2843-48ab-aa87-7439b155ecee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19f7e415ffbf4c6fbf00e42efb7000f4', 'request_id': 'req-575954fd-2843-48ab-aa87-7439b155ecee'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:13.696463 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-575954fd-2843-48ab-aa87-7439b155ecee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19f7e415ffbf4c6fbf00e42efb7000f4', 'request_id': 'req-575954fd-2843-48ab-aa87-7439b155ecee'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:13.707949 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-575954fd-2843-48ab-aa87-7439b155ecee admin admin] The token cache is being invalidate because project 19f7e415ffbf4c6fbf00e42efb7000f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:08:13.708257 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-575954fd-2843-48ab-aa87-7439b155ecee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:13.708891 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-575954fd-2843-48ab-aa87-7439b155ecee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:13.711872 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1036/2079] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:08:13 2022] DELETE /identity/v3/projects/19f7e415ffbf4c6fbf00e42efb7000f4 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:08:13.716500 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077c2d3-aca4-40a3-ab2b-7481eb66ae42 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:13.716845 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077c2d3-aca4-40a3-ab2b-7481eb66ae42 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:13.717051 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077c2d3-aca4-40a3-ab2b-7481eb66ae42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:13.735129 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-c077c2d3-aca4-40a3-ab2b-7481eb66ae42 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:08:13.736356 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-c077c2d3-aca4-40a3-ab2b-7481eb66ae42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:08:13.782747 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:08:13.805859 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1044/2080] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:08:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:08:13.813534 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b71ced-4f71-4715-8fbd-54e2956891df None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:13.813855 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b71ced-4f71-4715-8fbd-54e2956891df None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:13.814139 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b71ced-4f71-4715-8fbd-54e2956891df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:13.832962 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-29b71ced-4f71-4715-8fbd-54e2956891df None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:08:13.834203 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-29b71ced-4f71-4715-8fbd-54e2956891df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:08:13.842250 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1037/2081] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:08:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:08:13.846268 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077c2d3-aca4-40a3-ab2b-7481eb66ae42 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:13.856770 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077c2d3-aca4-40a3-ab2b-7481eb66ae42 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:13.861262 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e7cd5a-941b-40c0-9707-bb1e5e79471f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:13.861904 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7cd5a-941b-40c0-9707-bb1e5e79471f admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:13.862183 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7cd5a-941b-40c0-9707-bb1e5e79471f admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:13.862453 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7cd5a-941b-40c0-9707-bb1e5e79471f admin admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:13.863165 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e7cd5a-941b-40c0-9707-bb1e5e79471f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:08:13.863498 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e7cd5a-941b-40c0-9707-bb1e5e79471f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:13.865141 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e7cd5a-941b-40c0-9707-bb1e5e79471f admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:13.882108 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1045/2082] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:08:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:08:13.884918 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b71ced-4f71-4715-8fbd-54e2956891df None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:13.894142 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b71ced-4f71-4715-8fbd-54e2956891df None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:13.900111 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7606d8cf-2bfc-4a6c-bf31-250a1f814e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:13.900797 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606d8cf-2bfc-4a6c-bf31-250a1f814e44 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:13.901080 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606d8cf-2bfc-4a6c-bf31-250a1f814e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:13.901356 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606d8cf-2bfc-4a6c-bf31-250a1f814e44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:13.902048 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7606d8cf-2bfc-4a6c-bf31-250a1f814e44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:13.903937 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7606d8cf-2bfc-4a6c-bf31-250a1f814e44 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:13.930346 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1038/2083] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:08:13 2022] POST /identity/v3/projects => generated 389 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:08:13.934406 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e7cd5a-941b-40c0-9707-bb1e5e79471f admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:13.944983 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e7cd5a-941b-40c0-9707-bb1e5e79471f admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:14.000566 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef2fb85-dc81-4dfc-b3c4-badb6fc65487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:14.001231 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2fb85-dc81-4dfc-b3c4-badb6fc65487 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:14.001520 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2fb85-dc81-4dfc-b3c4-badb6fc65487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:14.001796 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2fb85-dc81-4dfc-b3c4-badb6fc65487 admin admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:14.002489 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef2fb85-dc81-4dfc-b3c4-badb6fc65487 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:14.004623 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef2fb85-dc81-4dfc-b3c4-badb6fc65487 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:14.028774 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1046/2084] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:08:13 2022] POST /identity/v3/users => generated 295 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:08:14.030166 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7606d8cf-2bfc-4a6c-bf31-250a1f814e44 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:14.041770 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7606d8cf-2bfc-4a6c-bf31-250a1f814e44 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:14.046338 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fda381-8a26-4322-a635-0bc094ee7745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:14.046999 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fda381-8a26-4322-a635-0bc094ee7745 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:14.047281 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fda381-8a26-4322-a635-0bc094ee7745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:14.047550 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fda381-8a26-4322-a635-0bc094ee7745 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:14.048296 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fda381-8a26-4322-a635-0bc094ee7745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:14.049878 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fda381-8a26-4322-a635-0bc094ee7745 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:14.066631 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1039/2085] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:08:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:08:14.067912 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef2fb85-dc81-4dfc-b3c4-badb6fc65487 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:14.078333 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef2fb85-dc81-4dfc-b3c4-badb6fc65487 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:14.083278 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4827c15-a92a-420a-a4cb-33aef4e4129f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:14.083944 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4827c15-a92a-420a-a4cb-33aef4e4129f admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:14.084280 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4827c15-a92a-420a-a4cb-33aef4e4129f admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:14.084645 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4827c15-a92a-420a-a4cb-33aef4e4129f admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:14.085294 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4827c15-a92a-420a-a4cb-33aef4e4129f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:14.086888 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4827c15-a92a-420a-a4cb-33aef4e4129f admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:14.102222 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1047/2086] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:08:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:08:14.105382 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fda381-8a26-4322-a635-0bc094ee7745 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:14.117379 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fda381-8a26-4322-a635-0bc094ee7745 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:14.122032 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2dfe6-6b40-42f5-b296-1b3d73e3cc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:14.122913 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2dfe6-6b40-42f5-b296-1b3d73e3cc46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:14.123195 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2dfe6-6b40-42f5-b296-1b3d73e3cc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:14.123469 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2dfe6-6b40-42f5-b296-1b3d73e3cc46 admin admin] PATH_INFO: `/v3/projects/41f3c98b9b964241b8dfc4066094b6a0/users/cf8614a108e34ed393a0d9eb71463eee/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:14.141255 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d2dfe6-6b40-42f5-b296-1b3d73e3cc46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41f3c98b9b964241b8dfc4066094b6a0, user_id=cf8614a108e34ed393a0d9eb71463eee, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:14.143951 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d2dfe6-6b40-42f5-b296-1b3d73e3cc46 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:14.158442 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1040/2087] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:08:14 2022] PUT /identity/v3/projects/41f3c98b9b964241b8dfc4066094b6a0/users/cf8614a108e34ed393a0d9eb71463eee/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:08:14.170370 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41108945-51fc-40cb-89ac-cc6b12251eff None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:14.170668 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41108945-51fc-40cb-89ac-cc6b12251eff None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:14.171036 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41108945-51fc-40cb-89ac-cc6b12251eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:14.200054 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-41108945-51fc-40cb-89ac-cc6b12251eff None None] MFA Rules not processed for user `cf8614a108e34ed393a0d9eb71463eee`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:08:14.201317 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-41108945-51fc-40cb-89ac-cc6b12251eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:08:14.270062 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1048/2088] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:08:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:08:14.282763 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2dfe6-6b40-42f5-b296-1b3d73e3cc46 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:14.285931 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-46d2dfe6-6b40-42f5-b296-1b3d73e3cc46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:08:14.350304 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2dfe6-6b40-42f5-b296-1b3d73e3cc46 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:14.355336 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121fd87e-953a-4bc1-b053-096a7f418671 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:14.360608 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fd87e-953a-4bc1-b053-096a7f418671 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:14.360908 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fd87e-953a-4bc1-b053-096a7f418671 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:14.361190 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fd87e-953a-4bc1-b053-096a7f418671 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:14.371095 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121fd87e-953a-4bc1-b053-096a7f418671 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:14.372594 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121fd87e-953a-4bc1-b053-096a7f418671 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:14.382860 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1041/2089] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:08:14 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 12:08:17.230005 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41108945-51fc-40cb-89ac-cc6b12251eff None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:17.231454 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-41108945-51fc-40cb-89ac-cc6b12251eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:08:17.277236 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:08:17.301020 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41108945-51fc-40cb-89ac-cc6b12251eff None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:17.305867 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f232e-74d2-492e-af07-b3336a672cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:17.306735 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f232e-74d2-492e-af07-b3336a672cbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:17.307020 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f232e-74d2-492e-af07-b3336a672cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:17.307298 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f232e-74d2-492e-af07-b3336a672cbd admin admin] PATH_INFO: `/v3/users/46d9d2633f0b46a08489bb6b2769e6f7` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:17.308512 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890f232e-74d2-492e-af07-b3336a672cbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=46d9d2633f0b46a08489bb6b2769e6f7)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:17.310441 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890f232e-74d2-492e-af07-b3336a672cbd admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:17.356196 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-890f232e-74d2-492e-af07-b3336a672cbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46d9d2633f0b46a08489bb6b2769e6f7'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:17.363150 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-890f232e-74d2-492e-af07-b3336a672cbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46d9d2633f0b46a08489bb6b2769e6f7'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:17.363941 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-890f232e-74d2-492e-af07-b3336a672cbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46d9d2633f0b46a08489bb6b2769e6f7'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:17.364555 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-890f232e-74d2-492e-af07-b3336a672cbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46d9d2633f0b46a08489bb6b2769e6f7'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:17.377072 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-890f232e-74d2-492e-af07-b3336a672cbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46d9d2633f0b46a08489bb6b2769e6f7'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:17.389944 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1049/2090] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:08:17 2022] DELETE /identity/v3/users/46d9d2633f0b46a08489bb6b2769e6f7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:08:17.394393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba0616-8983-4bd8-aeeb-bd7302e0db0d None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:17.394849 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba0616-8983-4bd8-aeeb-bd7302e0db0d None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:17.394955 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba0616-8983-4bd8-aeeb-bd7302e0db0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:17.411853 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-a9ba0616-8983-4bd8-aeeb-bd7302e0db0d None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:08:17.413245 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a9ba0616-8983-4bd8-aeeb-bd7302e0db0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:08:17.449218 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:08:17.477408 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1042/2091] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:08:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:08:17.487246 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f232e-74d2-492e-af07-b3336a672cbd admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:17.488655 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-890f232e-74d2-492e-af07-b3336a672cbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:08:17.550053 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f232e-74d2-492e-af07-b3336a672cbd admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:17.554371 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b1ad62-f134-4d18-b6ce-62d597166d0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:17.555022 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b1ad62-f134-4d18-b6ce-62d597166d0c service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:17.555307 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b1ad62-f134-4d18-b6ce-62d597166d0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:17.555590 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b1ad62-f134-4d18-b6ce-62d597166d0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:17.564683 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b1ad62-f134-4d18-b6ce-62d597166d0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:17.566126 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b1ad62-f134-4d18-b6ce-62d597166d0c service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:17.575647 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1050/2092] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:08:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:08:17.845099 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba0616-8983-4bd8-aeeb-bd7302e0db0d None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:17.846654 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a9ba0616-8983-4bd8-aeeb-bd7302e0db0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:08:17.860019 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba0616-8983-4bd8-aeeb-bd7302e0db0d None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:17.865117 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c667842d-a594-41a0-9bae-0829dbf4bdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:17.865926 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667842d-a594-41a0-9bae-0829dbf4bdd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:17.866203 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667842d-a594-41a0-9bae-0829dbf4bdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:17.866480 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667842d-a594-41a0-9bae-0829dbf4bdd4 admin admin] PATH_INFO: `/v3/projects/cba4c2e425d64be8bd83f72d13847930` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:17.867711 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c667842d-a594-41a0-9bae-0829dbf4bdd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cba4c2e425d64be8bd83f72d13847930)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:17.869684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c667842d-a594-41a0-9bae-0829dbf4bdd4 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:17.918259 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c667842d-a594-41a0-9bae-0829dbf4bdd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cba4c2e425d64be8bd83f72d13847930', 'request_id': 'req-c667842d-a594-41a0-9bae-0829dbf4bdd4'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:17.925652 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c667842d-a594-41a0-9bae-0829dbf4bdd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cba4c2e425d64be8bd83f72d13847930', 'request_id': 'req-c667842d-a594-41a0-9bae-0829dbf4bdd4'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:17.931424 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c667842d-a594-41a0-9bae-0829dbf4bdd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cba4c2e425d64be8bd83f72d13847930', 'request_id': 'req-c667842d-a594-41a0-9bae-0829dbf4bdd4'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:17.942316 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c667842d-a594-41a0-9bae-0829dbf4bdd4 admin admin] The token cache is being invalidate because project cba4c2e425d64be8bd83f72d13847930 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:08:17.942602 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c667842d-a594-41a0-9bae-0829dbf4bdd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:17.943247 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c667842d-a594-41a0-9bae-0829dbf4bdd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:17.945420 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1043/2093] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:08:17 2022] DELETE /identity/v3/projects/cba4c2e425d64be8bd83f72d13847930 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:08:17.949465 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b1ad62-f134-4d18-b6ce-62d597166d0c service neutron] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:17.960027 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b1ad62-f134-4d18-b6ce-62d597166d0c service neutron] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:18.018164 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f457027-05a9-4991-bc28-3277bf41fb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:18.019032 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f457027-05a9-4991-bc28-3277bf41fb94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:18.019317 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f457027-05a9-4991-bc28-3277bf41fb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:18.019588 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f457027-05a9-4991-bc28-3277bf41fb94 admin admin] PATH_INFO: `/v3/users/dacfb09009c14e5fb1b713719b07eb50` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:18.020838 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f457027-05a9-4991-bc28-3277bf41fb94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dacfb09009c14e5fb1b713719b07eb50)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:18.023923 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f457027-05a9-4991-bc28-3277bf41fb94 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:18.026205 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:08:18.072484 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-3f457027-05a9-4991-bc28-3277bf41fb94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dacfb09009c14e5fb1b713719b07eb50'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:18.079114 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-3f457027-05a9-4991-bc28-3277bf41fb94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dacfb09009c14e5fb1b713719b07eb50'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:18.079769 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-3f457027-05a9-4991-bc28-3277bf41fb94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dacfb09009c14e5fb1b713719b07eb50'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:18.080411 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-3f457027-05a9-4991-bc28-3277bf41fb94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dacfb09009c14e5fb1b713719b07eb50'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:18.094507 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-3f457027-05a9-4991-bc28-3277bf41fb94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dacfb09009c14e5fb1b713719b07eb50'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:18.109383 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1051/2094] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:08:17 2022] DELETE /identity/v3/users/dacfb09009c14e5fb1b713719b07eb50 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:08:18.380054 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c667842d-a594-41a0-9bae-0829dbf4bdd4 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:18.382152 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-c667842d-a594-41a0-9bae-0829dbf4bdd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:08:18.395366 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c667842d-a594-41a0-9bae-0829dbf4bdd4 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:18.462020 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1e8e22-6749-4c6d-b8ee-45185e4aaef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:18.462808 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e8e22-6749-4c6d-b8ee-45185e4aaef4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:18.463118 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e8e22-6749-4c6d-b8ee-45185e4aaef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:18.463398 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e8e22-6749-4c6d-b8ee-45185e4aaef4 admin admin] PATH_INFO: `/v3/projects/4ce8dad08d99441b943ba337e74e88ff` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:18.464657 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1e8e22-6749-4c6d-b8ee-45185e4aaef4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ce8dad08d99441b943ba337e74e88ff)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:18.466592 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1e8e22-6749-4c6d-b8ee-45185e4aaef4 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:18.528902 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-aa1e8e22-6749-4c6d-b8ee-45185e4aaef4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ce8dad08d99441b943ba337e74e88ff', 'request_id': 'req-aa1e8e22-6749-4c6d-b8ee-45185e4aaef4'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:18.538393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-aa1e8e22-6749-4c6d-b8ee-45185e4aaef4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ce8dad08d99441b943ba337e74e88ff', 'request_id': 'req-aa1e8e22-6749-4c6d-b8ee-45185e4aaef4'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:18.547985 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-aa1e8e22-6749-4c6d-b8ee-45185e4aaef4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ce8dad08d99441b943ba337e74e88ff', 'request_id': 'req-aa1e8e22-6749-4c6d-b8ee-45185e4aaef4'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:18.549111 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:08:18.561215 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-aa1e8e22-6749-4c6d-b8ee-45185e4aaef4 admin admin] The token cache is being invalidate because project 4ce8dad08d99441b943ba337e74e88ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:08:18.561506 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-aa1e8e22-6749-4c6d-b8ee-45185e4aaef4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:18.562289 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-aa1e8e22-6749-4c6d-b8ee-45185e4aaef4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:18.567085 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1044/2095] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:08:18 2022] DELETE /identity/v3/projects/4ce8dad08d99441b943ba337e74e88ff => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:08:18.570342 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb7fe0-ad0f-4216-b550-f418277635d8 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:18.570838 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb7fe0-ad0f-4216-b550-f418277635d8 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:18.571094 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb7fe0-ad0f-4216-b550-f418277635d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:18.591646 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-a3cb7fe0-ad0f-4216-b550-f418277635d8 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:08:18.593012 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-a3cb7fe0-ad0f-4216-b550-f418277635d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:08:18.660920 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1052/2096] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:08:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:08:18.669207 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ba8fe-7f65-4aaf-8d93-6050c5cb1518 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:18.669568 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ba8fe-7f65-4aaf-8d93-6050c5cb1518 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:18.670258 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ba8fe-7f65-4aaf-8d93-6050c5cb1518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:18.692334 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-407ba8fe-7f65-4aaf-8d93-6050c5cb1518 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:08:18.693542 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-407ba8fe-7f65-4aaf-8d93-6050c5cb1518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:08:18.702499 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1045/2097] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:08:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:08:18.706798 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb7fe0-ad0f-4216-b550-f418277635d8 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:18.716507 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb7fe0-ad0f-4216-b550-f418277635d8 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:18.723080 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51c481-b71b-4a3e-824e-fadff5667af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:18.723736 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51c481-b71b-4a3e-824e-fadff5667af4 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:18.724014 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51c481-b71b-4a3e-824e-fadff5667af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:18.724395 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51c481-b71b-4a3e-824e-fadff5667af4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:18.725670 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e51c481-b71b-4a3e-824e-fadff5667af4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:08:18.726147 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e51c481-b71b-4a3e-824e-fadff5667af4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:18.727523 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e51c481-b71b-4a3e-824e-fadff5667af4 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:18.739996 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1053/2098] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:08:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:08:18.745025 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ba8fe-7f65-4aaf-8d93-6050c5cb1518 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:18.754301 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ba8fe-7f65-4aaf-8d93-6050c5cb1518 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:18.759827 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d18a71-fecd-4aab-ab17-f6632fb6c4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:18.760511 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d18a71-fecd-4aab-ab17-f6632fb6c4ca admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:18.760792 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d18a71-fecd-4aab-ab17-f6632fb6c4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:18.761064 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d18a71-fecd-4aab-ab17-f6632fb6c4ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:18.761750 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d18a71-fecd-4aab-ab17-f6632fb6c4ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:18.763664 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d18a71-fecd-4aab-ab17-f6632fb6c4ca admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:18.792059 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1046/2099] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:08:18 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:08:18.796133 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51c481-b71b-4a3e-824e-fadff5667af4 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:18.806964 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51c481-b71b-4a3e-824e-fadff5667af4 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:18.868712 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a2f56-8e33-4553-aa9c-135116effce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:18.869389 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a2f56-8e33-4553-aa9c-135116effce8 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:18.869668 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a2f56-8e33-4553-aa9c-135116effce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:18.869939 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a2f56-8e33-4553-aa9c-135116effce8 admin admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:18.870639 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783a2f56-8e33-4553-aa9c-135116effce8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:18.872650 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783a2f56-8e33-4553-aa9c-135116effce8 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:18.888763 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:08:18.895792 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1054/2100] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:08:18 2022] POST /identity/v3/users => generated 294 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 12:08:18.900857 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d18a71-fecd-4aab-ab17-f6632fb6c4ca admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:18.921626 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d18a71-fecd-4aab-ab17-f6632fb6c4ca admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:18.926855 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d42b2-2ddd-4224-b13e-771bcc370bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:18.927667 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d42b2-2ddd-4224-b13e-771bcc370bf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:18.928077 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d42b2-2ddd-4224-b13e-771bcc370bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:18.928491 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d42b2-2ddd-4224-b13e-771bcc370bf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:18.929299 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6d42b2-2ddd-4224-b13e-771bcc370bf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:18.932910 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6d42b2-2ddd-4224-b13e-771bcc370bf8 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:18.946734 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1047/2101] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:08:18 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 12:08:18.950590 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a2f56-8e33-4553-aa9c-135116effce8 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:18.962745 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a2f56-8e33-4553-aa9c-135116effce8 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:18.972695 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d997c2-6b68-46bc-9c86-f51e025cec25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:18.973387 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d997c2-6b68-46bc-9c86-f51e025cec25 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:18.973785 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d997c2-6b68-46bc-9c86-f51e025cec25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:18.974125 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d997c2-6b68-46bc-9c86-f51e025cec25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:18.975586 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d997c2-6b68-46bc-9c86-f51e025cec25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:18.977684 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d997c2-6b68-46bc-9c86-f51e025cec25 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:18.994595 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1055/2102] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:08:18 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 12:08:18.996339 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d42b2-2ddd-4224-b13e-771bcc370bf8 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:19.011551 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d42b2-2ddd-4224-b13e-771bcc370bf8 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:19.016629 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24351c0-f843-414b-9370-4944757fe279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:19.017635 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24351c0-f843-414b-9370-4944757fe279 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:19.017988 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24351c0-f843-414b-9370-4944757fe279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:19.018401 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24351c0-f843-414b-9370-4944757fe279 admin admin] PATH_INFO: `/v3/projects/36c69adcda204efebf5251d367455be5/users/99498c9a45124a888caa29809c6794c2/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:19.034736 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24351c0-f843-414b-9370-4944757fe279 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36c69adcda204efebf5251d367455be5, user_id=99498c9a45124a888caa29809c6794c2, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:19.038313 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24351c0-f843-414b-9370-4944757fe279 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:19.050594 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1048/2103] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:08:18 2022] PUT /identity/v3/projects/36c69adcda204efebf5251d367455be5/users/99498c9a45124a888caa29809c6794c2/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:08:19.061000 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47acbfca-a3be-456e-a1c3-5b23db312b00 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:19.061297 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47acbfca-a3be-456e-a1c3-5b23db312b00 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:19.061575 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47acbfca-a3be-456e-a1c3-5b23db312b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:19.088511 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-47acbfca-a3be-456e-a1c3-5b23db312b00 None None] MFA Rules not processed for user `99498c9a45124a888caa29809c6794c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:08:19.089742 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-47acbfca-a3be-456e-a1c3-5b23db312b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:08:19.154362 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1056/2104] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:08:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:08:19.158874 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24351c0-f843-414b-9370-4944757fe279 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:19.219481 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24351c0-f843-414b-9370-4944757fe279 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:19.224159 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c0807-e878-49a5-800c-45d75e37940f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:19.224777 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c0807-e878-49a5-800c-45d75e37940f admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:19.225106 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c0807-e878-49a5-800c-45d75e37940f admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:19.225380 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c0807-e878-49a5-800c-45d75e37940f admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:19.226071 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c0807-e878-49a5-800c-45d75e37940f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:19.227944 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c0807-e878-49a5-800c-45d75e37940f admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:19.252113 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1049/2105] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:08:19 2022] POST /identity/v3/projects => generated 387 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 12:08:19.256690 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47acbfca-a3be-456e-a1c3-5b23db312b00 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:19.267388 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47acbfca-a3be-456e-a1c3-5b23db312b00 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:19.327770 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d4cf35-cfed-4c3b-945c-e182e011377a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:19.328474 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4cf35-cfed-4c3b-945c-e182e011377a admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:19.328762 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4cf35-cfed-4c3b-945c-e182e011377a admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:19.329037 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4cf35-cfed-4c3b-945c-e182e011377a admin admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:19.329721 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d4cf35-cfed-4c3b-945c-e182e011377a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:19.331642 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d4cf35-cfed-4c3b-945c-e182e011377a admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:19.351643 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1057/2106] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:08:19 2022] POST /identity/v3/users => generated 300 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:08:19.355841 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c0807-e878-49a5-800c-45d75e37940f admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:19.366462 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c0807-e878-49a5-800c-45d75e37940f admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:19.371191 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888949f1-c508-4ef7-8718-3a4e0d333230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:19.371845 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888949f1-c508-4ef7-8718-3a4e0d333230 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:19.372130 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888949f1-c508-4ef7-8718-3a4e0d333230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:19.372436 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888949f1-c508-4ef7-8718-3a4e0d333230 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:19.373164 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888949f1-c508-4ef7-8718-3a4e0d333230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:19.374755 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888949f1-c508-4ef7-8718-3a4e0d333230 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:19.385879 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1050/2107] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:08:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:08:19.389956 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d4cf35-cfed-4c3b-945c-e182e011377a admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:19.400466 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d4cf35-cfed-4c3b-945c-e182e011377a admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:19.405062 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03dc17-7b09-4bf7-b718-5bad917d2611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:19.406265 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03dc17-7b09-4bf7-b718-5bad917d2611 admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:19.406551 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03dc17-7b09-4bf7-b718-5bad917d2611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:19.406830 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03dc17-7b09-4bf7-b718-5bad917d2611 admin admin] PATH_INFO: `/v3/projects/aa2cb7dcce144cad84d49ec6a51e9a56/users/76834bd62f0d450e88860f7e7e026e2a/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:19.421515 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d03dc17-7b09-4bf7-b718-5bad917d2611 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa2cb7dcce144cad84d49ec6a51e9a56, user_id=76834bd62f0d450e88860f7e7e026e2a, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:19.424586 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d03dc17-7b09-4bf7-b718-5bad917d2611 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:19.437452 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1058/2108] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:08:19 2022] PUT /identity/v3/projects/aa2cb7dcce144cad84d49ec6a51e9a56/users/76834bd62f0d450e88860f7e7e026e2a/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:08:19.441487 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888949f1-c508-4ef7-8718-3a4e0d333230 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:19.451987 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888949f1-c508-4ef7-8718-3a4e0d333230 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:19.509140 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f12b7b-981d-44bc-8abb-a8c7b5a4747c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:19.509730 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f12b7b-981d-44bc-8abb-a8c7b5a4747c admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:19.510014 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f12b7b-981d-44bc-8abb-a8c7b5a4747c admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:19.510290 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f12b7b-981d-44bc-8abb-a8c7b5a4747c admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:19.511012 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f12b7b-981d-44bc-8abb-a8c7b5a4747c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:19.512639 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f12b7b-981d-44bc-8abb-a8c7b5a4747c admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:19.517601 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:08:19.523459 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1051/2109] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:08:19 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:08:19.527629 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03dc17-7b09-4bf7-b718-5bad917d2611 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:19.538625 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03dc17-7b09-4bf7-b718-5bad917d2611 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:19.543247 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a108985-7c90-4ee8-95e8-20d5f9ead8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:19.544131 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a108985-7c90-4ee8-95e8-20d5f9ead8cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:19.544475 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a108985-7c90-4ee8-95e8-20d5f9ead8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:19.544754 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a108985-7c90-4ee8-95e8-20d5f9ead8cc admin admin] PATH_INFO: `/v3/projects/aa2cb7dcce144cad84d49ec6a51e9a56/users/76834bd62f0d450e88860f7e7e026e2a/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:19.546698 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a108985-7c90-4ee8-95e8-20d5f9ead8cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa2cb7dcce144cad84d49ec6a51e9a56, user_id=76834bd62f0d450e88860f7e7e026e2a, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:19.549357 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a108985-7c90-4ee8-95e8-20d5f9ead8cc admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:19.560060 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1059/2110] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:08:19 2022] PUT /identity/v3/projects/aa2cb7dcce144cad84d49ec6a51e9a56/users/76834bd62f0d450e88860f7e7e026e2a/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:08:19.571067 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444ad70-28f9-4129-a8fb-7cd256b8e407 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:19.571537 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444ad70-28f9-4129-a8fb-7cd256b8e407 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:19.571981 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444ad70-28f9-4129-a8fb-7cd256b8e407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:19.603701 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-a444ad70-28f9-4129-a8fb-7cd256b8e407 None None] MFA Rules not processed for user `76834bd62f0d450e88860f7e7e026e2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:08:19.605220 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a444ad70-28f9-4129-a8fb-7cd256b8e407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:08:19.671584 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1052/2111] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:08:19 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:08:19.682801 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a108985-7c90-4ee8-95e8-20d5f9ead8cc admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:19.684661 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-2a108985-7c90-4ee8-95e8-20d5f9ead8cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:08:19.716363 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:08:19.742743 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a108985-7c90-4ee8-95e8-20d5f9ead8cc admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:19.746361 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faedee2a-cd48-4db1-b477-9342076afee8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:19.747007 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faedee2a-cd48-4db1-b477-9342076afee8 service cinder] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:19.747291 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faedee2a-cd48-4db1-b477-9342076afee8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:19.747565 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faedee2a-cd48-4db1-b477-9342076afee8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:19.757067 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faedee2a-cd48-4db1-b477-9342076afee8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:19.758505 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faedee2a-cd48-4db1-b477-9342076afee8 service cinder] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:19.767683 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1060/2112] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:08:19 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:08:20.338872 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a444ad70-28f9-4129-a8fb-7cd256b8e407 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:20.399959 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a444ad70-28f9-4129-a8fb-7cd256b8e407 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:20.404446 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d77107-07fc-48d6-a783-56dc484288a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:20.405306 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d77107-07fc-48d6-a783-56dc484288a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:20.405592 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d77107-07fc-48d6-a783-56dc484288a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:20.405870 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d77107-07fc-48d6-a783-56dc484288a6 admin admin] PATH_INFO: `/v3/users/99498c9a45124a888caa29809c6794c2` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:20.407065 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d77107-07fc-48d6-a783-56dc484288a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99498c9a45124a888caa29809c6794c2)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:20.409002 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d77107-07fc-48d6-a783-56dc484288a6 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:20.455939 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-90d77107-07fc-48d6-a783-56dc484288a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99498c9a45124a888caa29809c6794c2'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:20.456686 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-90d77107-07fc-48d6-a783-56dc484288a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99498c9a45124a888caa29809c6794c2'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:20.457307 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-90d77107-07fc-48d6-a783-56dc484288a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99498c9a45124a888caa29809c6794c2'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:20.464397 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-90d77107-07fc-48d6-a783-56dc484288a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99498c9a45124a888caa29809c6794c2'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:20.476608 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-90d77107-07fc-48d6-a783-56dc484288a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99498c9a45124a888caa29809c6794c2'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:20.489166 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1053/2113] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:08:20 2022] DELETE /identity/v3/users/99498c9a45124a888caa29809c6794c2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:08:20.494686 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621cdd2-3d12-4c0f-bccd-51bd3b648fa7 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:20.494977 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621cdd2-3d12-4c0f-bccd-51bd3b648fa7 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:20.495255 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621cdd2-3d12-4c0f-bccd-51bd3b648fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:20.513446 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-5621cdd2-3d12-4c0f-bccd-51bd3b648fa7 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:08:20.514640 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-5621cdd2-3d12-4c0f-bccd-51bd3b648fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:08:20.573416 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1061/2114] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:08:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:08:20.583183 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d77107-07fc-48d6-a783-56dc484288a6 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:20.585098 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-90d77107-07fc-48d6-a783-56dc484288a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:08:20.594170 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:08:20.647723 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d77107-07fc-48d6-a783-56dc484288a6 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:20.651378 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f9cbb9-d5f4-49b6-adf5-964ef9b4b598 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:20.652029 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9cbb9-d5f4-49b6-adf5-964ef9b4b598 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:20.652344 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9cbb9-d5f4-49b6-adf5-964ef9b4b598 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:20.652624 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9cbb9-d5f4-49b6-adf5-964ef9b4b598 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:20.661773 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f9cbb9-d5f4-49b6-adf5-964ef9b4b598 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:20.663238 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f9cbb9-d5f4-49b6-adf5-964ef9b4b598 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:20.672615 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1054/2115] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:08:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:08:20.958594 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621cdd2-3d12-4c0f-bccd-51bd3b648fa7 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:20.960244 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-5621cdd2-3d12-4c0f-bccd-51bd3b648fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:08:20.972401 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621cdd2-3d12-4c0f-bccd-51bd3b648fa7 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:20.979834 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d63a1-27fb-4d5a-9ced-6ad9a94dbd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:20.980788 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d63a1-27fb-4d5a-9ced-6ad9a94dbd12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:20.981071 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d63a1-27fb-4d5a-9ced-6ad9a94dbd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:20.981716 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d63a1-27fb-4d5a-9ced-6ad9a94dbd12 admin admin] PATH_INFO: `/v3/projects/36c69adcda204efebf5251d367455be5` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:20.982569 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0d63a1-27fb-4d5a-9ced-6ad9a94dbd12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36c69adcda204efebf5251d367455be5)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:20.984568 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0d63a1-27fb-4d5a-9ced-6ad9a94dbd12 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:21.033989 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-cf0d63a1-27fb-4d5a-9ced-6ad9a94dbd12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36c69adcda204efebf5251d367455be5', 'request_id': 'req-cf0d63a1-27fb-4d5a-9ced-6ad9a94dbd12'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:21.046440 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-cf0d63a1-27fb-4d5a-9ced-6ad9a94dbd12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36c69adcda204efebf5251d367455be5', 'request_id': 'req-cf0d63a1-27fb-4d5a-9ced-6ad9a94dbd12'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:21.055222 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-cf0d63a1-27fb-4d5a-9ced-6ad9a94dbd12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36c69adcda204efebf5251d367455be5', 'request_id': 'req-cf0d63a1-27fb-4d5a-9ced-6ad9a94dbd12'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:21.069863 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-cf0d63a1-27fb-4d5a-9ced-6ad9a94dbd12 admin admin] The token cache is being invalidate because project 36c69adcda204efebf5251d367455be5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:08:21.070150 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-cf0d63a1-27fb-4d5a-9ced-6ad9a94dbd12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:21.070808 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-cf0d63a1-27fb-4d5a-9ced-6ad9a94dbd12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:21.072386 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1062/2116] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:08:20 2022] DELETE /identity/v3/projects/36c69adcda204efebf5251d367455be5 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:08:21.076451 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f9cbb9-d5f4-49b6-adf5-964ef9b4b598 service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:21.087931 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f9cbb9-d5f4-49b6-adf5-964ef9b4b598 service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:21.143489 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed7f7a-b01e-4ee0-a49d-fa0032d3dd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:21.144315 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed7f7a-b01e-4ee0-a49d-fa0032d3dd02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:21.144598 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed7f7a-b01e-4ee0-a49d-fa0032d3dd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:21.144873 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed7f7a-b01e-4ee0-a49d-fa0032d3dd02 admin admin] PATH_INFO: `/v3/users/76834bd62f0d450e88860f7e7e026e2a` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:21.146058 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fed7f7a-b01e-4ee0-a49d-fa0032d3dd02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76834bd62f0d450e88860f7e7e026e2a)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:21.148163 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fed7f7a-b01e-4ee0-a49d-fa0032d3dd02 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:21.192583 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9fed7f7a-b01e-4ee0-a49d-fa0032d3dd02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76834bd62f0d450e88860f7e7e026e2a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:21.193222 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9fed7f7a-b01e-4ee0-a49d-fa0032d3dd02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76834bd62f0d450e88860f7e7e026e2a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:21.194614 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9fed7f7a-b01e-4ee0-a49d-fa0032d3dd02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76834bd62f0d450e88860f7e7e026e2a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:21.201424 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9fed7f7a-b01e-4ee0-a49d-fa0032d3dd02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76834bd62f0d450e88860f7e7e026e2a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:21.213040 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9fed7f7a-b01e-4ee0-a49d-fa0032d3dd02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76834bd62f0d450e88860f7e7e026e2a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:21.226360 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1055/2117] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:08:21 2022] DELETE /identity/v3/users/76834bd62f0d450e88860f7e7e026e2a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:08:21.518257 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d63a1-27fb-4d5a-9ced-6ad9a94dbd12 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:21.519766 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-cf0d63a1-27fb-4d5a-9ced-6ad9a94dbd12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:08:21.532785 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d63a1-27fb-4d5a-9ced-6ad9a94dbd12 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:21.584746 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:08:21.594182 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da4924-2d8d-4464-95e8-f480a51059a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:21.595391 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da4924-2d8d-4464-95e8-f480a51059a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:21.595825 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da4924-2d8d-4464-95e8-f480a51059a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:21.596138 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da4924-2d8d-4464-95e8-f480a51059a6 admin admin] PATH_INFO: `/v3/projects/aa2cb7dcce144cad84d49ec6a51e9a56` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:21.597385 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5da4924-2d8d-4464-95e8-f480a51059a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa2cb7dcce144cad84d49ec6a51e9a56)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:21.599360 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5da4924-2d8d-4464-95e8-f480a51059a6 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:21.645546 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-e5da4924-2d8d-4464-95e8-f480a51059a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa2cb7dcce144cad84d49ec6a51e9a56', 'request_id': 'req-e5da4924-2d8d-4464-95e8-f480a51059a6'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:21.652922 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-e5da4924-2d8d-4464-95e8-f480a51059a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa2cb7dcce144cad84d49ec6a51e9a56', 'request_id': 'req-e5da4924-2d8d-4464-95e8-f480a51059a6'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:21.658389 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-e5da4924-2d8d-4464-95e8-f480a51059a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa2cb7dcce144cad84d49ec6a51e9a56', 'request_id': 'req-e5da4924-2d8d-4464-95e8-f480a51059a6'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:21.670010 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-e5da4924-2d8d-4464-95e8-f480a51059a6 admin admin] The token cache is being invalidate because project aa2cb7dcce144cad84d49ec6a51e9a56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:08:21.670301 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-e5da4924-2d8d-4464-95e8-f480a51059a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:21.670952 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-e5da4924-2d8d-4464-95e8-f480a51059a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:21.672532 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1063/2118] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:08:21 2022] DELETE /identity/v3/projects/aa2cb7dcce144cad84d49ec6a51e9a56 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:08:21.677463 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf337443-f716-4044-bdf0-17a28a6b359f None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:21.677974 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf337443-f716-4044-bdf0-17a28a6b359f None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:21.678825 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf337443-f716-4044-bdf0-17a28a6b359f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:21.696979 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-bf337443-f716-4044-bdf0-17a28a6b359f None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:08:21.698097 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-bf337443-f716-4044-bdf0-17a28a6b359f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:08:21.717998 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:08:21.759652 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1056/2119] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:08:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:08:21.767368 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd50be-29b6-416e-ba2c-949abbb8b5da None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:21.767662 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd50be-29b6-416e-ba2c-949abbb8b5da None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:21.767948 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd50be-29b6-416e-ba2c-949abbb8b5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:21.785852 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-69bd50be-29b6-416e-ba2c-949abbb8b5da None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:08:21.787044 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-69bd50be-29b6-416e-ba2c-949abbb8b5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:08:21.795331 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1064/2120] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:08:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:08:21.799512 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf337443-f716-4044-bdf0-17a28a6b359f None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:21.809810 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf337443-f716-4044-bdf0-17a28a6b359f None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:21.814282 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b289d0-37b0-4ec8-9fcb-ccb68d9208d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:21.814943 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b289d0-37b0-4ec8-9fcb-ccb68d9208d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:21.815242 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b289d0-37b0-4ec8-9fcb-ccb68d9208d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:21.815520 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b289d0-37b0-4ec8-9fcb-ccb68d9208d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:21.816282 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b289d0-37b0-4ec8-9fcb-ccb68d9208d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:08:21.816594 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b289d0-37b0-4ec8-9fcb-ccb68d9208d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:21.818196 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b289d0-37b0-4ec8-9fcb-ccb68d9208d3 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:21.829675 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1057/2121] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:08:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:08:21.834013 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd50be-29b6-416e-ba2c-949abbb8b5da None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:21.844212 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd50be-29b6-416e-ba2c-949abbb8b5da None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:21.848910 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8026fd-7563-43ee-9810-a761995b7de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:21.849556 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8026fd-7563-43ee-9810-a761995b7de3 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:21.849927 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8026fd-7563-43ee-9810-a761995b7de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:21.850215 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8026fd-7563-43ee-9810-a761995b7de3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:21.850914 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8026fd-7563-43ee-9810-a761995b7de3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:21.852849 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8026fd-7563-43ee-9810-a761995b7de3 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:21.878352 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1065/2122] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:08:21 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 12:08:21.888032 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b289d0-37b0-4ec8-9fcb-ccb68d9208d3 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:21.900770 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b289d0-37b0-4ec8-9fcb-ccb68d9208d3 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:21.959701 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040f030-c909-4294-9e12-f9df2be33a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:21.960397 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040f030-c909-4294-9e12-f9df2be33a6d admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:21.960685 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040f030-c909-4294-9e12-f9df2be33a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:21.960968 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040f030-c909-4294-9e12-f9df2be33a6d admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:21.961666 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1040f030-c909-4294-9e12-f9df2be33a6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:21.963588 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1040f030-c909-4294-9e12-f9df2be33a6d admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:21.983173 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1058/2123] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:08:21 2022] POST /identity/v3/users => generated 286 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:08:21.987246 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8026fd-7563-43ee-9810-a761995b7de3 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:21.998108 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8026fd-7563-43ee-9810-a761995b7de3 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:22.002720 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617234e3-be5e-4a1f-9995-30cb3bb96fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:22.003383 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617234e3-be5e-4a1f-9995-30cb3bb96fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:22.003668 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617234e3-be5e-4a1f-9995-30cb3bb96fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:22.003947 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617234e3-be5e-4a1f-9995-30cb3bb96fe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:22.004712 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617234e3-be5e-4a1f-9995-30cb3bb96fe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:22.007121 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617234e3-be5e-4a1f-9995-30cb3bb96fe6 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:22.017418 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1066/2124] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:08:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:08:22.021241 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040f030-c909-4294-9e12-f9df2be33a6d admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:22.031072 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040f030-c909-4294-9e12-f9df2be33a6d admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:22.035730 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60c1f3-2d69-4b2c-b105-d0abcc14c062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:22.036416 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60c1f3-2d69-4b2c-b105-d0abcc14c062 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:22.036706 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60c1f3-2d69-4b2c-b105-d0abcc14c062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:22.036988 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60c1f3-2d69-4b2c-b105-d0abcc14c062 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:22.037851 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c60c1f3-2d69-4b2c-b105-d0abcc14c062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:22.039466 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c60c1f3-2d69-4b2c-b105-d0abcc14c062 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:22.049799 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1059/2125] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:08:22.054109 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617234e3-be5e-4a1f-9995-30cb3bb96fe6 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:22.063905 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617234e3-be5e-4a1f-9995-30cb3bb96fe6 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:22.069618 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebce78f-fef2-4d88-90bf-80ff5f1577c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:22.070623 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebce78f-fef2-4d88-90bf-80ff5f1577c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:22.070884 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebce78f-fef2-4d88-90bf-80ff5f1577c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:22.071180 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebce78f-fef2-4d88-90bf-80ff5f1577c0 admin admin] PATH_INFO: `/v3/projects/4a9a0e01fac74e61a0a288537f30aa2b/users/1d407365a3574c2387d2933b6d7ad991/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:22.087140 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebce78f-fef2-4d88-90bf-80ff5f1577c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a9a0e01fac74e61a0a288537f30aa2b, user_id=1d407365a3574c2387d2933b6d7ad991, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:22.092158 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebce78f-fef2-4d88-90bf-80ff5f1577c0 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:22.104160 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1067/2126] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:08:22 2022] PUT /identity/v3/projects/4a9a0e01fac74e61a0a288537f30aa2b/users/1d407365a3574c2387d2933b6d7ad991/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:08:22.109683 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a016cf-4313-4305-aff1-f2483af5aba4 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:22.110111 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a016cf-4313-4305-aff1-f2483af5aba4 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:22.110555 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a016cf-4313-4305-aff1-f2483af5aba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:22.128446 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-e3a016cf-4313-4305-aff1-f2483af5aba4 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:08:22.129784 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-e3a016cf-4313-4305-aff1-f2483af5aba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:08:22.194237 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1060/2127] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:08:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:08:22.203750 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebce78f-fef2-4d88-90bf-80ff5f1577c0 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:22.206480 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-cebce78f-fef2-4d88-90bf-80ff5f1577c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:08:22.267969 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebce78f-fef2-4d88-90bf-80ff5f1577c0 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:22.271516 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300112f7-309d-4cde-9567-986ea3f32a2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:22.272267 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300112f7-309d-4cde-9567-986ea3f32a2b service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:22.272550 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300112f7-309d-4cde-9567-986ea3f32a2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:22.272825 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300112f7-309d-4cde-9567-986ea3f32a2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:22.282257 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300112f7-309d-4cde-9567-986ea3f32a2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:22.283691 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300112f7-309d-4cde-9567-986ea3f32a2b service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:22.293488 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1068/2128] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:08:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 12:08:22.931013 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683731da-03ec-4985-b5c2-10f43893b02a None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:22.931542 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683731da-03ec-4985-b5c2-10f43893b02a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:22.931681 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683731da-03ec-4985-b5c2-10f43893b02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:22.958678 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-683731da-03ec-4985-b5c2-10f43893b02a None None] MFA Rules not processed for user `1d407365a3574c2387d2933b6d7ad991`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:08:22.959925 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-683731da-03ec-4985-b5c2-10f43893b02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:08:22.982451 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:08:23.030413 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1061/2129] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:08:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:08:23.041593 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300112f7-309d-4cde-9567-986ea3f32a2b service neutron] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:23.042942 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-300112f7-309d-4cde-9567-986ea3f32a2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:08:23.072678 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:08:23.105701 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300112f7-309d-4cde-9567-986ea3f32a2b service neutron] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:23.110524 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82506ffe-1e3c-4b13-a7fa-c40e4aa8dd9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:23.111179 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82506ffe-1e3c-4b13-a7fa-c40e4aa8dd9b service cinder] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:23.111461 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82506ffe-1e3c-4b13-a7fa-c40e4aa8dd9b service cinder] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:23.111735 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82506ffe-1e3c-4b13-a7fa-c40e4aa8dd9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:23.121028 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82506ffe-1e3c-4b13-a7fa-c40e4aa8dd9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:23.122488 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82506ffe-1e3c-4b13-a7fa-c40e4aa8dd9b service cinder] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:23.132261 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1069/2130] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:08:23 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:08:32.874528 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d09e6-0ea9-4003-b5e9-151ec06a1b28 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:32.875040 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d09e6-0ea9-4003-b5e9-151ec06a1b28 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:32.875139 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d09e6-0ea9-4003-b5e9-151ec06a1b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:32.892762 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-173d09e6-0ea9-4003-b5e9-151ec06a1b28 None None] MFA Rules not processed for user `1d407365a3574c2387d2933b6d7ad991`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:08:32.893941 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-173d09e6-0ea9-4003-b5e9-151ec06a1b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:08:32.900789 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1062/2131] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:08:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:08:33.127362 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=15 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:08:42.887390 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=20 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:08:51.266930 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82506ffe-1e3c-4b13-a7fa-c40e4aa8dd9b service cinder] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:51.268365 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-82506ffe-1e3c-4b13-a7fa-c40e4aa8dd9b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:08:51.355418 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82506ffe-1e3c-4b13-a7fa-c40e4aa8dd9b service cinder] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:51.361694 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abdf856-a907-40b0-b411-2dc428fd58c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:51.362038 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abdf856-a907-40b0-b411-2dc428fd58c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:51.362387 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abdf856-a907-40b0-b411-2dc428fd58c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:51.362735 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abdf856-a907-40b0-b411-2dc428fd58c2 admin admin] PATH_INFO: `/v3/users/cf8614a108e34ed393a0d9eb71463eee` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:51.364046 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abdf856-a907-40b0-b411-2dc428fd58c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf8614a108e34ed393a0d9eb71463eee)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:51.366198 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abdf856-a907-40b0-b411-2dc428fd58c2 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:51.428641 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-5abdf856-a907-40b0-b411-2dc428fd58c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf8614a108e34ed393a0d9eb71463eee'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:51.437812 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-5abdf856-a907-40b0-b411-2dc428fd58c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf8614a108e34ed393a0d9eb71463eee'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:51.438718 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-5abdf856-a907-40b0-b411-2dc428fd58c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf8614a108e34ed393a0d9eb71463eee'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:51.439417 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-5abdf856-a907-40b0-b411-2dc428fd58c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf8614a108e34ed393a0d9eb71463eee'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:51.453519 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-5abdf856-a907-40b0-b411-2dc428fd58c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf8614a108e34ed393a0d9eb71463eee'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:51.475706 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1070/2132] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:08:51 2022] DELETE /identity/v3/users/cf8614a108e34ed393a0d9eb71463eee => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:08:51.480802 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6a36f-289b-4380-a0e8-0509ad83cdff None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:51.481257 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6a36f-289b-4380-a0e8-0509ad83cdff None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:51.481424 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6a36f-289b-4380-a0e8-0509ad83cdff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:51.510701 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-d8b6a36f-289b-4380-a0e8-0509ad83cdff None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:08:51.511909 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-d8b6a36f-289b-4380-a0e8-0509ad83cdff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:08:51.574803 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1063/2133] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:08:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:08:51.584547 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abdf856-a907-40b0-b411-2dc428fd58c2 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:51.586170 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-5abdf856-a907-40b0-b411-2dc428fd58c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:08:51.660211 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:08:51.683063 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abdf856-a907-40b0-b411-2dc428fd58c2 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:51.688131 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958adb5a-61a6-456b-bdd2-f7474d60cfae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:51.688835 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958adb5a-61a6-456b-bdd2-f7474d60cfae service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:51.689125 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958adb5a-61a6-456b-bdd2-f7474d60cfae service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:51.689404 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958adb5a-61a6-456b-bdd2-f7474d60cfae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:51.699158 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958adb5a-61a6-456b-bdd2-f7474d60cfae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:51.700658 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958adb5a-61a6-456b-bdd2-f7474d60cfae service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:51.710092 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1071/2134] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:08:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:08:51.984603 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b6a36f-289b-4380-a0e8-0509ad83cdff None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:08:51.986106 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-d8b6a36f-289b-4380-a0e8-0509ad83cdff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:08:51.999694 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b6a36f-289b-4380-a0e8-0509ad83cdff None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:08:52.005119 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f186e76b-a878-4b20-8dea-7add027f4387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:08:52.005988 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186e76b-a878-4b20-8dea-7add027f4387 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:08:52.006274 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186e76b-a878-4b20-8dea-7add027f4387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:08:52.006550 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186e76b-a878-4b20-8dea-7add027f4387 admin admin] PATH_INFO: `/v3/projects/41f3c98b9b964241b8dfc4066094b6a0` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:08:52.008627 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f186e76b-a878-4b20-8dea-7add027f4387 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41f3c98b9b964241b8dfc4066094b6a0)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:08:52.010389 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f186e76b-a878-4b20-8dea-7add027f4387 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:08:52.070245 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f186e76b-a878-4b20-8dea-7add027f4387 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41f3c98b9b964241b8dfc4066094b6a0', 'request_id': 'req-f186e76b-a878-4b20-8dea-7add027f4387'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:52.078554 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f186e76b-a878-4b20-8dea-7add027f4387 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41f3c98b9b964241b8dfc4066094b6a0', 'request_id': 'req-f186e76b-a878-4b20-8dea-7add027f4387'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:52.084314 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f186e76b-a878-4b20-8dea-7add027f4387 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41f3c98b9b964241b8dfc4066094b6a0', 'request_id': 'req-f186e76b-a878-4b20-8dea-7add027f4387'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:52.096621 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f186e76b-a878-4b20-8dea-7add027f4387 admin admin] The token cache is being invalidate because project 41f3c98b9b964241b8dfc4066094b6a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:08:52.096905 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f186e76b-a878-4b20-8dea-7add027f4387 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:52.097542 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f186e76b-a878-4b20-8dea-7add027f4387 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:08:52.099217 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1064/2135] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:08:51 2022] DELETE /identity/v3/projects/41f3c98b9b964241b8dfc4066094b6a0 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:09:01.705843 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=10 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:09:02.092882 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:09:04.793487 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958adb5a-61a6-456b-bdd2-f7474d60cfae service neutron] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:09:04.795205 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-958adb5a-61a6-456b-bdd2-f7474d60cfae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:09:04.808533 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958adb5a-61a6-456b-bdd2-f7474d60cfae service neutron] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:09:04.864411 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e48f56-a314-4080-9760-4c4662e02aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:09:04.865937 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e48f56-a314-4080-9760-4c4662e02aff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:09:04.866434 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e48f56-a314-4080-9760-4c4662e02aff admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:09:04.866954 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e48f56-a314-4080-9760-4c4662e02aff admin admin] PATH_INFO: `/v3/users/0877f7b1e61d49f692cf7e1658b4f974` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:09:04.869468 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e48f56-a314-4080-9760-4c4662e02aff admin admin] RBAC: Authorizing `identity:delete_user(user_id=0877f7b1e61d49f692cf7e1658b4f974)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:09:04.871950 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e48f56-a314-4080-9760-4c4662e02aff admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:09:04.923026 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-e5e48f56-a314-4080-9760-4c4662e02aff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0877f7b1e61d49f692cf7e1658b4f974'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:09:04.930688 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-e5e48f56-a314-4080-9760-4c4662e02aff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0877f7b1e61d49f692cf7e1658b4f974'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:09:04.931654 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-e5e48f56-a314-4080-9760-4c4662e02aff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0877f7b1e61d49f692cf7e1658b4f974'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:09:04.933059 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-e5e48f56-a314-4080-9760-4c4662e02aff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0877f7b1e61d49f692cf7e1658b4f974'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:09:04.945372 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-e5e48f56-a314-4080-9760-4c4662e02aff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0877f7b1e61d49f692cf7e1658b4f974'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:09:04.958264 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1072/2136] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:09:04 2022] DELETE /identity/v3/users/0877f7b1e61d49f692cf7e1658b4f974 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:09:04.962783 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaaf13e-846d-42b8-b386-ffd6e9b5ff20 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:09:04.963287 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaaf13e-846d-42b8-b386-ffd6e9b5ff20 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:09:04.963398 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaaf13e-846d-42b8-b386-ffd6e9b5ff20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:09:04.981496 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-fdaaf13e-846d-42b8-b386-ffd6e9b5ff20 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:09:04.982681 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-fdaaf13e-846d-42b8-b386-ffd6e9b5ff20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:09:05.048383 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1065/2137] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:09:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:09:05.062358 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e48f56-a314-4080-9760-4c4662e02aff admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:09:05.063933 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-e5e48f56-a314-4080-9760-4c4662e02aff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:09:05.121867 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e48f56-a314-4080-9760-4c4662e02aff admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:09:05.125790 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e50a74-c971-4050-aef7-758fb0cc6ff8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:09:05.126861 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e50a74-c971-4050-aef7-758fb0cc6ff8 service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:09:05.127355 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e50a74-c971-4050-aef7-758fb0cc6ff8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:09:05.127843 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e50a74-c971-4050-aef7-758fb0cc6ff8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:09:05.141507 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e50a74-c971-4050-aef7-758fb0cc6ff8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:09:05.143828 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e50a74-c971-4050-aef7-758fb0cc6ff8 service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:09:05.154917 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1073/2138] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:09:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:09:05.419971 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaaf13e-846d-42b8-b386-ffd6e9b5ff20 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:09:05.421520 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-fdaaf13e-846d-42b8-b386-ffd6e9b5ff20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:09:05.435242 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaaf13e-846d-42b8-b386-ffd6e9b5ff20 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:09:05.449060 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef68535-9c82-498c-ad9a-67e6a0a57d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:09:05.450256 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef68535-9c82-498c-ad9a-67e6a0a57d6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:09:05.450530 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef68535-9c82-498c-ad9a-67e6a0a57d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:09:05.450979 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef68535-9c82-498c-ad9a-67e6a0a57d6f admin admin] PATH_INFO: `/v3/projects/6aec5969ef0b4fa3ba022900d1011146` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:09:05.452467 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef68535-9c82-498c-ad9a-67e6a0a57d6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6aec5969ef0b4fa3ba022900d1011146)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:09:05.455534 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef68535-9c82-498c-ad9a-67e6a0a57d6f admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:09:05.505917 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-eef68535-9c82-498c-ad9a-67e6a0a57d6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6aec5969ef0b4fa3ba022900d1011146', 'request_id': 'req-eef68535-9c82-498c-ad9a-67e6a0a57d6f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:09:05.513627 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-eef68535-9c82-498c-ad9a-67e6a0a57d6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6aec5969ef0b4fa3ba022900d1011146', 'request_id': 'req-eef68535-9c82-498c-ad9a-67e6a0a57d6f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:09:05.519391 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-eef68535-9c82-498c-ad9a-67e6a0a57d6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6aec5969ef0b4fa3ba022900d1011146', 'request_id': 'req-eef68535-9c82-498c-ad9a-67e6a0a57d6f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:09:05.531662 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-eef68535-9c82-498c-ad9a-67e6a0a57d6f admin admin] The token cache is being invalidate because project 6aec5969ef0b4fa3ba022900d1011146 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:09:05.531973 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-eef68535-9c82-498c-ad9a-67e6a0a57d6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:09:05.532650 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-eef68535-9c82-498c-ad9a-67e6a0a57d6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:09:05.534285 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1066/2139] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:09:05 2022] DELETE /identity/v3/projects/6aec5969ef0b4fa3ba022900d1011146 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:09:05.540261 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a00510-14ac-4ebc-acf6-bfbece66ef60 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:09:05.540652 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a00510-14ac-4ebc-acf6-bfbece66ef60 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:09:05.541001 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a00510-14ac-4ebc-acf6-bfbece66ef60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:09:05.568114 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:09:05.591670 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-19a00510-14ac-4ebc-acf6-bfbece66ef60 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:09:05.593193 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-19a00510-14ac-4ebc-acf6-bfbece66ef60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:09:05.639586 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c88201-728d-40f5-8efc-f2b28dfdd42b None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:09:05.639877 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c88201-728d-40f5-8efc-f2b28dfdd42b None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:09:05.640156 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c88201-728d-40f5-8efc-f2b28dfdd42b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:09:05.658366 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-27c88201-728d-40f5-8efc-f2b28dfdd42b None None] MFA Rules not processed for user `1d407365a3574c2387d2933b6d7ad991`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:09:05.659560 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-27c88201-728d-40f5-8efc-f2b28dfdd42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:09:05.660912 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1074/2140] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:09:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:09:05.669123 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868d994-bffb-4d88-bb3d-9b8e7bc3a8b1 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:09:05.669417 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868d994-bffb-4d88-bb3d-9b8e7bc3a8b1 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:09:05.669697 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868d994-bffb-4d88-bb3d-9b8e7bc3a8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:09:05.688516 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-1868d994-bffb-4d88-bb3d-9b8e7bc3a8b1 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:09:05.689721 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-1868d994-bffb-4d88-bb3d-9b8e7bc3a8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:09:05.698033 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1075/2141] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:09:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:09:05.702050 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868d994-bffb-4d88-bb3d-9b8e7bc3a8b1 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:09:05.712391 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868d994-bffb-4d88-bb3d-9b8e7bc3a8b1 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:09:05.717309 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d920b953-1e38-4a87-ac58-7b3ba1d476c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:09:05.717970 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920b953-1e38-4a87-ac58-7b3ba1d476c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:09:05.718257 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920b953-1e38-4a87-ac58-7b3ba1d476c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:09:05.718530 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920b953-1e38-4a87-ac58-7b3ba1d476c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:09:05.719249 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d920b953-1e38-4a87-ac58-7b3ba1d476c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:09:05.719609 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d920b953-1e38-4a87-ac58-7b3ba1d476c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:09:05.724751 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d920b953-1e38-4a87-ac58-7b3ba1d476c5 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:09:05.724902 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1067/2142] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:09:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:09:05.739583 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1076/2143] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:09:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:09:05.740958 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c88201-728d-40f5-8efc-f2b28dfdd42b None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:09:05.752561 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c88201-728d-40f5-8efc-f2b28dfdd42b None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:09:05.757174 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a91999-a7f4-40c7-9cf9-fa9ee15d4f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:09:05.758434 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a91999-a7f4-40c7-9cf9-fa9ee15d4f08 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:09:05.758914 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a91999-a7f4-40c7-9cf9-fa9ee15d4f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:09:05.759410 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a91999-a7f4-40c7-9cf9-fa9ee15d4f08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:09:05.760159 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a91999-a7f4-40c7-9cf9-fa9ee15d4f08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:09:05.762114 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a91999-a7f4-40c7-9cf9-fa9ee15d4f08 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:09:05.792343 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1068/2144] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:09:05 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:09:05.797288 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d920b953-1e38-4a87-ac58-7b3ba1d476c5 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:09:05.807049 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d920b953-1e38-4a87-ac58-7b3ba1d476c5 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:09:05.866851 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8250a2c-879b-4a7a-bf00-4388ba792eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:09:05.868303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8250a2c-879b-4a7a-bf00-4388ba792eb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:09:05.868705 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8250a2c-879b-4a7a-bf00-4388ba792eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:09:05.868875 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8250a2c-879b-4a7a-bf00-4388ba792eb4 admin admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:09:05.869553 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8250a2c-879b-4a7a-bf00-4388ba792eb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:09:05.871454 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8250a2c-879b-4a7a-bf00-4388ba792eb4 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:09:05.892504 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1077/2145] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:09:05 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:09:05.896744 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a91999-a7f4-40c7-9cf9-fa9ee15d4f08 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:09:05.910965 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a91999-a7f4-40c7-9cf9-fa9ee15d4f08 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:09:05.916581 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de1ea25-7c8e-4b20-a27e-5708e8c9cd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:09:05.917304 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1ea25-7c8e-4b20-a27e-5708e8c9cd99 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:09:05.917593 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1ea25-7c8e-4b20-a27e-5708e8c9cd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:09:05.917867 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1ea25-7c8e-4b20-a27e-5708e8c9cd99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:09:05.918601 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de1ea25-7c8e-4b20-a27e-5708e8c9cd99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:09:05.920253 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de1ea25-7c8e-4b20-a27e-5708e8c9cd99 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:09:05.921870 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:09:05.934808 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1069/2146] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:09:05 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:09:05.938799 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8250a2c-879b-4a7a-bf00-4388ba792eb4 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:09:05.949602 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8250a2c-879b-4a7a-bf00-4388ba792eb4 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:09:05.955067 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ee788-547d-4b88-b46b-81fb1951265d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:09:05.955817 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ee788-547d-4b88-b46b-81fb1951265d admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:09:05.956228 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ee788-547d-4b88-b46b-81fb1951265d admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:09:05.956588 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ee788-547d-4b88-b46b-81fb1951265d admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:09:05.957437 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100ee788-547d-4b88-b46b-81fb1951265d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:09:05.959274 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100ee788-547d-4b88-b46b-81fb1951265d admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:09:05.983502 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1078/2147] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:09:05 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:09:05.984891 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de1ea25-7c8e-4b20-a27e-5708e8c9cd99 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:09:05.997129 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de1ea25-7c8e-4b20-a27e-5708e8c9cd99 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:09:06.002101 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c07aa-1d1f-4fe8-8ba9-c1d6b7ed0920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:09:06.003112 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c07aa-1d1f-4fe8-8ba9-c1d6b7ed0920 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:09:06.003319 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c07aa-1d1f-4fe8-8ba9-c1d6b7ed0920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:09:06.003618 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c07aa-1d1f-4fe8-8ba9-c1d6b7ed0920 admin admin] PATH_INFO: `/v3/projects/3472f765b1ce4d92b4025f457efdd387/users/c71e4f6c1c8249c48d05c1bf6fe370de/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:09:06.019818 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c07aa-1d1f-4fe8-8ba9-c1d6b7ed0920 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3472f765b1ce4d92b4025f457efdd387, user_id=c71e4f6c1c8249c48d05c1bf6fe370de, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:09:06.022501 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c07aa-1d1f-4fe8-8ba9-c1d6b7ed0920 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:09:06.040217 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1070/2148] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:09:05 2022] PUT /identity/v3/projects/3472f765b1ce4d92b4025f457efdd387/users/c71e4f6c1c8249c48d05c1bf6fe370de/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:09:06.050766 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dcca75-5a89-4019-98e5-f12997105a78 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:09:06.051080 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dcca75-5a89-4019-98e5-f12997105a78 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:09:06.051351 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dcca75-5a89-4019-98e5-f12997105a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:09:06.083417 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-b7dcca75-5a89-4019-98e5-f12997105a78 None None] MFA Rules not processed for user `c71e4f6c1c8249c48d05c1bf6fe370de`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:09:06.084754 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-b7dcca75-5a89-4019-98e5-f12997105a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:09:06.137629 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:09:06.162540 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1079/2149] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:09:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:09:06.179388 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c07aa-1d1f-4fe8-8ba9-c1d6b7ed0920 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:09:06.181705 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-7c3c07aa-1d1f-4fe8-8ba9-c1d6b7ed0920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:09:06.275473 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c07aa-1d1f-4fe8-8ba9-c1d6b7ed0920 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:09:06.279635 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea13f16-3988-4c65-896a-d3c9636b2edf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2f8b5040a048c5bf4eef36f2ecd678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:09:06.280125 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea13f16-3988-4c65-896a-d3c9636b2edf service glance] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:09:06.280444 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea13f16-3988-4c65-896a-d3c9636b2edf service glance] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:09:06.280721 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea13f16-3988-4c65-896a-d3c9636b2edf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:09:06.298989 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea13f16-3988-4c65-896a-d3c9636b2edf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:09:06.300911 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea13f16-3988-4c65-896a-d3c9636b2edf service glance] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:09:06.314536 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1071/2150] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:09:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:09:08.861186 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae5958-6615-4e16-a1bf-c4fca8f4da4b None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:09:08.861716 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae5958-6615-4e16-a1bf-c4fca8f4da4b None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:09:08.862082 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae5958-6615-4e16-a1bf-c4fca8f4da4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:09:08.884719 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-f2ae5958-6615-4e16-a1bf-c4fca8f4da4b None None] MFA Rules not processed for user `ac2ba7b98bfd40a49cf11263d9739e68`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:09:08.884719 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-f2ae5958-6615-4e16-a1bf-c4fca8f4da4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:09:08.946778 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1080/2151] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:09:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:09:16.306784 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=38,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:09:18.939712 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=31 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:09:34.641513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583bde43-8a84-4a02-a927-8250547beee3 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:09:34.642054 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583bde43-8a84-4a02-a927-8250547beee3 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:09:34.642156 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583bde43-8a84-4a02-a927-8250547beee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:09:34.702121 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-583bde43-8a84-4a02-a927-8250547beee3 None None] MFA Rules not processed for user `d52efc21c66d4300a8a979d92dbfeb47`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:09:34.703338 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-583bde43-8a84-4a02-a927-8250547beee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:09:34.775048 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1072/2152] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Jun 8 12:09:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:09:34.828250 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae5958-6615-4e16-a1bf-c4fca8f4da4b None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:09:34.829682 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-f2ae5958-6615-4e16-a1bf-c4fca8f4da4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:09:34.917167 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae5958-6615-4e16-a1bf-c4fca8f4da4b None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:09:34.922802 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d70389-67b3-414d-a387-81bcc28ad5cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753bde6a72d64045abd3ad44b9b0de04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:09:34.923448 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d70389-67b3-414d-a387-81bcc28ad5cc service swift] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:09:34.923730 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d70389-67b3-414d-a387-81bcc28ad5cc service swift] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:09:34.924003 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d70389-67b3-414d-a387-81bcc28ad5cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:09:34.931762 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d70389-67b3-414d-a387-81bcc28ad5cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:09:34.933385 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d70389-67b3-414d-a387-81bcc28ad5cc service swift] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:09:34.942015 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1081/2153] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Jun 8 12:09:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 08 12:09:43.373346 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583bde43-8a84-4a02-a927-8250547beee3 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:09:43.375227 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-583bde43-8a84-4a02-a927-8250547beee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:09:43.504819 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583bde43-8a84-4a02-a927-8250547beee3 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:09:43.512053 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc74c9e-344a-43b8-b4a8-4f8f5cc486ff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9009560a846414b849d42efa8625ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:09:43.512841 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc74c9e-344a-43b8-b4a8-4f8f5cc486ff service placement] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:09:43.513275 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc74c9e-344a-43b8-b4a8-4f8f5cc486ff service placement] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:09:43.513942 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc74c9e-344a-43b8-b4a8-4f8f5cc486ff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:09:43.516095 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-4bc74c9e-344a-43b8-b4a8-4f8f5cc486ff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:09:43.531651 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc74c9e-344a-43b8-b4a8-4f8f5cc486ff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:09:43.536243 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc74c9e-344a-43b8-b4a8-4f8f5cc486ff service placement] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:09:43.557100 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1073/2154] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:09:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:09:44.938786 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=41 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:09:48.080704 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d70389-67b3-414d-a387-81bcc28ad5cc service swift] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:09:48.151073 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d70389-67b3-414d-a387-81bcc28ad5cc service swift] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:09:48.156439 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3291f9-2e8b-4fe6-b27d-8452de09e3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:09:48.157553 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3291f9-2e8b-4fe6-b27d-8452de09e3ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:09:48.157938 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3291f9-2e8b-4fe6-b27d-8452de09e3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:09:48.158334 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3291f9-2e8b-4fe6-b27d-8452de09e3ab admin admin] PATH_INFO: `/v3/users/c71e4f6c1c8249c48d05c1bf6fe370de` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:09:48.159707 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3291f9-2e8b-4fe6-b27d-8452de09e3ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=c71e4f6c1c8249c48d05c1bf6fe370de)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:09:48.161779 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3291f9-2e8b-4fe6-b27d-8452de09e3ab admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:09:48.219118 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-ba3291f9-2e8b-4fe6-b27d-8452de09e3ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c71e4f6c1c8249c48d05c1bf6fe370de'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:09:48.227878 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-ba3291f9-2e8b-4fe6-b27d-8452de09e3ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c71e4f6c1c8249c48d05c1bf6fe370de'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:09:48.228608 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-ba3291f9-2e8b-4fe6-b27d-8452de09e3ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c71e4f6c1c8249c48d05c1bf6fe370de'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:09:48.229488 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-ba3291f9-2e8b-4fe6-b27d-8452de09e3ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c71e4f6c1c8249c48d05c1bf6fe370de'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:09:48.245492 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-ba3291f9-2e8b-4fe6-b27d-8452de09e3ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c71e4f6c1c8249c48d05c1bf6fe370de'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:09:48.262596 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1082/2155] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:09:48 2022] DELETE /identity/v3/users/c71e4f6c1c8249c48d05c1bf6fe370de => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:09:48.269079 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2dab4-1877-4633-90f9-17ee20ab8e7c None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:09:48.269648 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2dab4-1877-4633-90f9-17ee20ab8e7c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:09:48.269865 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2dab4-1877-4633-90f9-17ee20ab8e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:09:48.297896 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-cfd2dab4-1877-4633-90f9-17ee20ab8e7c None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:09:48.300031 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-cfd2dab4-1877-4633-90f9-17ee20ab8e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:09:48.334854 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:09:48.389113 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1074/2156] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:09:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:09:48.399049 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3291f9-2e8b-4fe6-b27d-8452de09e3ab admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:09:48.402296 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-ba3291f9-2e8b-4fe6-b27d-8452de09e3ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:09:48.487701 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3291f9-2e8b-4fe6-b27d-8452de09e3ab admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:09:48.493319 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3394c2-a58c-4053-ab5a-768f61a6192f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:09:48.494003 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3394c2-a58c-4053-ab5a-768f61a6192f service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:09:48.494288 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3394c2-a58c-4053-ab5a-768f61a6192f service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:09:48.494562 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3394c2-a58c-4053-ab5a-768f61a6192f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:09:48.516847 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3394c2-a58c-4053-ab5a-768f61a6192f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:09:48.520289 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3394c2-a58c-4053-ab5a-768f61a6192f service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:09:48.529928 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1083/2157] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:09:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:09:48.868457 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2dab4-1877-4633-90f9-17ee20ab8e7c None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:09:48.870205 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-cfd2dab4-1877-4633-90f9-17ee20ab8e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:09:48.883936 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2dab4-1877-4633-90f9-17ee20ab8e7c None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:09:48.889024 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a678c4-133e-4b0d-bf15-7fd6ac771888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:09:48.889998 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a678c4-133e-4b0d-bf15-7fd6ac771888 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:09:48.890593 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a678c4-133e-4b0d-bf15-7fd6ac771888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:09:48.891022 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a678c4-133e-4b0d-bf15-7fd6ac771888 admin admin] PATH_INFO: `/v3/projects/3472f765b1ce4d92b4025f457efdd387` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:09:48.892345 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a678c4-133e-4b0d-bf15-7fd6ac771888 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3472f765b1ce4d92b4025f457efdd387)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:09:48.894456 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a678c4-133e-4b0d-bf15-7fd6ac771888 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:09:48.947356 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-19a678c4-133e-4b0d-bf15-7fd6ac771888 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3472f765b1ce4d92b4025f457efdd387', 'request_id': 'req-19a678c4-133e-4b0d-bf15-7fd6ac771888'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:09:48.957424 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-19a678c4-133e-4b0d-bf15-7fd6ac771888 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3472f765b1ce4d92b4025f457efdd387', 'request_id': 'req-19a678c4-133e-4b0d-bf15-7fd6ac771888'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:09:48.966095 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-19a678c4-133e-4b0d-bf15-7fd6ac771888 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3472f765b1ce4d92b4025f457efdd387', 'request_id': 'req-19a678c4-133e-4b0d-bf15-7fd6ac771888'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:09:48.976441 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-19a678c4-133e-4b0d-bf15-7fd6ac771888 admin admin] The token cache is being invalidate because project 3472f765b1ce4d92b4025f457efdd387 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:09:48.977031 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-19a678c4-133e-4b0d-bf15-7fd6ac771888 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:09:48.977778 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-19a678c4-133e-4b0d-bf15-7fd6ac771888 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:09:48.979678 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1075/2158] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:09:48 2022] DELETE /identity/v3/projects/3472f765b1ce4d92b4025f457efdd387 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:09:50.621112 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd53d0-821f-4a1c-a2cc-d86c7f44eb5c None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:09:50.621581 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd53d0-821f-4a1c-a2cc-d86c7f44eb5c None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:09:50.621677 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd53d0-821f-4a1c-a2cc-d86c7f44eb5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:09:50.639285 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-dccd53d0-821f-4a1c-a2cc-d86c7f44eb5c None None] MFA Rules not processed for user `d52efc21c66d4300a8a979d92dbfeb47`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:09:50.640504 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-dccd53d0-821f-4a1c-a2cc-d86c7f44eb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:09:50.657020 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:09:50.697147 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1084/2159] 10.222.0.39 () {58 vars in 967 bytes} [Wed Jun 8 12:09:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:09:50.709475 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a678c4-133e-4b0d-bf15-7fd6ac771888 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:09:50.710859 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-19a678c4-133e-4b0d-bf15-7fd6ac771888 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:09:50.778743 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a678c4-133e-4b0d-bf15-7fd6ac771888 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:09:50.783720 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb404cfc-3100-4360-ad11-1b7aac3452b6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753bde6a72d64045abd3ad44b9b0de04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:09:50.784397 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb404cfc-3100-4360-ad11-1b7aac3452b6 service swift] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:09:50.784685 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb404cfc-3100-4360-ad11-1b7aac3452b6 service swift] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:09:50.784963 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb404cfc-3100-4360-ad11-1b7aac3452b6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:09:50.796894 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb404cfc-3100-4360-ad11-1b7aac3452b6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:09:50.799685 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb404cfc-3100-4360-ad11-1b7aac3452b6 service swift] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:09:50.808070 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1076/2160] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Jun 8 12:09:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 12:09:52.795778 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27717bbf-db97-46ec-9e58-af6e52497a09 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:09:52.796297 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27717bbf-db97-46ec-9e58-af6e52497a09 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:09:52.796432 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27717bbf-db97-46ec-9e58-af6e52497a09 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:09:52.797818 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1085/2161] 10.222.0.39 () {54 vars in 921 bytes} [Wed Jun 8 12:09:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:09:52.811085 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8451ee4-b739-4143-8f1a-ceecbfade574 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:09:52.811597 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8451ee4-b739-4143-8f1a-ceecbfade574 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:09:52.811691 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8451ee4-b739-4143-8f1a-ceecbfade574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:09:52.850823 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-a8451ee4-b739-4143-8f1a-ceecbfade574 None None] MFA Rules not processed for user `e9009560a846414b849d42efa8625ff5`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:09:52.852077 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a8451ee4-b739-4143-8f1a-ceecbfade574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:09:52.878257 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:09:52.882925 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27717bbf-db97-46ec-9e58-af6e52497a09 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:09:52.884425 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-27717bbf-db97-46ec-9e58-af6e52497a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:09:52.938654 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1077/2162] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Jun 8 12:09:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:09:52.949607 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8451ee4-b739-4143-8f1a-ceecbfade574 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:09:52.951302 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a8451ee4-b739-4143-8f1a-ceecbfade574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:09:52.963755 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8451ee4-b739-4143-8f1a-ceecbfade574 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:09:52.969237 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e586e0-4df5-478a-a172-51d1f856c844 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9009560a846414b849d42efa8625ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:09:52.969877 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e586e0-4df5-478a-a172-51d1f856c844 service placement] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:09:52.970000 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27717bbf-db97-46ec-9e58-af6e52497a09 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:09:52.970156 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e586e0-4df5-478a-a172-51d1f856c844 service placement] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:09:52.970428 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e586e0-4df5-478a-a172-51d1f856c844 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:09:52.974597 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d035109-c774-42d9-bb75-fb87f6334df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:09:52.975413 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d035109-c774-42d9-bb75-fb87f6334df2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:09:52.975697 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d035109-c774-42d9-bb75-fb87f6334df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:09:52.976007 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d035109-c774-42d9-bb75-fb87f6334df2 admin admin] PATH_INFO: `/v3/users/1d407365a3574c2387d2933b6d7ad991` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:09:52.977292 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d035109-c774-42d9-bb75-fb87f6334df2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d407365a3574c2387d2933b6d7ad991)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:09:52.978994 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e586e0-4df5-478a-a172-51d1f856c844 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:09:52.979479 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d035109-c774-42d9-bb75-fb87f6334df2 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:09:52.980603 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e586e0-4df5-478a-a172-51d1f856c844 service placement] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:09:52.991364 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1078/2163] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:09:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:09:53.029679 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-1d035109-c774-42d9-bb75-fb87f6334df2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d407365a3574c2387d2933b6d7ad991'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:09:53.036446 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-1d035109-c774-42d9-bb75-fb87f6334df2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d407365a3574c2387d2933b6d7ad991'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:09:53.037143 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-1d035109-c774-42d9-bb75-fb87f6334df2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d407365a3574c2387d2933b6d7ad991'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:09:53.037762 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-1d035109-c774-42d9-bb75-fb87f6334df2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d407365a3574c2387d2933b6d7ad991'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:09:53.050288 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-1d035109-c774-42d9-bb75-fb87f6334df2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d407365a3574c2387d2933b6d7ad991'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:09:53.064278 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1086/2164] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:09:52 2022] DELETE /identity/v3/users/1d407365a3574c2387d2933b6d7ad991 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:09:53.245742 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e586e0-4df5-478a-a172-51d1f856c844 service placement] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:09:53.259046 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e586e0-4df5-478a-a172-51d1f856c844 service placement] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:09:53.317404 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d493e20e-5f07-4a0b-875b-0db9574e99ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:09:53.318265 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493e20e-5f07-4a0b-875b-0db9574e99ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:09:53.318548 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493e20e-5f07-4a0b-875b-0db9574e99ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:09:53.318819 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493e20e-5f07-4a0b-875b-0db9574e99ff admin admin] PATH_INFO: `/v3/projects/4a9a0e01fac74e61a0a288537f30aa2b` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:09:53.319985 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d493e20e-5f07-4a0b-875b-0db9574e99ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a9a0e01fac74e61a0a288537f30aa2b)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:09:53.321919 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d493e20e-5f07-4a0b-875b-0db9574e99ff admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:09:53.366112 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d493e20e-5f07-4a0b-875b-0db9574e99ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a9a0e01fac74e61a0a288537f30aa2b', 'request_id': 'req-d493e20e-5f07-4a0b-875b-0db9574e99ff'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:09:53.373425 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d493e20e-5f07-4a0b-875b-0db9574e99ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a9a0e01fac74e61a0a288537f30aa2b', 'request_id': 'req-d493e20e-5f07-4a0b-875b-0db9574e99ff'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:09:53.378902 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d493e20e-5f07-4a0b-875b-0db9574e99ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a9a0e01fac74e61a0a288537f30aa2b', 'request_id': 'req-d493e20e-5f07-4a0b-875b-0db9574e99ff'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:09:53.390434 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d493e20e-5f07-4a0b-875b-0db9574e99ff admin admin] The token cache is being invalidate because project 4a9a0e01fac74e61a0a288537f30aa2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:09:53.390725 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d493e20e-5f07-4a0b-875b-0db9574e99ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:09:53.391354 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d493e20e-5f07-4a0b-875b-0db9574e99ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:09:53.392927 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1079/2165] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:09:53 2022] DELETE /identity/v3/projects/4a9a0e01fac74e61a0a288537f30aa2b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:09:53.397894 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7999b1c-58ed-433b-89b9-f6f3206d1041 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:09:53.398193 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7999b1c-58ed-433b-89b9-f6f3206d1041 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:09:53.398477 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7999b1c-58ed-433b-89b9-f6f3206d1041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:09:53.415758 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-d7999b1c-58ed-433b-89b9-f6f3206d1041 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:09:53.417013 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-d7999b1c-58ed-433b-89b9-f6f3206d1041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:09:53.458674 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:09:53.477656 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1087/2166] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:09:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:09:53.486342 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6887e-aa88-4f78-898a-82e05b652668 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:09:53.486636 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6887e-aa88-4f78-898a-82e05b652668 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:09:53.486923 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6887e-aa88-4f78-898a-82e05b652668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:09:53.505009 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-d2b6887e-aa88-4f78-898a-82e05b652668 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:09:53.506246 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-d2b6887e-aa88-4f78-898a-82e05b652668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:09:53.515049 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1080/2167] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:09:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:09:53.519181 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7999b1c-58ed-433b-89b9-f6f3206d1041 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:09:53.529414 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7999b1c-58ed-433b-89b9-f6f3206d1041 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:09:53.533993 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195e027-5332-4f0e-8ff8-fb38288c6411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:09:53.534648 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195e027-5332-4f0e-8ff8-fb38288c6411 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:09:53.534930 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195e027-5332-4f0e-8ff8-fb38288c6411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:09:53.535209 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195e027-5332-4f0e-8ff8-fb38288c6411 admin admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:09:53.535926 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7195e027-5332-4f0e-8ff8-fb38288c6411 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:09:53.536265 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7195e027-5332-4f0e-8ff8-fb38288c6411 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:09:53.537877 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7195e027-5332-4f0e-8ff8-fb38288c6411 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:09:53.549704 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1088/2168] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:09:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:09:53.554161 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6887e-aa88-4f78-898a-82e05b652668 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:09:53.563921 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6887e-aa88-4f78-898a-82e05b652668 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:09:53.568630 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf5f196-7f7f-47ad-9984-7e9dbea5f2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:09:53.569297 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5f196-7f7f-47ad-9984-7e9dbea5f2c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:09:53.569581 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5f196-7f7f-47ad-9984-7e9dbea5f2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:09:53.569855 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5f196-7f7f-47ad-9984-7e9dbea5f2c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:09:53.570546 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf5f196-7f7f-47ad-9984-7e9dbea5f2c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:09:53.572496 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf5f196-7f7f-47ad-9984-7e9dbea5f2c5 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:09:53.601712 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1081/2169] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:09:53 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:09:53.606086 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195e027-5332-4f0e-8ff8-fb38288c6411 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:09:53.616283 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195e027-5332-4f0e-8ff8-fb38288c6411 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:09:53.670663 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19451e0-4dec-4a8f-ab11-82553f5367a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:09:53.671333 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19451e0-4dec-4a8f-ab11-82553f5367a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:09:53.671623 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19451e0-4dec-4a8f-ab11-82553f5367a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:09:53.671898 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19451e0-4dec-4a8f-ab11-82553f5367a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:09:53.672625 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19451e0-4dec-4a8f-ab11-82553f5367a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:09:53.674536 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19451e0-4dec-4a8f-ab11-82553f5367a5 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:09:53.693126 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1089/2170] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:09:53 2022] POST /identity/v3/users => generated 293 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:09:53.697212 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf5f196-7f7f-47ad-9984-7e9dbea5f2c5 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:09:53.708142 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf5f196-7f7f-47ad-9984-7e9dbea5f2c5 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:09:53.712736 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c56923-3034-45f1-89d0-1bfda190ea9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:09:53.713392 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c56923-3034-45f1-89d0-1bfda190ea9d admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:09:53.713674 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c56923-3034-45f1-89d0-1bfda190ea9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:09:53.713954 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c56923-3034-45f1-89d0-1bfda190ea9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:09:53.714671 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c56923-3034-45f1-89d0-1bfda190ea9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:09:53.716959 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c56923-3034-45f1-89d0-1bfda190ea9d admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:09:53.722136 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:09:53.728467 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1082/2171] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:09:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 12:09:53.732532 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19451e0-4dec-4a8f-ab11-82553f5367a5 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:09:53.742640 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19451e0-4dec-4a8f-ab11-82553f5367a5 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:09:53.747308 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311abd6f-36a2-43b5-a433-5f7a90cb27bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:09:53.748035 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311abd6f-36a2-43b5-a433-5f7a90cb27bd admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:09:53.748354 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311abd6f-36a2-43b5-a433-5f7a90cb27bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:09:53.748636 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311abd6f-36a2-43b5-a433-5f7a90cb27bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:09:53.749354 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311abd6f-36a2-43b5-a433-5f7a90cb27bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:09:53.750959 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311abd6f-36a2-43b5-a433-5f7a90cb27bd admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:09:53.760777 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1090/2172] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:09:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 12:09:53.765209 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c56923-3034-45f1-89d0-1bfda190ea9d admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:09:53.774869 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c56923-3034-45f1-89d0-1bfda190ea9d admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:09:53.780320 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d44d45-a37c-4f26-865c-6f6c55dcd727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:09:53.781248 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d44d45-a37c-4f26-865c-6f6c55dcd727 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:09:53.781535 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d44d45-a37c-4f26-865c-6f6c55dcd727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:09:53.781814 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d44d45-a37c-4f26-865c-6f6c55dcd727 admin admin] PATH_INFO: `/v3/projects/7158805198014fdcb56382c8c9e52921/users/8acb027c742f4c31b47cda00cdbf44d9/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:09:53.796419 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d44d45-a37c-4f26-865c-6f6c55dcd727 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7158805198014fdcb56382c8c9e52921, user_id=8acb027c742f4c31b47cda00cdbf44d9, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:09:53.799068 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d44d45-a37c-4f26-865c-6f6c55dcd727 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:09:53.811958 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1083/2173] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:09:53 2022] PUT /identity/v3/projects/7158805198014fdcb56382c8c9e52921/users/8acb027c742f4c31b47cda00cdbf44d9/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:09:53.821579 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471435d-4f79-46b3-94dc-30de42600973 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:09:53.821988 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471435d-4f79-46b3-94dc-30de42600973 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:09:53.822141 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471435d-4f79-46b3-94dc-30de42600973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:09:53.848640 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-1471435d-4f79-46b3-94dc-30de42600973 None None] MFA Rules not processed for user `8acb027c742f4c31b47cda00cdbf44d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:09:53.849839 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-1471435d-4f79-46b3-94dc-30de42600973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:09:53.938491 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1091/2174] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:09:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:09:53.949314 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d44d45-a37c-4f26-865c-6f6c55dcd727 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:09:53.951759 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-75d44d45-a37c-4f26-865c-6f6c55dcd727 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:09:54.030451 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d44d45-a37c-4f26-865c-6f6c55dcd727 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:09:54.033979 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf17c82-be1c-49da-8a64-622fa8481bc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:09:54.034619 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf17c82-be1c-49da-8a64-622fa8481bc7 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:09:54.034903 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf17c82-be1c-49da-8a64-622fa8481bc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:09:54.035176 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf17c82-be1c-49da-8a64-622fa8481bc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:09:54.043704 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf17c82-be1c-49da-8a64-622fa8481bc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:09:54.045165 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf17c82-be1c-49da-8a64-622fa8481bc7 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:09:54.053903 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1084/2175] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:09:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:09:56.586129 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471435d-4f79-46b3-94dc-30de42600973 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:09:56.632080 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:09:56.651143 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471435d-4f79-46b3-94dc-30de42600973 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:09:56.655769 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf42b19-80fd-4a1c-92fe-8be417f291e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:09:56.656670 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf42b19-80fd-4a1c-92fe-8be417f291e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:09:56.656952 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf42b19-80fd-4a1c-92fe-8be417f291e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:09:56.657226 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf42b19-80fd-4a1c-92fe-8be417f291e7 admin admin] PATH_INFO: `/v3/users/8acb027c742f4c31b47cda00cdbf44d9` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:09:56.658410 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf42b19-80fd-4a1c-92fe-8be417f291e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8acb027c742f4c31b47cda00cdbf44d9)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:09:56.660385 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf42b19-80fd-4a1c-92fe-8be417f291e7 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:09:56.705755 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-aaf42b19-80fd-4a1c-92fe-8be417f291e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8acb027c742f4c31b47cda00cdbf44d9'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:09:56.712484 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-aaf42b19-80fd-4a1c-92fe-8be417f291e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8acb027c742f4c31b47cda00cdbf44d9'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:09:56.713131 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-aaf42b19-80fd-4a1c-92fe-8be417f291e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8acb027c742f4c31b47cda00cdbf44d9'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:09:56.713729 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-aaf42b19-80fd-4a1c-92fe-8be417f291e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8acb027c742f4c31b47cda00cdbf44d9'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:09:56.725298 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-aaf42b19-80fd-4a1c-92fe-8be417f291e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8acb027c742f4c31b47cda00cdbf44d9'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:09:56.738517 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1092/2176] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:09:56 2022] DELETE /identity/v3/users/8acb027c742f4c31b47cda00cdbf44d9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:09:56.743053 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b604181-3e94-41a8-a5be-6970e3c35875 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:09:56.743551 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b604181-3e94-41a8-a5be-6970e3c35875 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:09:56.743659 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b604181-3e94-41a8-a5be-6970e3c35875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:09:56.761923 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-2b604181-3e94-41a8-a5be-6970e3c35875 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:09:56.763148 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-2b604181-3e94-41a8-a5be-6970e3c35875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:09:56.821510 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1085/2177] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:09:56.831049 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf42b19-80fd-4a1c-92fe-8be417f291e7 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:09:56.832505 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-aaf42b19-80fd-4a1c-92fe-8be417f291e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:09:56.890925 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf42b19-80fd-4a1c-92fe-8be417f291e7 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:09:56.894545 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b998a1-4350-49bc-b8c7-9094968a5b96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:09:56.895192 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b998a1-4350-49bc-b8c7-9094968a5b96 service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:09:56.895475 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b998a1-4350-49bc-b8c7-9094968a5b96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:09:56.895750 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b998a1-4350-49bc-b8c7-9094968a5b96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:09:56.905320 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b998a1-4350-49bc-b8c7-9094968a5b96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:09:56.906745 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b998a1-4350-49bc-b8c7-9094968a5b96 service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:09:56.916002 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1093/2178] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:09:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:09:57.183882 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b604181-3e94-41a8-a5be-6970e3c35875 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:09:57.186116 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-2b604181-3e94-41a8-a5be-6970e3c35875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:09:57.198450 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b604181-3e94-41a8-a5be-6970e3c35875 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:09:57.209280 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629524dd-73fa-46b5-af5c-d69e7f0fd86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:09:57.210186 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629524dd-73fa-46b5-af5c-d69e7f0fd86f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:09:57.210560 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629524dd-73fa-46b5-af5c-d69e7f0fd86f admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:09:57.210738 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629524dd-73fa-46b5-af5c-d69e7f0fd86f admin admin] PATH_INFO: `/v3/projects/7158805198014fdcb56382c8c9e52921` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:09:57.211993 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629524dd-73fa-46b5-af5c-d69e7f0fd86f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7158805198014fdcb56382c8c9e52921)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:09:57.213992 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629524dd-73fa-46b5-af5c-d69e7f0fd86f admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:09:57.270432 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-629524dd-73fa-46b5-af5c-d69e7f0fd86f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7158805198014fdcb56382c8c9e52921', 'request_id': 'req-629524dd-73fa-46b5-af5c-d69e7f0fd86f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:09:57.274026 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:09:57.278784 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-629524dd-73fa-46b5-af5c-d69e7f0fd86f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7158805198014fdcb56382c8c9e52921', 'request_id': 'req-629524dd-73fa-46b5-af5c-d69e7f0fd86f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:09:57.285163 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-629524dd-73fa-46b5-af5c-d69e7f0fd86f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7158805198014fdcb56382c8c9e52921', 'request_id': 'req-629524dd-73fa-46b5-af5c-d69e7f0fd86f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:09:57.295962 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-629524dd-73fa-46b5-af5c-d69e7f0fd86f admin admin] The token cache is being invalidate because project 7158805198014fdcb56382c8c9e52921 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:09:57.296278 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-629524dd-73fa-46b5-af5c-d69e7f0fd86f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:09:57.296910 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-629524dd-73fa-46b5-af5c-d69e7f0fd86f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:09:57.298429 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1086/2179] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:09:57 2022] DELETE /identity/v3/projects/7158805198014fdcb56382c8c9e52921 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:09:57.303244 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4df79f-6d5b-4187-9a35-16db237952f3 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:09:57.303535 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4df79f-6d5b-4187-9a35-16db237952f3 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:09:57.303816 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4df79f-6d5b-4187-9a35-16db237952f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:09:57.320964 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-7e4df79f-6d5b-4187-9a35-16db237952f3 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:09:57.322160 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-7e4df79f-6d5b-4187-9a35-16db237952f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:09:57.380240 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1094/2180] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:09:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:09:57.388552 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd09d09-fea5-4ddf-97bc-08ffe1e13d24 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:09:57.388833 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd09d09-fea5-4ddf-97bc-08ffe1e13d24 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:09:57.389120 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd09d09-fea5-4ddf-97bc-08ffe1e13d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:09:57.407834 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-0cd09d09-fea5-4ddf-97bc-08ffe1e13d24 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:09:57.409059 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-0cd09d09-fea5-4ddf-97bc-08ffe1e13d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:09:57.416897 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1087/2181] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:09:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:09:57.420995 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4df79f-6d5b-4187-9a35-16db237952f3 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:09:57.427150 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:09:57.431216 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4df79f-6d5b-4187-9a35-16db237952f3 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:09:57.437087 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334553f-37c2-40cd-8564-b5784e8d4a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:09:57.437974 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334553f-37c2-40cd-8564-b5784e8d4a5d admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:09:57.438408 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334553f-37c2-40cd-8564-b5784e8d4a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:09:57.438845 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334553f-37c2-40cd-8564-b5784e8d4a5d admin admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:09:57.439571 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0334553f-37c2-40cd-8564-b5784e8d4a5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:09:57.439884 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0334553f-37c2-40cd-8564-b5784e8d4a5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:09:57.441534 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0334553f-37c2-40cd-8564-b5784e8d4a5d admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:09:57.453486 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1095/2182] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:09:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:09:57.457594 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd09d09-fea5-4ddf-97bc-08ffe1e13d24 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:09:57.466951 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd09d09-fea5-4ddf-97bc-08ffe1e13d24 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:09:57.471554 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ce7c5-e6a6-4634-a1f0-0a3b39f765ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:09:57.472237 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ce7c5-e6a6-4634-a1f0-0a3b39f765ee admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:09:57.472524 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ce7c5-e6a6-4634-a1f0-0a3b39f765ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:09:57.472803 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ce7c5-e6a6-4634-a1f0-0a3b39f765ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:09:57.473503 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30ce7c5-e6a6-4634-a1f0-0a3b39f765ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:09:57.475400 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30ce7c5-e6a6-4634-a1f0-0a3b39f765ee admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:09:57.500761 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1088/2183] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:09:57 2022] POST /identity/v3/projects => generated 363 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:09:57.504726 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334553f-37c2-40cd-8564-b5784e8d4a5d admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:09:57.515320 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334553f-37c2-40cd-8564-b5784e8d4a5d admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:09:57.580729 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f84816-c43c-43a5-8d2b-73de468d34d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:09:57.580729 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f84816-c43c-43a5-8d2b-73de468d34d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:09:57.580729 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f84816-c43c-43a5-8d2b-73de468d34d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:09:57.580729 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f84816-c43c-43a5-8d2b-73de468d34d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:09:57.581207 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f84816-c43c-43a5-8d2b-73de468d34d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:09:57.581207 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f84816-c43c-43a5-8d2b-73de468d34d0 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:09:57.602509 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1096/2184] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:09:57 2022] POST /identity/v3/users => generated 282 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:09:57.606877 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ce7c5-e6a6-4634-a1f0-0a3b39f765ee admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:09:57.617014 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ce7c5-e6a6-4634-a1f0-0a3b39f765ee admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:09:57.621583 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e92bd-9f86-4686-b594-fc6b97c6ff7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:09:57.622731 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e92bd-9f86-4686-b594-fc6b97c6ff7d admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:09:57.623012 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e92bd-9f86-4686-b594-fc6b97c6ff7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:09:57.623291 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e92bd-9f86-4686-b594-fc6b97c6ff7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:09:57.624020 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e92bd-9f86-4686-b594-fc6b97c6ff7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:09:57.625648 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e92bd-9f86-4686-b594-fc6b97c6ff7d admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:09:57.636553 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1089/2185] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:09:57.642358 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f84816-c43c-43a5-8d2b-73de468d34d0 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:09:57.652277 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f84816-c43c-43a5-8d2b-73de468d34d0 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:09:57.657038 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d9466-b631-4980-b669-c435fe147376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:09:57.657710 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d9466-b631-4980-b669-c435fe147376 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:09:57.657994 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d9466-b631-4980-b669-c435fe147376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:09:57.658271 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d9466-b631-4980-b669-c435fe147376 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:09:57.658994 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d9466-b631-4980-b669-c435fe147376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:09:57.660646 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d9466-b631-4980-b669-c435fe147376 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:09:57.671127 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1097/2186] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:09:57.675366 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e92bd-9f86-4686-b594-fc6b97c6ff7d admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:09:57.685842 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e92bd-9f86-4686-b594-fc6b97c6ff7d admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:09:57.690680 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800260a2-3ea7-41b2-ba0c-18920b69affe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:09:57.691568 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800260a2-3ea7-41b2-ba0c-18920b69affe admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:09:57.691857 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800260a2-3ea7-41b2-ba0c-18920b69affe admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:09:57.692139 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800260a2-3ea7-41b2-ba0c-18920b69affe admin admin] PATH_INFO: `/v3/projects/76d52258cdd140729eead82dfba140da/users/c1c9d4122bff4b81b771668c763af8f6/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:09:57.708051 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800260a2-3ea7-41b2-ba0c-18920b69affe admin admin] RBAC: Authorizing `identity:create_grant(project_id=76d52258cdd140729eead82dfba140da, user_id=c1c9d4122bff4b81b771668c763af8f6, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:09:57.710736 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800260a2-3ea7-41b2-ba0c-18920b69affe admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:09:57.723778 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1090/2187] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:09:57 2022] PUT /identity/v3/projects/76d52258cdd140729eead82dfba140da/users/c1c9d4122bff4b81b771668c763af8f6/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:09:57.734172 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8f5d8-0be3-43d9-8089-5928907c9512 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:09:57.734461 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8f5d8-0be3-43d9-8089-5928907c9512 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:09:57.734736 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8f5d8-0be3-43d9-8089-5928907c9512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:09:57.760723 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-c6f8f5d8-0be3-43d9-8089-5928907c9512 None None] MFA Rules not processed for user `c1c9d4122bff4b81b771668c763af8f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:09:57.761916 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-c6f8f5d8-0be3-43d9-8089-5928907c9512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:09:57.824113 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1098/2188] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:09:57 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:09:57.835581 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800260a2-3ea7-41b2-ba0c-18920b69affe admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:09:57.837338 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-800260a2-3ea7-41b2-ba0c-18920b69affe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:09:57.897264 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800260a2-3ea7-41b2-ba0c-18920b69affe admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:09:57.900765 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ae422-ab3b-4725-8e96-952adfd4bf2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:09:57.901424 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ae422-ab3b-4725-8e96-952adfd4bf2a service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:09:57.901707 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ae422-ab3b-4725-8e96-952adfd4bf2a service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:09:57.901981 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ae422-ab3b-4725-8e96-952adfd4bf2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:09:57.910658 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947ae422-ab3b-4725-8e96-952adfd4bf2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:09:57.912325 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947ae422-ab3b-4725-8e96-952adfd4bf2a service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:09:57.921505 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1091/2189] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:09:57 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:10:07.821125 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=70,keystone:INSERT=3 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:10:07.917449 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=59,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:10:45.289531 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f8f5d8-0be3-43d9-8089-5928907c9512 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:10:45.351672 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f8f5d8-0be3-43d9-8089-5928907c9512 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:10:45.356465 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd7675-e3f8-4177-8f42-de8ac327479d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:10:45.357347 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd7675-e3f8-4177-8f42-de8ac327479d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:10:45.357637 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd7675-e3f8-4177-8f42-de8ac327479d admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:10:45.357936 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd7675-e3f8-4177-8f42-de8ac327479d admin admin] PATH_INFO: `/v3/users/c1c9d4122bff4b81b771668c763af8f6` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:10:45.359124 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd7675-e3f8-4177-8f42-de8ac327479d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1c9d4122bff4b81b771668c763af8f6)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:10:45.361646 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd7675-e3f8-4177-8f42-de8ac327479d admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:10:45.406771 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-25dd7675-e3f8-4177-8f42-de8ac327479d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1c9d4122bff4b81b771668c763af8f6'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:10:45.413677 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-25dd7675-e3f8-4177-8f42-de8ac327479d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1c9d4122bff4b81b771668c763af8f6'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:10:45.414406 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-25dd7675-e3f8-4177-8f42-de8ac327479d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1c9d4122bff4b81b771668c763af8f6'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:10:45.415014 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-25dd7675-e3f8-4177-8f42-de8ac327479d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1c9d4122bff4b81b771668c763af8f6'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:10:45.427215 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-25dd7675-e3f8-4177-8f42-de8ac327479d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1c9d4122bff4b81b771668c763af8f6'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:10:45.438946 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1099/2190] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:10:45 2022] DELETE /identity/v3/users/c1c9d4122bff4b81b771668c763af8f6 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:10:45.444042 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37a158-a5cf-4cbb-9bd0-f76afd842f52 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:10:45.444557 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37a158-a5cf-4cbb-9bd0-f76afd842f52 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:10:45.444663 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37a158-a5cf-4cbb-9bd0-f76afd842f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:10:45.461062 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-0f37a158-a5cf-4cbb-9bd0-f76afd842f52 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:10:45.462256 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-0f37a158-a5cf-4cbb-9bd0-f76afd842f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:10:45.520838 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1092/2191] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:10:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:10:45.537339 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd7675-e3f8-4177-8f42-de8ac327479d admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:10:45.538865 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-25dd7675-e3f8-4177-8f42-de8ac327479d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:10:45.612032 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd7675-e3f8-4177-8f42-de8ac327479d admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:10:45.615728 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d85a6-5e59-44f0-9af0-def0c8b2a1a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:10:45.616418 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d85a6-5e59-44f0-9af0-def0c8b2a1a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:10:45.616735 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d85a6-5e59-44f0-9af0-def0c8b2a1a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:10:45.617015 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d85a6-5e59-44f0-9af0-def0c8b2a1a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:10:45.625907 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d85a6-5e59-44f0-9af0-def0c8b2a1a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:10:45.627349 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d85a6-5e59-44f0-9af0-def0c8b2a1a1 service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:10:45.636677 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1100/2192] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:10:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:10:45.905876 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37a158-a5cf-4cbb-9bd0-f76afd842f52 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:10:45.907286 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-0f37a158-a5cf-4cbb-9bd0-f76afd842f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:10:45.923215 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37a158-a5cf-4cbb-9bd0-f76afd842f52 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:10:45.928125 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24409a44-707a-45b0-b805-088f5f63521d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:10:45.929383 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24409a44-707a-45b0-b805-088f5f63521d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:10:45.929745 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24409a44-707a-45b0-b805-088f5f63521d admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:10:45.929937 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24409a44-707a-45b0-b805-088f5f63521d admin admin] PATH_INFO: `/v3/projects/76d52258cdd140729eead82dfba140da` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:10:45.931212 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24409a44-707a-45b0-b805-088f5f63521d admin admin] RBAC: Authorizing `identity:delete_project(project_id=76d52258cdd140729eead82dfba140da)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:10:45.933108 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24409a44-707a-45b0-b805-088f5f63521d admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:10:45.980246 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-24409a44-707a-45b0-b805-088f5f63521d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76d52258cdd140729eead82dfba140da', 'request_id': 'req-24409a44-707a-45b0-b805-088f5f63521d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:10:45.987320 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-24409a44-707a-45b0-b805-088f5f63521d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76d52258cdd140729eead82dfba140da', 'request_id': 'req-24409a44-707a-45b0-b805-088f5f63521d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:10:45.993194 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-24409a44-707a-45b0-b805-088f5f63521d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76d52258cdd140729eead82dfba140da', 'request_id': 'req-24409a44-707a-45b0-b805-088f5f63521d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:10:46.004220 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-24409a44-707a-45b0-b805-088f5f63521d admin admin] The token cache is being invalidate because project 76d52258cdd140729eead82dfba140da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:10:46.004514 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-24409a44-707a-45b0-b805-088f5f63521d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:10:46.005142 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-24409a44-707a-45b0-b805-088f5f63521d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:10:46.006686 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1093/2193] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:10:45 2022] DELETE /identity/v3/projects/76d52258cdd140729eead82dfba140da => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:10:46.011476 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5f06f-d9f3-46b0-9cbd-563bd3b40935 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:10:46.011772 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5f06f-d9f3-46b0-9cbd-563bd3b40935 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:10:46.012051 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5f06f-d9f3-46b0-9cbd-563bd3b40935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:10:46.029971 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-83b5f06f-d9f3-46b0-9cbd-563bd3b40935 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:10:46.031219 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-83b5f06f-d9f3-46b0-9cbd-563bd3b40935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:10:46.048617 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:10:46.093998 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1101/2194] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:10:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:10:46.102711 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88a646-eb70-43d4-b90c-9a03be46389d None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:10:46.103007 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88a646-eb70-43d4-b90c-9a03be46389d None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:10:46.103293 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88a646-eb70-43d4-b90c-9a03be46389d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:10:46.122383 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-8e88a646-eb70-43d4-b90c-9a03be46389d None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:10:46.123612 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-8e88a646-eb70-43d4-b90c-9a03be46389d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:10:46.132094 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1094/2195] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:10:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:10:46.136322 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b5f06f-d9f3-46b0-9cbd-563bd3b40935 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:10:46.147331 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b5f06f-d9f3-46b0-9cbd-563bd3b40935 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:10:46.152210 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c83fd-a97f-48e5-ad45-ab8a17137861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:10:46.152907 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c83fd-a97f-48e5-ad45-ab8a17137861 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:10:46.153192 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c83fd-a97f-48e5-ad45-ab8a17137861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:10:46.153472 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c83fd-a97f-48e5-ad45-ab8a17137861 admin admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:10:46.154239 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c83fd-a97f-48e5-ad45-ab8a17137861 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:10:46.154551 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c83fd-a97f-48e5-ad45-ab8a17137861 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:10:46.156195 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c83fd-a97f-48e5-ad45-ab8a17137861 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:10:46.168755 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1102/2196] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:10:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:10:46.172843 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e88a646-eb70-43d4-b90c-9a03be46389d None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:10:46.182453 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e88a646-eb70-43d4-b90c-9a03be46389d None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:10:46.187001 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b499e-3c2f-477b-85d8-de7974ec60eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:10:46.187648 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b499e-3c2f-477b-85d8-de7974ec60eb admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:10:46.187935 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b499e-3c2f-477b-85d8-de7974ec60eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:10:46.188243 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b499e-3c2f-477b-85d8-de7974ec60eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:10:46.188938 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601b499e-3c2f-477b-85d8-de7974ec60eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:10:46.191283 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601b499e-3c2f-477b-85d8-de7974ec60eb admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:10:46.219324 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1095/2197] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:10:46 2022] POST /identity/v3/projects => generated 399 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:10:46.221468 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c83fd-a97f-48e5-ad45-ab8a17137861 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:10:46.231961 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c83fd-a97f-48e5-ad45-ab8a17137861 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:10:46.289163 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e05aab-d678-40aa-b808-35fe24cdbeda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:10:46.289766 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e05aab-d678-40aa-b808-35fe24cdbeda admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:10:46.290326 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e05aab-d678-40aa-b808-35fe24cdbeda admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:10:46.290326 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e05aab-d678-40aa-b808-35fe24cdbeda admin admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:10:46.291006 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e05aab-d678-40aa-b808-35fe24cdbeda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:10:46.292993 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e05aab-d678-40aa-b808-35fe24cdbeda admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:10:46.313367 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1103/2198] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:10:46 2022] POST /identity/v3/users => generated 300 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:10:46.319076 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b499e-3c2f-477b-85d8-de7974ec60eb admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:10:46.330682 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b499e-3c2f-477b-85d8-de7974ec60eb admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:10:46.335294 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b3103-8fa3-4f16-8ba1-1be0eb4bc284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:10:46.335951 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b3103-8fa3-4f16-8ba1-1be0eb4bc284 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:10:46.336261 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b3103-8fa3-4f16-8ba1-1be0eb4bc284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:10:46.336565 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b3103-8fa3-4f16-8ba1-1be0eb4bc284 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:10:46.337290 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17b3103-8fa3-4f16-8ba1-1be0eb4bc284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:10:46.338886 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17b3103-8fa3-4f16-8ba1-1be0eb4bc284 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:10:46.349262 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1096/2199] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:10:46.353226 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e05aab-d678-40aa-b808-35fe24cdbeda admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:10:46.363496 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e05aab-d678-40aa-b808-35fe24cdbeda admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:10:46.368141 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0496c0-565f-4d45-9ec8-9bfa5f4cf4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:10:46.368820 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0496c0-565f-4d45-9ec8-9bfa5f4cf4e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:10:46.369109 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0496c0-565f-4d45-9ec8-9bfa5f4cf4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:10:46.369389 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0496c0-565f-4d45-9ec8-9bfa5f4cf4e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:10:46.370109 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0496c0-565f-4d45-9ec8-9bfa5f4cf4e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:10:46.371703 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0496c0-565f-4d45-9ec8-9bfa5f4cf4e5 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:10:46.382146 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1104/2200] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 12:10:46.386039 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b3103-8fa3-4f16-8ba1-1be0eb4bc284 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:10:46.396376 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b3103-8fa3-4f16-8ba1-1be0eb4bc284 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:10:46.400946 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6513187-ae60-4516-9722-de99d6902e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:10:46.402050 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6513187-ae60-4516-9722-de99d6902e4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:10:46.402050 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6513187-ae60-4516-9722-de99d6902e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:10:46.402332 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6513187-ae60-4516-9722-de99d6902e4d admin admin] PATH_INFO: `/v3/projects/c99c5bee01c64710878a2f8b18038892/users/7490c757be1a42ac942c342ebe944f65/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:10:46.416612 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6513187-ae60-4516-9722-de99d6902e4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c99c5bee01c64710878a2f8b18038892, user_id=7490c757be1a42ac942c342ebe944f65, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:10:46.419232 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6513187-ae60-4516-9722-de99d6902e4d admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:10:46.432767 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1097/2201] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:10:46 2022] PUT /identity/v3/projects/c99c5bee01c64710878a2f8b18038892/users/7490c757be1a42ac942c342ebe944f65/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:10:46.498115 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edab94a-0369-4a8d-97ea-d3142f24d45c None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:10:46.498406 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edab94a-0369-4a8d-97ea-d3142f24d45c None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:10:46.498690 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edab94a-0369-4a8d-97ea-d3142f24d45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:10:46.525851 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-3edab94a-0369-4a8d-97ea-d3142f24d45c None None] MFA Rules not processed for user `7490c757be1a42ac942c342ebe944f65`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:10:46.527046 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-3edab94a-0369-4a8d-97ea-d3142f24d45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:10:46.591873 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1105/2202] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:10:46 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:10:46.605548 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6513187-ae60-4516-9722-de99d6902e4d admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:10:46.607287 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f6513187-ae60-4516-9722-de99d6902e4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:10:46.630484 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:10:46.680655 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6513187-ae60-4516-9722-de99d6902e4d admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:10:46.684262 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4282c48-5374-4bf3-885d-e42db9f24bdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:10:46.684911 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4282c48-5374-4bf3-885d-e42db9f24bdc service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:10:46.685192 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4282c48-5374-4bf3-885d-e42db9f24bdc service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:10:46.685466 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4282c48-5374-4bf3-885d-e42db9f24bdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:10:46.694382 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4282c48-5374-4bf3-885d-e42db9f24bdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:10:46.695807 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4282c48-5374-4bf3-885d-e42db9f24bdc service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:10:46.705217 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1098/2203] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:10:46 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:10:49.356290 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859d78f-419f-4f73-942f-f186199a7a8c None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:10:49.356802 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859d78f-419f-4f73-942f-f186199a7a8c None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:10:49.356915 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859d78f-419f-4f73-942f-f186199a7a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:10:49.373987 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-3859d78f-419f-4f73-942f-f186199a7a8c None None] MFA Rules not processed for user `38475bbe086b451fb78750ce6606dfa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:10:49.375967 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-3859d78f-419f-4f73-942f-f186199a7a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:10:49.398303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:10:49.454450 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1106/2204] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:10:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:10:55.911043 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4282c48-5374-4bf3-885d-e42db9f24bdc service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:10:55.972968 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4282c48-5374-4bf3-885d-e42db9f24bdc service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:10:55.977536 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989123e-1646-4c9e-be20-7b1857a4462f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:10:55.978676 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989123e-1646-4c9e-be20-7b1857a4462f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:10:55.978965 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989123e-1646-4c9e-be20-7b1857a4462f admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:10:55.979246 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989123e-1646-4c9e-be20-7b1857a4462f admin admin] PATH_INFO: `/v3/users/7490c757be1a42ac942c342ebe944f65` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:10:55.980492 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7989123e-1646-4c9e-be20-7b1857a4462f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7490c757be1a42ac942c342ebe944f65)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:10:55.982423 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7989123e-1646-4c9e-be20-7b1857a4462f admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:10:56.030413 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-7989123e-1646-4c9e-be20-7b1857a4462f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7490c757be1a42ac942c342ebe944f65'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:10:56.031079 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-7989123e-1646-4c9e-be20-7b1857a4462f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7490c757be1a42ac942c342ebe944f65'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:10:56.031679 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-7989123e-1646-4c9e-be20-7b1857a4462f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7490c757be1a42ac942c342ebe944f65'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:10:56.039153 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-7989123e-1646-4c9e-be20-7b1857a4462f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7490c757be1a42ac942c342ebe944f65'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:10:56.052000 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-7989123e-1646-4c9e-be20-7b1857a4462f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7490c757be1a42ac942c342ebe944f65'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:10:56.066070 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1099/2205] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:10:55 2022] DELETE /identity/v3/users/7490c757be1a42ac942c342ebe944f65 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:10:56.070510 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421ef78-7578-4cdb-9cbd-09fa012b8667 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:10:56.071012 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421ef78-7578-4cdb-9cbd-09fa012b8667 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:10:56.071145 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421ef78-7578-4cdb-9cbd-09fa012b8667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:10:56.088233 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-b421ef78-7578-4cdb-9cbd-09fa012b8667 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:10:56.089426 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-b421ef78-7578-4cdb-9cbd-09fa012b8667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:10:56.147664 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1107/2206] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:10:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:10:56.157082 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989123e-1646-4c9e-be20-7b1857a4462f admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:10:56.158969 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-7989123e-1646-4c9e-be20-7b1857a4462f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:10:56.203914 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:10:56.217408 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989123e-1646-4c9e-be20-7b1857a4462f admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:10:56.221528 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af37e601-6235-4367-b0f5-c68c42518cf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:10:56.222175 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af37e601-6235-4367-b0f5-c68c42518cf1 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:10:56.222465 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af37e601-6235-4367-b0f5-c68c42518cf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:10:56.222741 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af37e601-6235-4367-b0f5-c68c42518cf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:10:56.231960 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af37e601-6235-4367-b0f5-c68c42518cf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:10:56.233439 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af37e601-6235-4367-b0f5-c68c42518cf1 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:10:56.243320 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1100/2207] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:10:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:10:56.509400 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421ef78-7578-4cdb-9cbd-09fa012b8667 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:10:56.510914 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-b421ef78-7578-4cdb-9cbd-09fa012b8667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:10:56.524193 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421ef78-7578-4cdb-9cbd-09fa012b8667 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:10:56.529172 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0346527-1d06-4a55-a61d-72b3d72ef33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:10:56.530036 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0346527-1d06-4a55-a61d-72b3d72ef33c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:10:56.530306 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0346527-1d06-4a55-a61d-72b3d72ef33c admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:10:56.530585 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0346527-1d06-4a55-a61d-72b3d72ef33c admin admin] PATH_INFO: `/v3/projects/c99c5bee01c64710878a2f8b18038892` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:10:56.532256 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0346527-1d06-4a55-a61d-72b3d72ef33c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c99c5bee01c64710878a2f8b18038892)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:10:56.534264 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0346527-1d06-4a55-a61d-72b3d72ef33c admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:10:56.590282 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-c0346527-1d06-4a55-a61d-72b3d72ef33c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c99c5bee01c64710878a2f8b18038892', 'request_id': 'req-c0346527-1d06-4a55-a61d-72b3d72ef33c'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:10:56.600831 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-c0346527-1d06-4a55-a61d-72b3d72ef33c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c99c5bee01c64710878a2f8b18038892', 'request_id': 'req-c0346527-1d06-4a55-a61d-72b3d72ef33c'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:10:56.608013 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-c0346527-1d06-4a55-a61d-72b3d72ef33c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c99c5bee01c64710878a2f8b18038892', 'request_id': 'req-c0346527-1d06-4a55-a61d-72b3d72ef33c'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:10:56.622357 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-c0346527-1d06-4a55-a61d-72b3d72ef33c admin admin] The token cache is being invalidate because project c99c5bee01c64710878a2f8b18038892 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:10:56.622868 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-c0346527-1d06-4a55-a61d-72b3d72ef33c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:10:56.623965 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-c0346527-1d06-4a55-a61d-72b3d72ef33c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:10:56.626371 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1108/2208] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:10:56 2022] DELETE /identity/v3/projects/c99c5bee01c64710878a2f8b18038892 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:10:56.636237 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c03498-a4c5-413c-ba74-4834d2021c0c None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:10:56.636733 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c03498-a4c5-413c-ba74-4834d2021c0c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:10:56.637017 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c03498-a4c5-413c-ba74-4834d2021c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:10:56.656205 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-42c03498-a4c5-413c-ba74-4834d2021c0c None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:10:56.657516 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-42c03498-a4c5-413c-ba74-4834d2021c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:10:56.721286 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1101/2209] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:10:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:10:56.729282 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ff3e2-4149-412e-99f2-b3fd6e758d6d None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:10:56.729571 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ff3e2-4149-412e-99f2-b3fd6e758d6d None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:10:56.729848 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ff3e2-4149-412e-99f2-b3fd6e758d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:10:56.748618 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-f90ff3e2-4149-412e-99f2-b3fd6e758d6d None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:10:56.749801 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-f90ff3e2-4149-412e-99f2-b3fd6e758d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:10:56.758000 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1109/2210] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:10:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:10:56.761959 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c03498-a4c5-413c-ba74-4834d2021c0c None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:10:56.772291 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c03498-a4c5-413c-ba74-4834d2021c0c None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:10:56.777025 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa90d693-52de-435e-a1ab-b49ad1fcaba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:10:56.777694 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa90d693-52de-435e-a1ab-b49ad1fcaba8 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:10:56.777974 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa90d693-52de-435e-a1ab-b49ad1fcaba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:10:56.778246 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa90d693-52de-435e-a1ab-b49ad1fcaba8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:10:56.778975 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa90d693-52de-435e-a1ab-b49ad1fcaba8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:10:56.779285 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa90d693-52de-435e-a1ab-b49ad1fcaba8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:10:56.780934 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa90d693-52de-435e-a1ab-b49ad1fcaba8 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:10:56.793979 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1102/2211] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:10:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:10:56.798185 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ff3e2-4149-412e-99f2-b3fd6e758d6d None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:10:56.807649 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ff3e2-4149-412e-99f2-b3fd6e758d6d None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:10:56.812499 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4271ace5-f664-4136-bd8d-ab23e3d66a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:10:56.813153 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271ace5-f664-4136-bd8d-ab23e3d66a14 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:10:56.813459 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271ace5-f664-4136-bd8d-ab23e3d66a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:10:56.813743 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271ace5-f664-4136-bd8d-ab23e3d66a14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:10:56.814424 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4271ace5-f664-4136-bd8d-ab23e3d66a14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:10:56.819850 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4271ace5-f664-4136-bd8d-ab23e3d66a14 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:10:56.851974 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1110/2212] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:10:56 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 12:10:56.854352 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa90d693-52de-435e-a1ab-b49ad1fcaba8 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:10:56.866248 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa90d693-52de-435e-a1ab-b49ad1fcaba8 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:10:56.927730 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff32940-16ae-4a67-bc6b-8ab25fdf0cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:10:56.928458 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff32940-16ae-4a67-bc6b-8ab25fdf0cc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:10:56.928729 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff32940-16ae-4a67-bc6b-8ab25fdf0cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:10:56.929010 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff32940-16ae-4a67-bc6b-8ab25fdf0cc7 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:10:56.929703 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff32940-16ae-4a67-bc6b-8ab25fdf0cc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:10:56.932100 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff32940-16ae-4a67-bc6b-8ab25fdf0cc7 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:10:56.966943 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1103/2213] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:10:56 2022] POST /identity/v3/users => generated 289 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:10:56.968144 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4271ace5-f664-4136-bd8d-ab23e3d66a14 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:10:56.979507 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4271ace5-f664-4136-bd8d-ab23e3d66a14 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:10:56.984630 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c6ce40-adb3-435a-9802-4d0927f92827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:10:56.985352 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6ce40-adb3-435a-9802-4d0927f92827 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:10:56.985730 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6ce40-adb3-435a-9802-4d0927f92827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:10:56.986208 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6ce40-adb3-435a-9802-4d0927f92827 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:10:56.987066 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c6ce40-adb3-435a-9802-4d0927f92827 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:10:56.989729 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c6ce40-adb3-435a-9802-4d0927f92827 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:10:57.005063 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1111/2214] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:10:57.006058 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff32940-16ae-4a67-bc6b-8ab25fdf0cc7 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:10:57.017048 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff32940-16ae-4a67-bc6b-8ab25fdf0cc7 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:10:57.022663 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cd0dea-6dc6-49fe-a2bf-80dd412091ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:10:57.023337 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd0dea-6dc6-49fe-a2bf-80dd412091ab admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:10:57.023621 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd0dea-6dc6-49fe-a2bf-80dd412091ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:10:57.023897 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd0dea-6dc6-49fe-a2bf-80dd412091ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:10:57.024671 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cd0dea-6dc6-49fe-a2bf-80dd412091ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:10:57.026268 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cd0dea-6dc6-49fe-a2bf-80dd412091ab admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:10:57.040934 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1104/2215] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 12:10:57.045112 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c6ce40-adb3-435a-9802-4d0927f92827 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:10:57.056002 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c6ce40-adb3-435a-9802-4d0927f92827 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:10:57.060618 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca22c2-be01-4dcb-ab42-3dc4883d4670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:10:57.061495 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca22c2-be01-4dcb-ab42-3dc4883d4670 admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:10:57.061779 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca22c2-be01-4dcb-ab42-3dc4883d4670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:10:57.062056 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca22c2-be01-4dcb-ab42-3dc4883d4670 admin admin] PATH_INFO: `/v3/projects/7460a664cf154be08f3df2ec025632e2/users/5a2945ee4e3f4c6a91fef4978bcbfd88/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:10:57.064258 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:10:57.078966 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ca22c2-be01-4dcb-ab42-3dc4883d4670 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7460a664cf154be08f3df2ec025632e2, user_id=5a2945ee4e3f4c6a91fef4978bcbfd88, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:10:57.081788 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ca22c2-be01-4dcb-ab42-3dc4883d4670 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:10:57.093953 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1112/2216] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:10:57 2022] PUT /identity/v3/projects/7460a664cf154be08f3df2ec025632e2/users/5a2945ee4e3f4c6a91fef4978bcbfd88/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:10:57.099082 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f570f-cc57-4ecc-b14b-04409a69e89c None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:10:57.099395 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f570f-cc57-4ecc-b14b-04409a69e89c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:10:57.099701 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f570f-cc57-4ecc-b14b-04409a69e89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:10:57.118052 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-704f570f-cc57-4ecc-b14b-04409a69e89c None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:10:57.119240 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-704f570f-cc57-4ecc-b14b-04409a69e89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:10:57.162735 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:10:57.179111 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1105/2217] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:10:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:10:57.188652 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca22c2-be01-4dcb-ab42-3dc4883d4670 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:10:57.190259 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-93ca22c2-be01-4dcb-ab42-3dc4883d4670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:10:57.246721 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca22c2-be01-4dcb-ab42-3dc4883d4670 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:10:57.250380 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a48262-8660-4cd3-9dd1-f9b40bb73c51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:10:57.251029 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a48262-8660-4cd3-9dd1-f9b40bb73c51 service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:10:57.251317 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a48262-8660-4cd3-9dd1-f9b40bb73c51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:10:57.251595 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a48262-8660-4cd3-9dd1-f9b40bb73c51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:10:57.261338 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a48262-8660-4cd3-9dd1-f9b40bb73c51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:10:57.262782 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a48262-8660-4cd3-9dd1-f9b40bb73c51 service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:10:57.272535 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1113/2218] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:10:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:11:01.737082 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d116d-61cc-4dab-ae69-e3a839f39b4c None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:11:01.737549 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d116d-61cc-4dab-ae69-e3a839f39b4c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:11:01.737707 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d116d-61cc-4dab-ae69-e3a839f39b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:11:01.767129 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-6f4d116d-61cc-4dab-ae69-e3a839f39b4c None None] MFA Rules not processed for user `5a2945ee4e3f4c6a91fef4978bcbfd88`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:11:01.768466 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-6f4d116d-61cc-4dab-ae69-e3a839f39b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:11:01.835103 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1106/2219] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:11:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:11:01.839812 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a48262-8660-4cd3-9dd1-f9b40bb73c51 service neutron] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:11:01.850711 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a48262-8660-4cd3-9dd1-f9b40bb73c51 service neutron] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:11:01.856064 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e94779-e402-460f-8854-f10a44de8955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:11:01.857090 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e94779-e402-460f-8854-f10a44de8955 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:11:01.857378 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e94779-e402-460f-8854-f10a44de8955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:11:01.857655 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e94779-e402-460f-8854-f10a44de8955 admin admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:11:01.858389 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e94779-e402-460f-8854-f10a44de8955 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:11:01.860375 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e94779-e402-460f-8854-f10a44de8955 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:11:01.885955 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1114/2220] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:11:01 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 12:11:01.890074 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d116d-61cc-4dab-ae69-e3a839f39b4c None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:11:01.901254 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d116d-61cc-4dab-ae69-e3a839f39b4c None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:11:01.956026 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a7a1d-bed9-4704-a0ff-5918a6618933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:11:01.957359 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a7a1d-bed9-4704-a0ff-5918a6618933 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:11:01.957864 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a7a1d-bed9-4704-a0ff-5918a6618933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:11:01.958231 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a7a1d-bed9-4704-a0ff-5918a6618933 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:11:01.958931 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a7a1d-bed9-4704-a0ff-5918a6618933 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:11:01.960890 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a7a1d-bed9-4704-a0ff-5918a6618933 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:11:01.982644 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1107/2221] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:11:01 2022] POST /identity/v3/users => generated 295 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:11:01.986713 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e94779-e402-460f-8854-f10a44de8955 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:11:01.998040 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e94779-e402-460f-8854-f10a44de8955 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:11:02.003248 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0fc7f-3535-445b-8444-d56386dff62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:11:02.004797 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0fc7f-3535-445b-8444-d56386dff62c admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:11:02.005157 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0fc7f-3535-445b-8444-d56386dff62c admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:11:02.005507 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0fc7f-3535-445b-8444-d56386dff62c admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:11:02.006324 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df0fc7f-3535-445b-8444-d56386dff62c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:11:02.007991 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df0fc7f-3535-445b-8444-d56386dff62c admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:11:02.020210 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1115/2222] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:11:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 12:11:02.024448 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a7a1d-bed9-4704-a0ff-5918a6618933 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:11:02.038395 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a7a1d-bed9-4704-a0ff-5918a6618933 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:11:02.044024 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a014eb5-15cd-4b6c-b6b9-6bc1f5fd3b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:11:02.045080 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a014eb5-15cd-4b6c-b6b9-6bc1f5fd3b99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:11:02.045455 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a014eb5-15cd-4b6c-b6b9-6bc1f5fd3b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:11:02.045807 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a014eb5-15cd-4b6c-b6b9-6bc1f5fd3b99 admin admin] PATH_INFO: `/v3/projects/04921bc6d96e4310b9774c0858355d30/users/8800016871b34731b7b6189ec16c1667/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:11:02.064753 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a014eb5-15cd-4b6c-b6b9-6bc1f5fd3b99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04921bc6d96e4310b9774c0858355d30, user_id=8800016871b34731b7b6189ec16c1667, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:11:02.068254 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a014eb5-15cd-4b6c-b6b9-6bc1f5fd3b99 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:11:02.086168 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1108/2223] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:11:02 2022] PUT /identity/v3/projects/04921bc6d96e4310b9774c0858355d30/users/8800016871b34731b7b6189ec16c1667/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:11:02.087667 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0fc7f-3535-445b-8444-d56386dff62c admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:11:02.100122 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0fc7f-3535-445b-8444-d56386dff62c admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:11:02.169698 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd160028-1669-4bc0-b858-b60c82be8ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:11:02.170750 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd160028-1669-4bc0-b858-b60c82be8ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:11:02.171100 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd160028-1669-4bc0-b858-b60c82be8ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:11:02.171377 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd160028-1669-4bc0-b858-b60c82be8ff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:11:02.172141 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd160028-1669-4bc0-b858-b60c82be8ff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:11:02.174214 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd160028-1669-4bc0-b858-b60c82be8ff0 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:11:02.188370 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1116/2224] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:11:02 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:11:02.193039 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a014eb5-15cd-4b6c-b6b9-6bc1f5fd3b99 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:11:02.208369 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a014eb5-15cd-4b6c-b6b9-6bc1f5fd3b99 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:11:02.209105 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50324751-91a9-419d-bced-d88b59f7dcf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:11:02.210316 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50324751-91a9-419d-bced-d88b59f7dcf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:11:02.210463 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50324751-91a9-419d-bced-d88b59f7dcf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:11:02.210731 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50324751-91a9-419d-bced-d88b59f7dcf9 admin admin] PATH_INFO: `/v3/projects/04921bc6d96e4310b9774c0858355d30/users/8800016871b34731b7b6189ec16c1667/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:11:02.212846 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50324751-91a9-419d-bced-d88b59f7dcf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04921bc6d96e4310b9774c0858355d30, user_id=8800016871b34731b7b6189ec16c1667, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:11:02.215672 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50324751-91a9-419d-bced-d88b59f7dcf9 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:11:02.226909 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1109/2225] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:11:02 2022] PUT /identity/v3/projects/04921bc6d96e4310b9774c0858355d30/users/8800016871b34731b7b6189ec16c1667/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:11:09.216019 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36916369-21bb-4b6d-af3b-49e3b2b2feb7 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:11:09.216019 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36916369-21bb-4b6d-af3b-49e3b2b2feb7 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:11:09.216019 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36916369-21bb-4b6d-af3b-49e3b2b2feb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:11:09.248228 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-36916369-21bb-4b6d-af3b-49e3b2b2feb7 None None] MFA Rules not processed for user `8800016871b34731b7b6189ec16c1667`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:11:09.249478 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-36916369-21bb-4b6d-af3b-49e3b2b2feb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:11:09.289273 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:11:09.323077 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1117/2226] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:11:09 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:11:09.337158 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50324751-91a9-419d-bced-d88b59f7dcf9 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:11:09.339875 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-50324751-91a9-419d-bced-d88b59f7dcf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:11:09.381298 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:11:09.439468 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50324751-91a9-419d-bced-d88b59f7dcf9 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:11:09.446370 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a812f1fb-c2ec-4126-a2d9-0e03e3670a59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef7edb5e9ce49e6b098f48bf060b228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:11:09.447038 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812f1fb-c2ec-4126-a2d9-0e03e3670a59 service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:11:09.447309 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812f1fb-c2ec-4126-a2d9-0e03e3670a59 service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:11:09.447582 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812f1fb-c2ec-4126-a2d9-0e03e3670a59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:11:09.511555 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a812f1fb-c2ec-4126-a2d9-0e03e3670a59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:11:09.513172 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a812f1fb-c2ec-4126-a2d9-0e03e3670a59 service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:11:09.522554 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1110/2227] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:11:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:11:13.203696 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fbcb0d-ba15-4305-a335-7b1f5bb691f4 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:11:13.204147 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fbcb0d-ba15-4305-a335-7b1f5bb691f4 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:11:13.204343 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fbcb0d-ba15-4305-a335-7b1f5bb691f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:11:13.223026 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-72fbcb0d-ba15-4305-a335-7b1f5bb691f4 None None] MFA Rules not processed for user `d52efc21c66d4300a8a979d92dbfeb47`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:11:13.224443 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-72fbcb0d-ba15-4305-a335-7b1f5bb691f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:11:13.281296 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1118/2228] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Jun 8 12:11:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:11:13.330373 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a812f1fb-c2ec-4126-a2d9-0e03e3670a59 service nova] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:11:13.333057 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a812f1fb-c2ec-4126-a2d9-0e03e3670a59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:11:13.404900 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a812f1fb-c2ec-4126-a2d9-0e03e3670a59 service nova] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:11:13.410575 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17da095-dc36-4d8b-bfd7-d366c79a2949 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753bde6a72d64045abd3ad44b9b0de04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:11:13.411240 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17da095-dc36-4d8b-bfd7-d366c79a2949 service swift] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:11:13.411528 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17da095-dc36-4d8b-bfd7-d366c79a2949 service swift] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:11:13.411909 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17da095-dc36-4d8b-bfd7-d366c79a2949 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:11:13.421989 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17da095-dc36-4d8b-bfd7-d366c79a2949 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:11:13.423605 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17da095-dc36-4d8b-bfd7-d366c79a2949 service swift] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:11:13.432356 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1111/2229] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Jun 8 12:11:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 12:11:23.274144 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=37 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:11:23.429067 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=82 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:11:27.880154 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2ba68-582a-4ccd-98b8-a8ca9b062167 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:11:27.880756 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2ba68-582a-4ccd-98b8-a8ca9b062167 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:11:27.881067 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2ba68-582a-4ccd-98b8-a8ca9b062167 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:11:27.883521 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1119/2230] 10.222.0.39 () {54 vars in 921 bytes} [Wed Jun 8 12:11:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:11:27.889645 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e29330-2bf1-4530-abc2-ad287f22fb05 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:11:27.890101 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e29330-2bf1-4530-abc2-ad287f22fb05 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:11:27.890399 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e29330-2bf1-4530-abc2-ad287f22fb05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:11:27.948402 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-17e29330-2bf1-4530-abc2-ad287f22fb05 None None] MFA Rules not processed for user `7ef7edb5e9ce49e6b098f48bf060b228`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:11:27.949684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-17e29330-2bf1-4530-abc2-ad287f22fb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:11:27.959935 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1112/2231] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Jun 8 12:11:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:11:27.971177 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a2ba68-582a-4ccd-98b8-a8ca9b062167 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:11:27.973025 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-32a2ba68-582a-4ccd-98b8-a8ca9b062167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:11:28.059483 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a2ba68-582a-4ccd-98b8-a8ca9b062167 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:11:28.063057 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3397ecc-71a5-412a-8799-efa88b5ac33d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2f8b5040a048c5bf4eef36f2ecd678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:11:28.063707 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3397ecc-71a5-412a-8799-efa88b5ac33d service glance] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:11:28.063990 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3397ecc-71a5-412a-8799-efa88b5ac33d service glance] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:11:28.064294 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3397ecc-71a5-412a-8799-efa88b5ac33d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:11:28.074694 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3397ecc-71a5-412a-8799-efa88b5ac33d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:11:28.076116 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3397ecc-71a5-412a-8799-efa88b5ac33d service glance] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:11:28.087388 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1120/2232] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:11:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:11:28.154484 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb2337-4bb3-46e0-a08e-7524de99bac5 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:11:28.154778 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb2337-4bb3-46e0-a08e-7524de99bac5 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:11:28.155059 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb2337-4bb3-46e0-a08e-7524de99bac5 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:11:28.156481 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1113/2233] 10.222.0.39 () {54 vars in 921 bytes} [Wed Jun 8 12:11:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:11:28.162009 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e0bcc-2791-41b6-9715-7b028c1d0002 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:11:28.162331 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e0bcc-2791-41b6-9715-7b028c1d0002 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:11:28.162608 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e0bcc-2791-41b6-9715-7b028c1d0002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:11:28.180923 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-823e0bcc-2791-41b6-9715-7b028c1d0002 None None] MFA Rules not processed for user `2fef074aa2ea4570928109f62ea1aa96`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:11:28.182076 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-823e0bcc-2791-41b6-9715-7b028c1d0002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:11:28.233425 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1121/2234] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Jun 8 12:11:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:11:28.245019 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb2337-4bb3-46e0-a08e-7524de99bac5 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:11:28.246683 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b7cb2337-4bb3-46e0-a08e-7524de99bac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:11:28.260600 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb2337-4bb3-46e0-a08e-7524de99bac5 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:11:28.264115 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d4100-f7fa-43e5-983c-68fc392f7baf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:11:28.264779 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d4100-f7fa-43e5-983c-68fc392f7baf service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:11:28.265064 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d4100-f7fa-43e5-983c-68fc392f7baf service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:11:28.265341 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d4100-f7fa-43e5-983c-68fc392f7baf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:11:28.272951 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d4100-f7fa-43e5-983c-68fc392f7baf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:11:28.274376 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d4100-f7fa-43e5-983c-68fc392f7baf service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:11:28.282025 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1114/2235] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:11:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:11:28.363335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0ed60-4f0a-432a-abf4-c588fa6191c6 None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:11:28.363629 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0ed60-4f0a-432a-abf4-c588fa6191c6 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:11:28.363917 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0ed60-4f0a-432a-abf4-c588fa6191c6 None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:11:28.365346 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1122/2236] 10.222.0.39 () {54 vars in 921 bytes} [Wed Jun 8 12:11:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:11:28.370612 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a4716-d219-4ed0-94e3-4250522aec4e None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:11:28.370906 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a4716-d219-4ed0-94e3-4250522aec4e None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:11:28.371186 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a4716-d219-4ed0-94e3-4250522aec4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:11:28.391098 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-c99a4716-d219-4ed0-94e3-4250522aec4e None None] MFA Rules not processed for user `7ef7edb5e9ce49e6b098f48bf060b228`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:11:28.392371 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-c99a4716-d219-4ed0-94e3-4250522aec4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:11:28.402069 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1115/2237] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Jun 8 12:11:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:11:28.412374 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c0ed60-4f0a-432a-abf4-c588fa6191c6 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:11:28.423404 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c0ed60-4f0a-432a-abf4-c588fa6191c6 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:11:28.427001 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36cc2cb-c5bc-45f0-863b-220c5bd6a0da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:11:28.427646 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36cc2cb-c5bc-45f0-863b-220c5bd6a0da service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:11:28.427930 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36cc2cb-c5bc-45f0-863b-220c5bd6a0da service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:11:28.428231 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36cc2cb-c5bc-45f0-863b-220c5bd6a0da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:11:28.439400 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36cc2cb-c5bc-45f0-863b-220c5bd6a0da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:11:28.441567 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36cc2cb-c5bc-45f0-863b-220c5bd6a0da service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:11:28.452208 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1123/2238] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:11:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:11:30.761360 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b666e93-a213-4c38-b593-6bccf251b49e None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:11:30.761812 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b666e93-a213-4c38-b593-6bccf251b49e None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:11:30.761906 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b666e93-a213-4c38-b593-6bccf251b49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:11:30.780013 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-6b666e93-a213-4c38-b593-6bccf251b49e None None] MFA Rules not processed for user `d52efc21c66d4300a8a979d92dbfeb47`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:11:30.781261 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-6b666e93-a213-4c38-b593-6bccf251b49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:11:30.790215 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1116/2239] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Jun 8 12:11:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:11:30.802665 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36cc2cb-c5bc-45f0-863b-220c5bd6a0da service neutron] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:11:30.814764 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36cc2cb-c5bc-45f0-863b-220c5bd6a0da service neutron] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:11:30.820612 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f4ae9-f3b1-4299-8e96-cf3d8e98c860 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753bde6a72d64045abd3ad44b9b0de04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:11:30.821440 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f4ae9-f3b1-4299-8e96-cf3d8e98c860 service swift] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:11:30.821727 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f4ae9-f3b1-4299-8e96-cf3d8e98c860 service swift] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:11:30.822010 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f4ae9-f3b1-4299-8e96-cf3d8e98c860 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:11:30.831338 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2f4ae9-f3b1-4299-8e96-cf3d8e98c860 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:11:30.833145 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2f4ae9-f3b1-4299-8e96-cf3d8e98c860 service swift] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:11:30.841307 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1124/2240] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Jun 8 12:11:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 12:11:34.334259 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab39237-e860-43cb-8eef-9121fa045db4 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:11:34.334799 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab39237-e860-43cb-8eef-9121fa045db4 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:11:34.334799 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab39237-e860-43cb-8eef-9121fa045db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:11:34.352927 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-3ab39237-e860-43cb-8eef-9121fa045db4 None None] MFA Rules not processed for user `5a2945ee4e3f4c6a91fef4978bcbfd88`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:11:34.354377 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-3ab39237-e860-43cb-8eef-9121fa045db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:11:34.362213 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1117/2241] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:11:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:11:36.255780 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f4ae9-f3b1-4299-8e96-cf3d8e98c860 service swift] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:11:36.265599 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f4ae9-f3b1-4299-8e96-cf3d8e98c860 service swift] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:11:36.269265 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46e3c7-5756-4e5e-abf7-8fb7cdc4b20c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:11:36.269914 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46e3c7-5756-4e5e-abf7-8fb7cdc4b20c service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:11:36.271591 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46e3c7-5756-4e5e-abf7-8fb7cdc4b20c service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:11:36.271904 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46e3c7-5756-4e5e-abf7-8fb7cdc4b20c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:11:36.273783 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-ce46e3c7-5756-4e5e-abf7-8fb7cdc4b20c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:11:36.287997 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce46e3c7-5756-4e5e-abf7-8fb7cdc4b20c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:11:36.289468 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce46e3c7-5756-4e5e-abf7-8fb7cdc4b20c service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:11:36.300280 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1125/2242] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:11:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 12:11:36.421759 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab39237-e860-43cb-8eef-9121fa045db4 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:11:36.431624 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab39237-e860-43cb-8eef-9121fa045db4 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:11:36.435197 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da11da3-f32a-4076-aea1-29335644c317 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:11:36.435846 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da11da3-f32a-4076-aea1-29335644c317 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:11:36.436152 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da11da3-f32a-4076-aea1-29335644c317 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:11:36.436462 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da11da3-f32a-4076-aea1-29335644c317 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:11:36.443003 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-1da11da3-f32a-4076-aea1-29335644c317 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:11:36.459921 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da11da3-f32a-4076-aea1-29335644c317 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:11:36.461971 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da11da3-f32a-4076-aea1-29335644c317 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:11:36.475134 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1118/2243] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:11:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:11:46.295504 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=76 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:11:46.469898 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=30 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:11:50.152140 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46e3c7-5756-4e5e-abf7-8fb7cdc4b20c service neutron] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:11:50.162991 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46e3c7-5756-4e5e-abf7-8fb7cdc4b20c service neutron] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:11:50.166582 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95122a8-064b-4fd9-bbfc-d18f17f48d89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:11:50.167223 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95122a8-064b-4fd9-bbfc-d18f17f48d89 service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:11:50.167503 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95122a8-064b-4fd9-bbfc-d18f17f48d89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:11:50.167774 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95122a8-064b-4fd9-bbfc-d18f17f48d89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:11:50.169556 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-e95122a8-064b-4fd9-bbfc-d18f17f48d89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:11:50.179156 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95122a8-064b-4fd9-bbfc-d18f17f48d89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:11:50.180607 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95122a8-064b-4fd9-bbfc-d18f17f48d89 service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:11:50.188315 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1126/2244] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:11:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:11:54.032665 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da11da3-f32a-4076-aea1-29335644c317 service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:11:54.034060 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-1da11da3-f32a-4076-aea1-29335644c317 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:11:54.091099 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da11da3-f32a-4076-aea1-29335644c317 service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:11:54.094817 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2b7c7-4bd8-4d51-8e4f-f27d7a36949e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:11:54.095479 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2b7c7-4bd8-4d51-8e4f-f27d7a36949e service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:11:54.095764 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2b7c7-4bd8-4d51-8e4f-f27d7a36949e service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:11:54.096078 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2b7c7-4bd8-4d51-8e4f-f27d7a36949e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:11:54.098453 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-bde2b7c7-4bd8-4d51-8e4f-f27d7a36949e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:11:54.167744 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde2b7c7-4bd8-4d51-8e4f-f27d7a36949e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:11:54.169324 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde2b7c7-4bd8-4d51-8e4f-f27d7a36949e service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:11:54.180922 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1119/2245] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:11:54 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:12:00.184890 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=6 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:12:01.523204 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb26db-9759-4032-a13d-06f7ea759aaf None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:12:01.523765 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb26db-9759-4032-a13d-06f7ea759aaf None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:12:01.523765 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb26db-9759-4032-a13d-06f7ea759aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:12:01.543701 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-53eb26db-9759-4032-a13d-06f7ea759aaf None None] MFA Rules not processed for user `d52efc21c66d4300a8a979d92dbfeb47`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:12:01.544939 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-53eb26db-9759-4032-a13d-06f7ea759aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:12:01.552615 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1127/2246] 10.222.0.39 () {58 vars in 967 bytes} [Wed Jun 8 12:12:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:12:01.564663 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2b7c7-4bd8-4d51-8e4f-f27d7a36949e service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:12:01.576750 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2b7c7-4bd8-4d51-8e4f-f27d7a36949e service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:12:01.584506 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81c0a4-febd-4620-9b88-33e40014d7a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753bde6a72d64045abd3ad44b9b0de04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:12:01.585088 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81c0a4-febd-4620-9b88-33e40014d7a9 service swift] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:12:01.585399 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81c0a4-febd-4620-9b88-33e40014d7a9 service swift] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:12:01.585707 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81c0a4-febd-4620-9b88-33e40014d7a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:12:01.594962 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd81c0a4-febd-4620-9b88-33e40014d7a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:12:01.596628 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd81c0a4-febd-4620-9b88-33e40014d7a9 service swift] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:12:01.605996 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1120/2247] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Jun 8 12:12:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 12:12:10.201130 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb26db-9759-4032-a13d-06f7ea759aaf None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:12:10.210450 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb26db-9759-4032-a13d-06f7ea759aaf None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:12:10.214135 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2352486-7a67-4e1f-9abf-bf791fcf7650 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:12:10.214783 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2352486-7a67-4e1f-9abf-bf791fcf7650 service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:12:10.215077 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2352486-7a67-4e1f-9abf-bf791fcf7650 service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:12:10.215356 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2352486-7a67-4e1f-9abf-bf791fcf7650 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:12:10.225031 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2352486-7a67-4e1f-9abf-bf791fcf7650 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:12:10.226467 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2352486-7a67-4e1f-9abf-bf791fcf7650 service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:12:10.236878 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1128/2248] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:12:10 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:12:11.602395 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=54 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:12:11.924690 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81c0a4-febd-4620-9b88-33e40014d7a9 service swift] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:12:11.937620 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81c0a4-febd-4620-9b88-33e40014d7a9 service swift] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:12:11.943334 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d9b11-7375-4ab8-9a70-f2d658a057b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef7edb5e9ce49e6b098f48bf060b228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:12:11.943975 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d9b11-7375-4ab8-9a70-f2d658a057b0 service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:12:11.944285 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d9b11-7375-4ab8-9a70-f2d658a057b0 service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:12:11.944561 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d9b11-7375-4ab8-9a70-f2d658a057b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:12:11.946310 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-031d9b11-7375-4ab8-9a70-f2d658a057b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:12:11.958670 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031d9b11-7375-4ab8-9a70-f2d658a057b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:12:11.960288 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031d9b11-7375-4ab8-9a70-f2d658a057b0 service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:12:11.971062 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1121/2249] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:12:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:12:20.232477 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=9 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:12:20.513876 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a349484-09ef-4eaa-b3ed-a0a6bb07f18c None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:12:20.514166 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a349484-09ef-4eaa-b3ed-a0a6bb07f18c None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:12:20.514444 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a349484-09ef-4eaa-b3ed-a0a6bb07f18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:12:20.531340 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-2a349484-09ef-4eaa-b3ed-a0a6bb07f18c None None] MFA Rules not processed for user `ac2ba7b98bfd40a49cf11263d9739e68`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:12:20.532558 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-2a349484-09ef-4eaa-b3ed-a0a6bb07f18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:12:20.540557 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1129/2250] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:12:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:12:21.966312 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=6 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:12:30.526305 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=3 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:12:40.630535 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d9b11-7375-4ab8-9a70-f2d658a057b0 service nova] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:12:40.632090 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-031d9b11-7375-4ab8-9a70-f2d658a057b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:12:40.646707 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d9b11-7375-4ab8-9a70-f2d658a057b0 service nova] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:12:40.652224 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001edb54-aa1c-42c8-8bc0-6986d38b6f51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef7edb5e9ce49e6b098f48bf060b228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:12:40.652864 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001edb54-aa1c-42c8-8bc0-6986d38b6f51 service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:12:40.653152 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001edb54-aa1c-42c8-8bc0-6986d38b6f51 service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:12:40.653431 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001edb54-aa1c-42c8-8bc0-6986d38b6f51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:12:40.655129 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-001edb54-aa1c-42c8-8bc0-6986d38b6f51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:12:40.718437 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001edb54-aa1c-42c8-8bc0-6986d38b6f51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:12:40.720234 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001edb54-aa1c-42c8-8bc0-6986d38b6f51 service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:12:40.729719 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1122/2251] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:12:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:12:50.725294 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=28 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:12:53.271139 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a349484-09ef-4eaa-b3ed-a0a6bb07f18c None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:12:53.283871 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a349484-09ef-4eaa-b3ed-a0a6bb07f18c None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:12:53.289232 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c756d9cf-32a6-4dbb-a5c3-715c6b2526f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef7edb5e9ce49e6b098f48bf060b228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:12:53.289899 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756d9cf-32a6-4dbb-a5c3-715c6b2526f2 service nova] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:12:53.290183 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756d9cf-32a6-4dbb-a5c3-715c6b2526f2 service nova] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:12:53.290461 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756d9cf-32a6-4dbb-a5c3-715c6b2526f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:12:53.292230 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-c756d9cf-32a6-4dbb-a5c3-715c6b2526f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:12:53.358232 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c756d9cf-32a6-4dbb-a5c3-715c6b2526f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:12:53.359833 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c756d9cf-32a6-4dbb-a5c3-715c6b2526f2 service nova] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:12:53.368758 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1130/2252] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:12:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 12:12:56.511038 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001edb54-aa1c-42c8-8bc0-6986d38b6f51 service nova] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:12:56.531404 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001edb54-aa1c-42c8-8bc0-6986d38b6f51 service nova] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:12:56.540072 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a708d60-506a-4195-b31e-988ba652ac41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef7edb5e9ce49e6b098f48bf060b228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:12:56.541102 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a708d60-506a-4195-b31e-988ba652ac41 service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:12:56.541620 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a708d60-506a-4195-b31e-988ba652ac41 service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:12:56.542053 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a708d60-506a-4195-b31e-988ba652ac41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:12:56.545250 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-6a708d60-506a-4195-b31e-988ba652ac41 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:12:56.570376 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a708d60-506a-4195-b31e-988ba652ac41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:12:56.572086 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a708d60-506a-4195-b31e-988ba652ac41 service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:12:56.592800 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1123/2253] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:12:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:13:03.365180 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=28 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:13:04.972423 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2cbc09-6259-40a6-8017-a86ea8a9d160 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:13:04.972998 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2cbc09-6259-40a6-8017-a86ea8a9d160 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:13:04.972998 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2cbc09-6259-40a6-8017-a86ea8a9d160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:13:04.991052 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-8d2cbc09-6259-40a6-8017-a86ea8a9d160 None None] MFA Rules not processed for user `38475bbe086b451fb78750ce6606dfa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:13:04.992300 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-8d2cbc09-6259-40a6-8017-a86ea8a9d160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:13:04.999159 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1131/2254] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:13:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:13:05.315518 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a708d60-506a-4195-b31e-988ba652ac41 service nova] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:13:05.325323 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a708d60-506a-4195-b31e-988ba652ac41 service nova] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:13:05.328914 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655428d-1f82-43f6-9dbc-6f5f0370a5a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:13:05.329549 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655428d-1f82-43f6-9dbc-6f5f0370a5a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:13:05.329835 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655428d-1f82-43f6-9dbc-6f5f0370a5a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:13:05.330113 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655428d-1f82-43f6-9dbc-6f5f0370a5a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:13:05.331879 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b655428d-1f82-43f6-9dbc-6f5f0370a5a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:13:05.342062 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b655428d-1f82-43f6-9dbc-6f5f0370a5a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:13:05.343505 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b655428d-1f82-43f6-9dbc-6f5f0370a5a5 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:13:05.351226 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1124/2255] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:13:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:13:05.661858 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2cbc09-6259-40a6-8017-a86ea8a9d160 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:13:05.663274 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-8d2cbc09-6259-40a6-8017-a86ea8a9d160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:13:05.735214 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2cbc09-6259-40a6-8017-a86ea8a9d160 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:13:05.740806 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4efac-b89f-47cc-ac1b-a9e319883fa6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9009560a846414b849d42efa8625ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:13:05.741464 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4efac-b89f-47cc-ac1b-a9e319883fa6 service placement] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:13:05.741748 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4efac-b89f-47cc-ac1b-a9e319883fa6 service placement] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:13:05.742024 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4efac-b89f-47cc-ac1b-a9e319883fa6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:13:05.743868 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-2fd4efac-b89f-47cc-ac1b-a9e319883fa6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:13:05.755104 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd4efac-b89f-47cc-ac1b-a9e319883fa6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:13:05.757318 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd4efac-b89f-47cc-ac1b-a9e319883fa6 service placement] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:13:05.766908 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1132/2256] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:13:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:13:15.347827 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=12 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:13:15.378990 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655428d-1f82-43f6-9dbc-6f5f0370a5a5 service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:13:15.393572 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655428d-1f82-43f6-9dbc-6f5f0370a5a5 service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:13:15.400316 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3cf562-6f1a-4b58-8733-0a511581736e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef7edb5e9ce49e6b098f48bf060b228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:13:15.400977 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3cf562-6f1a-4b58-8733-0a511581736e service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:13:15.401267 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3cf562-6f1a-4b58-8733-0a511581736e service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:13:15.401548 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3cf562-6f1a-4b58-8733-0a511581736e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:13:15.403394 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-bb3cf562-6f1a-4b58-8733-0a511581736e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:13:15.420012 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3cf562-6f1a-4b58-8733-0a511581736e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:13:15.421661 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3cf562-6f1a-4b58-8733-0a511581736e service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:13:15.432883 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1125/2257] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:13:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:13:15.762908 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=35 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:13:22.513326 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4efac-b89f-47cc-ac1b-a9e319883fa6 service placement] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:13:22.531540 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4efac-b89f-47cc-ac1b-a9e319883fa6 service placement] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:13:22.537359 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c652c0d-6caf-4f63-ae69-7e9e20791ae8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef7edb5e9ce49e6b098f48bf060b228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:13:22.538006 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c652c0d-6caf-4f63-ae69-7e9e20791ae8 service nova] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:13:22.538290 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c652c0d-6caf-4f63-ae69-7e9e20791ae8 service nova] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:13:22.538563 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c652c0d-6caf-4f63-ae69-7e9e20791ae8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:13:22.540414 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-5c652c0d-6caf-4f63-ae69-7e9e20791ae8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:13:22.604349 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c652c0d-6caf-4f63-ae69-7e9e20791ae8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:13:22.606115 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c652c0d-6caf-4f63-ae69-7e9e20791ae8 service nova] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:13:22.615365 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1133/2258] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:13:22 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:13:25.428368 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=6 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:13:29.650372 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81921a86-b144-4db1-8067-dd0a2c92966f None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:13:29.650967 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81921a86-b144-4db1-8067-dd0a2c92966f None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:13:29.650967 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81921a86-b144-4db1-8067-dd0a2c92966f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:13:29.668911 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-81921a86-b144-4db1-8067-dd0a2c92966f None None] MFA Rules not processed for user `8c9b1729824c4d2793b8af88a1184ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:13:29.670098 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-81921a86-b144-4db1-8067-dd0a2c92966f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:13:29.677316 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1126/2259] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:13:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:13:32.611418 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=28 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:13:39.663870 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:13:58.930520 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c652c0d-6caf-4f63-ae69-7e9e20791ae8 service nova] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:13:58.939595 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c652c0d-6caf-4f63-ae69-7e9e20791ae8 service nova] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:13:58.943162 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88394333-9532-4b87-8c7a-5b31efb464ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:13:58.943798 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88394333-9532-4b87-8c7a-5b31efb464ad service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:13:58.944081 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88394333-9532-4b87-8c7a-5b31efb464ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:13:58.945179 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88394333-9532-4b87-8c7a-5b31efb464ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:13:58.947069 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-88394333-9532-4b87-8c7a-5b31efb464ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:13:59.014884 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88394333-9532-4b87-8c7a-5b31efb464ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:13:59.016388 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88394333-9532-4b87-8c7a-5b31efb464ad service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:13:59.026682 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1134/2260] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:13:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:14:02.628535 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81921a86-b144-4db1-8067-dd0a2c92966f None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:02.630003 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-81921a86-b144-4db1-8067-dd0a2c92966f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:14:02.644794 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81921a86-b144-4db1-8067-dd0a2c92966f None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:02.649424 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085f395-dd7a-4035-927d-10468f643341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:02.650332 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085f395-dd7a-4035-927d-10468f643341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:02.650615 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085f395-dd7a-4035-927d-10468f643341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:02.650888 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085f395-dd7a-4035-927d-10468f643341 admin admin] PATH_INFO: `/v3/users/ac2ba7b98bfd40a49cf11263d9739e68` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:02.652074 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e085f395-dd7a-4035-927d-10468f643341 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac2ba7b98bfd40a49cf11263d9739e68)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:02.654020 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e085f395-dd7a-4035-927d-10468f643341 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:02.699699 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-e085f395-dd7a-4035-927d-10468f643341 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac2ba7b98bfd40a49cf11263d9739e68'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:02.700298 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-e085f395-dd7a-4035-927d-10468f643341 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac2ba7b98bfd40a49cf11263d9739e68'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:02.700904 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-e085f395-dd7a-4035-927d-10468f643341 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac2ba7b98bfd40a49cf11263d9739e68'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:02.707658 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-e085f395-dd7a-4035-927d-10468f643341 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac2ba7b98bfd40a49cf11263d9739e68'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:02.719369 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-e085f395-dd7a-4035-927d-10468f643341 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac2ba7b98bfd40a49cf11263d9739e68'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:02.736300 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1127/2261] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:14:02 2022] DELETE /identity/v3/users/ac2ba7b98bfd40a49cf11263d9739e68 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:14:02.913350 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88394333-9532-4b87-8c7a-5b31efb464ad service neutron] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:02.924195 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88394333-9532-4b87-8c7a-5b31efb464ad service neutron] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:02.981677 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a57b0-ecfa-42d0-a18e-781f9b7a863e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:02.982584 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a57b0-ecfa-42d0-a18e-781f9b7a863e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:02.982870 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a57b0-ecfa-42d0-a18e-781f9b7a863e admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:02.983146 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a57b0-ecfa-42d0-a18e-781f9b7a863e admin admin] PATH_INFO: `/v3/projects/ee3ef48b254d48d9a017d48f11541087` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:02.984359 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255a57b0-ecfa-42d0-a18e-781f9b7a863e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee3ef48b254d48d9a017d48f11541087)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:02.986258 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255a57b0-ecfa-42d0-a18e-781f9b7a863e admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:03.033731 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-255a57b0-ecfa-42d0-a18e-781f9b7a863e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee3ef48b254d48d9a017d48f11541087', 'request_id': 'req-255a57b0-ecfa-42d0-a18e-781f9b7a863e'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:03.042795 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-255a57b0-ecfa-42d0-a18e-781f9b7a863e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee3ef48b254d48d9a017d48f11541087', 'request_id': 'req-255a57b0-ecfa-42d0-a18e-781f9b7a863e'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:03.049325 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-255a57b0-ecfa-42d0-a18e-781f9b7a863e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee3ef48b254d48d9a017d48f11541087', 'request_id': 'req-255a57b0-ecfa-42d0-a18e-781f9b7a863e'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:03.060987 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-255a57b0-ecfa-42d0-a18e-781f9b7a863e admin admin] The token cache is being invalidate because project ee3ef48b254d48d9a017d48f11541087 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:14:03.061280 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-255a57b0-ecfa-42d0-a18e-781f9b7a863e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:03.061940 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-255a57b0-ecfa-42d0-a18e-781f9b7a863e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:03.063489 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1135/2262] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:14:02 2022] DELETE /identity/v3/projects/ee3ef48b254d48d9a017d48f11541087 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:14:03.068523 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0460ca-fc84-43a7-95dc-aae451aa0687 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:03.068958 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0460ca-fc84-43a7-95dc-aae451aa0687 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:03.069396 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0460ca-fc84-43a7-95dc-aae451aa0687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:03.088089 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-9b0460ca-fc84-43a7-95dc-aae451aa0687 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:14:03.089321 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-9b0460ca-fc84-43a7-95dc-aae451aa0687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:14:03.152525 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1128/2263] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:14:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:14:03.159951 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2641af-3a62-48f9-8048-4e7c95914a21 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:03.160277 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2641af-3a62-48f9-8048-4e7c95914a21 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:03.160644 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2641af-3a62-48f9-8048-4e7c95914a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:03.179859 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-bd2641af-3a62-48f9-8048-4e7c95914a21 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:14:03.181097 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-bd2641af-3a62-48f9-8048-4e7c95914a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:14:03.189048 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1136/2264] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:14:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:14:03.193127 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0460ca-fc84-43a7-95dc-aae451aa0687 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:03.202749 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0460ca-fc84-43a7-95dc-aae451aa0687 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:03.207309 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764697e6-f2d5-4c03-9d5c-0c1fb98f60ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:03.207957 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764697e6-f2d5-4c03-9d5c-0c1fb98f60ca admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:03.208276 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764697e6-f2d5-4c03-9d5c-0c1fb98f60ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:03.208556 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764697e6-f2d5-4c03-9d5c-0c1fb98f60ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:03.209311 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764697e6-f2d5-4c03-9d5c-0c1fb98f60ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:14:03.209618 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764697e6-f2d5-4c03-9d5c-0c1fb98f60ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:03.211719 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764697e6-f2d5-4c03-9d5c-0c1fb98f60ca admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:03.229648 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1129/2265] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:14:03.233751 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2641af-3a62-48f9-8048-4e7c95914a21 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:03.243036 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2641af-3a62-48f9-8048-4e7c95914a21 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:03.247670 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac5d4f0-a1c8-440b-9423-a7041746de38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:03.248378 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5d4f0-a1c8-440b-9423-a7041746de38 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:03.248662 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5d4f0-a1c8-440b-9423-a7041746de38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:03.248939 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5d4f0-a1c8-440b-9423-a7041746de38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:03.249630 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac5d4f0-a1c8-440b-9423-a7041746de38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:03.251543 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac5d4f0-a1c8-440b-9423-a7041746de38 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:03.265527 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:14:03.288467 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1137/2266] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:14:03 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:14:03.292469 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764697e6-f2d5-4c03-9d5c-0c1fb98f60ca admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:03.302290 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764697e6-f2d5-4c03-9d5c-0c1fb98f60ca admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:03.358017 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a1d85-4892-4101-ba01-23023dbd79b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:03.358669 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a1d85-4892-4101-ba01-23023dbd79b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:03.358955 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a1d85-4892-4101-ba01-23023dbd79b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:03.359232 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a1d85-4892-4101-ba01-23023dbd79b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:03.359927 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31a1d85-4892-4101-ba01-23023dbd79b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:03.361916 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31a1d85-4892-4101-ba01-23023dbd79b3 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:03.368888 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:14:03.383782 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1130/2267] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:14:03 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:14:03.387875 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac5d4f0-a1c8-440b-9423-a7041746de38 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:03.399229 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac5d4f0-a1c8-440b-9423-a7041746de38 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:03.403775 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398033c1-32b6-414f-ae30-8bd44d119551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:03.404459 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398033c1-32b6-414f-ae30-8bd44d119551 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:03.404745 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398033c1-32b6-414f-ae30-8bd44d119551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:03.405023 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398033c1-32b6-414f-ae30-8bd44d119551 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:03.405755 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398033c1-32b6-414f-ae30-8bd44d119551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:03.407359 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398033c1-32b6-414f-ae30-8bd44d119551 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:03.417167 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1138/2268] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:14:03.420967 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a1d85-4892-4101-ba01-23023dbd79b3 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:03.430901 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a1d85-4892-4101-ba01-23023dbd79b3 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:03.435468 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5365cef2-0114-4cee-8e93-b809a01e62ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:03.436121 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365cef2-0114-4cee-8e93-b809a01e62ef admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:03.436441 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365cef2-0114-4cee-8e93-b809a01e62ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:03.436729 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365cef2-0114-4cee-8e93-b809a01e62ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:03.437448 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5365cef2-0114-4cee-8e93-b809a01e62ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:03.439062 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5365cef2-0114-4cee-8e93-b809a01e62ef admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:03.449505 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1131/2269] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:14:03.454216 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398033c1-32b6-414f-ae30-8bd44d119551 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:03.465547 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398033c1-32b6-414f-ae30-8bd44d119551 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:03.470288 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b785b2-098f-4ad6-968b-7e3aaa0a9743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:03.471178 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b785b2-098f-4ad6-968b-7e3aaa0a9743 admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:03.471486 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b785b2-098f-4ad6-968b-7e3aaa0a9743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:03.471758 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b785b2-098f-4ad6-968b-7e3aaa0a9743 admin admin] PATH_INFO: `/v3/projects/f0ee6020e0484f6cbc09ac69850e82a1/users/40b1a11eeef14f8096f3aef0c48c4f84/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:03.487350 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b785b2-098f-4ad6-968b-7e3aaa0a9743 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0ee6020e0484f6cbc09ac69850e82a1, user_id=40b1a11eeef14f8096f3aef0c48c4f84, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:03.490056 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b785b2-098f-4ad6-968b-7e3aaa0a9743 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:03.503030 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1139/2270] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:14:03 2022] PUT /identity/v3/projects/f0ee6020e0484f6cbc09ac69850e82a1/users/40b1a11eeef14f8096f3aef0c48c4f84/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:14:03.514296 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8484b82-3e59-4def-9619-67935ebc139d None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:03.514591 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8484b82-3e59-4def-9619-67935ebc139d None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:03.514876 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8484b82-3e59-4def-9619-67935ebc139d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:03.541552 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-b8484b82-3e59-4def-9619-67935ebc139d None None] MFA Rules not processed for user `40b1a11eeef14f8096f3aef0c48c4f84`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:14:03.542790 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b8484b82-3e59-4def-9619-67935ebc139d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:14:03.608195 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1132/2271] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:14:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:14:03.612597 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b785b2-098f-4ad6-968b-7e3aaa0a9743 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:03.674760 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b785b2-098f-4ad6-968b-7e3aaa0a9743 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:03.679987 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3264477-584c-4173-8331-6cb31ba11bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:03.680676 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3264477-584c-4173-8331-6cb31ba11bc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:03.680967 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3264477-584c-4173-8331-6cb31ba11bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:03.681249 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3264477-584c-4173-8331-6cb31ba11bc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:03.681938 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3264477-584c-4173-8331-6cb31ba11bc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:03.683846 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3264477-584c-4173-8331-6cb31ba11bc3 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:03.709027 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1140/2272] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:14:03 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:14:03.713104 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8484b82-3e59-4def-9619-67935ebc139d None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:03.724105 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8484b82-3e59-4def-9619-67935ebc139d None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:03.794788 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93630379-fd9e-4619-b82e-f0af9a3035c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:03.795395 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93630379-fd9e-4619-b82e-f0af9a3035c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:03.795684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93630379-fd9e-4619-b82e-f0af9a3035c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:03.795965 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93630379-fd9e-4619-b82e-f0af9a3035c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:03.796687 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93630379-fd9e-4619-b82e-f0af9a3035c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:03.798843 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93630379-fd9e-4619-b82e-f0af9a3035c2 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:03.822933 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1133/2273] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:14:03 2022] POST /identity/v3/users => generated 294 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:14:03.826066 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3264477-584c-4173-8331-6cb31ba11bc3 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:03.836154 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3264477-584c-4173-8331-6cb31ba11bc3 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:03.840851 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d2ec75-e3d7-43d3-8ae3-24473fac7997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:03.841551 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2ec75-e3d7-43d3-8ae3-24473fac7997 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:03.841868 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2ec75-e3d7-43d3-8ae3-24473fac7997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:03.842150 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2ec75-e3d7-43d3-8ae3-24473fac7997 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:03.842879 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d2ec75-e3d7-43d3-8ae3-24473fac7997 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:03.844602 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d2ec75-e3d7-43d3-8ae3-24473fac7997 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:03.855285 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1141/2274] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:14:03.859532 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93630379-fd9e-4619-b82e-f0af9a3035c2 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:03.870247 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93630379-fd9e-4619-b82e-f0af9a3035c2 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:03.874766 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd87bc-6013-4d6f-b00c-365291f8895b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:03.875628 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd87bc-6013-4d6f-b00c-365291f8895b admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:03.875926 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd87bc-6013-4d6f-b00c-365291f8895b admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:03.876298 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd87bc-6013-4d6f-b00c-365291f8895b admin admin] PATH_INFO: `/v3/projects/193688faea274772baefa69e9bb2384a/users/a9059ed5348c460fab0d368e1793926b/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:03.892290 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd87bc-6013-4d6f-b00c-365291f8895b admin admin] RBAC: Authorizing `identity:create_grant(project_id=193688faea274772baefa69e9bb2384a, user_id=a9059ed5348c460fab0d368e1793926b, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:03.894914 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd87bc-6013-4d6f-b00c-365291f8895b admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:03.907702 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1134/2275] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:14:03 2022] PUT /identity/v3/projects/193688faea274772baefa69e9bb2384a/users/a9059ed5348c460fab0d368e1793926b/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:14:03.911738 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d2ec75-e3d7-43d3-8ae3-24473fac7997 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:03.921576 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d2ec75-e3d7-43d3-8ae3-24473fac7997 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:03.977074 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ebac03-9673-44fa-be1c-8428fb5c23d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:03.977743 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ebac03-9673-44fa-be1c-8428fb5c23d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:03.978029 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ebac03-9673-44fa-be1c-8428fb5c23d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:03.978305 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ebac03-9673-44fa-be1c-8428fb5c23d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:03.979056 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ebac03-9673-44fa-be1c-8428fb5c23d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:03.980689 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ebac03-9673-44fa-be1c-8428fb5c23d5 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:03.990329 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1142/2276] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:14:03.995019 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd87bc-6013-4d6f-b00c-365291f8895b admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:04.005293 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd87bc-6013-4d6f-b00c-365291f8895b admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:04.010508 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6365cb9f-ebee-446b-b338-470f26175cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:04.011378 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365cb9f-ebee-446b-b338-470f26175cf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:04.011663 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365cb9f-ebee-446b-b338-470f26175cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:04.011941 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365cb9f-ebee-446b-b338-470f26175cf1 admin admin] PATH_INFO: `/v3/projects/193688faea274772baefa69e9bb2384a/users/a9059ed5348c460fab0d368e1793926b/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:04.013922 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6365cb9f-ebee-446b-b338-470f26175cf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=193688faea274772baefa69e9bb2384a, user_id=a9059ed5348c460fab0d368e1793926b, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:04.016596 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6365cb9f-ebee-446b-b338-470f26175cf1 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:04.026854 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1135/2277] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:14:03 2022] PUT /identity/v3/projects/193688faea274772baefa69e9bb2384a/users/a9059ed5348c460fab0d368e1793926b/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:14:04.036720 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07402a16-d06a-48d0-a97b-24d08e04a567 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:04.037013 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07402a16-d06a-48d0-a97b-24d08e04a567 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:04.037294 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07402a16-d06a-48d0-a97b-24d08e04a567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:04.064052 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-07402a16-d06a-48d0-a97b-24d08e04a567 None None] MFA Rules not processed for user `a9059ed5348c460fab0d368e1793926b`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:14:04.065231 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-07402a16-d06a-48d0-a97b-24d08e04a567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:14:04.074302 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:14:04.135139 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1143/2278] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:14:04 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:14:04.145901 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6365cb9f-ebee-446b-b338-470f26175cf1 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:04.148640 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-6365cb9f-ebee-446b-b338-470f26175cf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:14:04.171386 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:14:04.206829 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6365cb9f-ebee-446b-b338-470f26175cf1 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:04.211123 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb2ae6-d450-4cc5-b8a3-068bf6ac4bb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:04.211945 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb2ae6-d450-4cc5-b8a3-068bf6ac4bb5 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:04.212261 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb2ae6-d450-4cc5-b8a3-068bf6ac4bb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:04.212535 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb2ae6-d450-4cc5-b8a3-068bf6ac4bb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:04.270660 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bb2ae6-d450-4cc5-b8a3-068bf6ac4bb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:04.272110 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bb2ae6-d450-4cc5-b8a3-068bf6ac4bb5 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:04.281822 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1136/2279] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:14:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:14:10.922015 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07402a16-d06a-48d0-a97b-24d08e04a567 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:10.931586 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07402a16-d06a-48d0-a97b-24d08e04a567 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:10.935145 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a53f27-e796-4366-b1c5-24f733582d24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:10.935783 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a53f27-e796-4366-b1c5-24f733582d24 service cinder] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:10.936068 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a53f27-e796-4366-b1c5-24f733582d24 service cinder] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:10.936371 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a53f27-e796-4366-b1c5-24f733582d24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:10.945902 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a53f27-e796-4366-b1c5-24f733582d24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:10.947335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a53f27-e796-4366-b1c5-24f733582d24 service cinder] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:10.956678 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1144/2280] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:14:10 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:14:14.277614 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=39 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:14:20.952514 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=30 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:14:32.315667 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23137e62-51ea-4fa6-a17e-4a7e21aac9ea None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:32.316202 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23137e62-51ea-4fa6-a17e-4a7e21aac9ea None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:32.316302 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23137e62-51ea-4fa6-a17e-4a7e21aac9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:32.336604 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-23137e62-51ea-4fa6-a17e-4a7e21aac9ea None None] MFA Rules not processed for user `f3d3e9767e814d0d995be5c660c36fc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:14:32.337811 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-23137e62-51ea-4fa6-a17e-4a7e21aac9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:14:32.405294 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1137/2281] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:14:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:14:32.745130 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a53f27-e796-4366-b1c5-24f733582d24 service cinder] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:32.746667 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-46a53f27-e796-4366-b1c5-24f733582d24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:14:32.804806 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a53f27-e796-4366-b1c5-24f733582d24 service cinder] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:32.808430 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ba406-a631-4225-ab29-8554df6366a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:32.809082 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ba406-a631-4225-ab29-8554df6366a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:32.809365 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ba406-a631-4225-ab29-8554df6366a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:32.809639 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ba406-a631-4225-ab29-8554df6366a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:32.811448 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-600ba406-a631-4225-ab29-8554df6366a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:14:32.822087 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600ba406-a631-4225-ab29-8554df6366a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:32.823543 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600ba406-a631-4225-ab29-8554df6366a2 service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:32.831855 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1145/2282] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:14:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:14:41.380039 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23137e62-51ea-4fa6-a17e-4a7e21aac9ea None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:41.457212 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23137e62-51ea-4fa6-a17e-4a7e21aac9ea None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:41.462161 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22fefd-8bb5-4307-8966-476470858693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:41.463075 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22fefd-8bb5-4307-8966-476470858693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:41.463362 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22fefd-8bb5-4307-8966-476470858693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:41.463637 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22fefd-8bb5-4307-8966-476470858693 admin admin] PATH_INFO: `/v3/users/40b1a11eeef14f8096f3aef0c48c4f84` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:41.464872 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e22fefd-8bb5-4307-8966-476470858693 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40b1a11eeef14f8096f3aef0c48c4f84)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:41.466813 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e22fefd-8bb5-4307-8966-476470858693 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:41.514986 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3e22fefd-8bb5-4307-8966-476470858693 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40b1a11eeef14f8096f3aef0c48c4f84'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:41.515709 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3e22fefd-8bb5-4307-8966-476470858693 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40b1a11eeef14f8096f3aef0c48c4f84'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:41.516379 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3e22fefd-8bb5-4307-8966-476470858693 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40b1a11eeef14f8096f3aef0c48c4f84'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:41.524487 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3e22fefd-8bb5-4307-8966-476470858693 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40b1a11eeef14f8096f3aef0c48c4f84'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:41.536671 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3e22fefd-8bb5-4307-8966-476470858693 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40b1a11eeef14f8096f3aef0c48c4f84'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:41.550040 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1138/2283] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:14:41 2022] DELETE /identity/v3/users/40b1a11eeef14f8096f3aef0c48c4f84 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:14:41.556013 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447b660-b934-41eb-9673-31bb5945aca6 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:41.556550 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447b660-b934-41eb-9673-31bb5945aca6 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:41.556668 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447b660-b934-41eb-9673-31bb5945aca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:41.575068 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-7447b660-b934-41eb-9673-31bb5945aca6 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:14:41.576371 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-7447b660-b934-41eb-9673-31bb5945aca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:14:41.649169 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1146/2284] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:14:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:14:41.658829 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22fefd-8bb5-4307-8966-476470858693 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:41.660253 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-3e22fefd-8bb5-4307-8966-476470858693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:14:41.689043 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:14:41.722940 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22fefd-8bb5-4307-8966-476470858693 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:41.727630 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2906de7-d7d1-4723-9e40-58870c19986d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:41.728310 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2906de7-d7d1-4723-9e40-58870c19986d service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:41.728597 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2906de7-d7d1-4723-9e40-58870c19986d service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:41.728877 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2906de7-d7d1-4723-9e40-58870c19986d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:41.738074 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2906de7-d7d1-4723-9e40-58870c19986d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:41.740097 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2906de7-d7d1-4723-9e40-58870c19986d service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:41.749782 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1139/2285] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:14:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:14:42.042115 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7447b660-b934-41eb-9673-31bb5945aca6 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:42.043925 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-7447b660-b934-41eb-9673-31bb5945aca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:14:42.060888 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7447b660-b934-41eb-9673-31bb5945aca6 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:42.066463 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb97467-7b3a-48e5-a841-60bd66fdfdac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:42.067960 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb97467-7b3a-48e5-a841-60bd66fdfdac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:42.069232 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb97467-7b3a-48e5-a841-60bd66fdfdac admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:42.069521 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb97467-7b3a-48e5-a841-60bd66fdfdac admin admin] PATH_INFO: `/v3/projects/f0ee6020e0484f6cbc09ac69850e82a1` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:42.070735 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb97467-7b3a-48e5-a841-60bd66fdfdac admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0ee6020e0484f6cbc09ac69850e82a1)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:42.072673 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb97467-7b3a-48e5-a841-60bd66fdfdac admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:42.132287 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-1fb97467-7b3a-48e5-a841-60bd66fdfdac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0ee6020e0484f6cbc09ac69850e82a1', 'request_id': 'req-1fb97467-7b3a-48e5-a841-60bd66fdfdac'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:42.142342 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-1fb97467-7b3a-48e5-a841-60bd66fdfdac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0ee6020e0484f6cbc09ac69850e82a1', 'request_id': 'req-1fb97467-7b3a-48e5-a841-60bd66fdfdac'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:42.150674 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-1fb97467-7b3a-48e5-a841-60bd66fdfdac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0ee6020e0484f6cbc09ac69850e82a1', 'request_id': 'req-1fb97467-7b3a-48e5-a841-60bd66fdfdac'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:42.163875 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-1fb97467-7b3a-48e5-a841-60bd66fdfdac admin admin] The token cache is being invalidate because project f0ee6020e0484f6cbc09ac69850e82a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:14:42.164127 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-1fb97467-7b3a-48e5-a841-60bd66fdfdac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:42.164809 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-1fb97467-7b3a-48e5-a841-60bd66fdfdac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:42.166365 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1147/2286] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:14:42 2022] DELETE /identity/v3/projects/f0ee6020e0484f6cbc09ac69850e82a1 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:14:42.171120 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2906de7-d7d1-4723-9e40-58870c19986d service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:42.182322 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2906de7-d7d1-4723-9e40-58870c19986d service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:42.253670 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3209ea4f-42d4-4b43-8715-f34d543b7e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:42.255415 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209ea4f-42d4-4b43-8715-f34d543b7e40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:42.255981 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209ea4f-42d4-4b43-8715-f34d543b7e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:42.256443 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209ea4f-42d4-4b43-8715-f34d543b7e40 admin admin] PATH_INFO: `/v3/users/a9059ed5348c460fab0d368e1793926b` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:42.258116 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3209ea4f-42d4-4b43-8715-f34d543b7e40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9059ed5348c460fab0d368e1793926b)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:42.260303 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3209ea4f-42d4-4b43-8715-f34d543b7e40 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:42.331822 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3209ea4f-42d4-4b43-8715-f34d543b7e40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9059ed5348c460fab0d368e1793926b'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:42.332888 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3209ea4f-42d4-4b43-8715-f34d543b7e40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9059ed5348c460fab0d368e1793926b'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:42.334593 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3209ea4f-42d4-4b43-8715-f34d543b7e40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9059ed5348c460fab0d368e1793926b'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:42.342981 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3209ea4f-42d4-4b43-8715-f34d543b7e40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9059ed5348c460fab0d368e1793926b'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:42.359214 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3209ea4f-42d4-4b43-8715-f34d543b7e40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9059ed5348c460fab0d368e1793926b'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:42.381616 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1140/2287] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:14:42 2022] DELETE /identity/v3/users/a9059ed5348c460fab0d368e1793926b => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:14:42.835883 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb97467-7b3a-48e5-a841-60bd66fdfdac admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:42.839431 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-1fb97467-7b3a-48e5-a841-60bd66fdfdac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:14:42.871213 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb97467-7b3a-48e5-a841-60bd66fdfdac admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:42.913709 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:14:42.955431 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d6abc-a5e6-41a7-920b-1d909dbaccaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:42.956334 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d6abc-a5e6-41a7-920b-1d909dbaccaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:42.956617 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d6abc-a5e6-41a7-920b-1d909dbaccaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:42.956887 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d6abc-a5e6-41a7-920b-1d909dbaccaf admin admin] PATH_INFO: `/v3/projects/193688faea274772baefa69e9bb2384a` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:42.958788 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41d6abc-a5e6-41a7-920b-1d909dbaccaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=193688faea274772baefa69e9bb2384a)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:42.960740 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41d6abc-a5e6-41a7-920b-1d909dbaccaf admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:43.042070 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-f41d6abc-a5e6-41a7-920b-1d909dbaccaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '193688faea274772baefa69e9bb2384a', 'request_id': 'req-f41d6abc-a5e6-41a7-920b-1d909dbaccaf'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:43.053017 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-f41d6abc-a5e6-41a7-920b-1d909dbaccaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '193688faea274772baefa69e9bb2384a', 'request_id': 'req-f41d6abc-a5e6-41a7-920b-1d909dbaccaf'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:43.064681 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-f41d6abc-a5e6-41a7-920b-1d909dbaccaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '193688faea274772baefa69e9bb2384a', 'request_id': 'req-f41d6abc-a5e6-41a7-920b-1d909dbaccaf'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:43.082837 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-f41d6abc-a5e6-41a7-920b-1d909dbaccaf admin admin] The token cache is being invalidate because project 193688faea274772baefa69e9bb2384a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:14:43.083939 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-f41d6abc-a5e6-41a7-920b-1d909dbaccaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:43.084661 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-f41d6abc-a5e6-41a7-920b-1d909dbaccaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:43.086328 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1148/2288] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:14:42 2022] DELETE /identity/v3/projects/193688faea274772baefa69e9bb2384a => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:14:43.094626 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6a7bf-9b79-4676-bd52-03064c27a12f None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:43.095094 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6a7bf-9b79-4676-bd52-03064c27a12f None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:43.095478 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6a7bf-9b79-4676-bd52-03064c27a12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:43.117228 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-0da6a7bf-9b79-4676-bd52-03064c27a12f None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:14:43.118831 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-0da6a7bf-9b79-4676-bd52-03064c27a12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:14:43.190687 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:14:43.222575 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1141/2289] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:14:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:14:43.231044 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bfd8fe-5a52-45bc-b2ec-d25b86fdd909 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:43.231440 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bfd8fe-5a52-45bc-b2ec-d25b86fdd909 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:43.231831 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bfd8fe-5a52-45bc-b2ec-d25b86fdd909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:43.252376 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-e1bfd8fe-5a52-45bc-b2ec-d25b86fdd909 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:14:43.253691 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-e1bfd8fe-5a52-45bc-b2ec-d25b86fdd909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:14:43.262677 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1149/2290] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:14:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:14:43.266873 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6a7bf-9b79-4676-bd52-03064c27a12f None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:43.277845 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6a7bf-9b79-4676-bd52-03064c27a12f None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:43.282753 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a350b-a423-4d6e-b88f-f287b52c6e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:43.283453 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a350b-a423-4d6e-b88f-f287b52c6e6b admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:43.283741 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a350b-a423-4d6e-b88f-f287b52c6e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:43.284059 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a350b-a423-4d6e-b88f-f287b52c6e6b admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:43.284861 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a350b-a423-4d6e-b88f-f287b52c6e6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:14:43.285199 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a350b-a423-4d6e-b88f-f287b52c6e6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:43.286955 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a350b-a423-4d6e-b88f-f287b52c6e6b admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:43.304513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1142/2291] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:14:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:14:43.305744 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bfd8fe-5a52-45bc-b2ec-d25b86fdd909 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:43.315268 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bfd8fe-5a52-45bc-b2ec-d25b86fdd909 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:43.320771 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f18e3d-4e0d-4fb0-a5bf-12889e07be62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:43.321444 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f18e3d-4e0d-4fb0-a5bf-12889e07be62 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:43.321738 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f18e3d-4e0d-4fb0-a5bf-12889e07be62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:43.322021 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f18e3d-4e0d-4fb0-a5bf-12889e07be62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:43.322730 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f18e3d-4e0d-4fb0-a5bf-12889e07be62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:43.324964 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f18e3d-4e0d-4fb0-a5bf-12889e07be62 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:43.357486 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1150/2292] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:14:43 2022] POST /identity/v3/projects => generated 393 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:14:43.358809 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a350b-a423-4d6e-b88f-f287b52c6e6b admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:43.369953 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a350b-a423-4d6e-b88f-f287b52c6e6b admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:43.426482 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0a859-a9d2-4354-8a46-91665cbfbe2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:43.427806 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0a859-a9d2-4354-8a46-91665cbfbe2a admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:43.428083 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0a859-a9d2-4354-8a46-91665cbfbe2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:43.428379 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0a859-a9d2-4354-8a46-91665cbfbe2a admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:43.429064 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b0a859-a9d2-4354-8a46-91665cbfbe2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:43.430997 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b0a859-a9d2-4354-8a46-91665cbfbe2a admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:43.450614 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1143/2293] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:14:43 2022] POST /identity/v3/users => generated 297 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:14:43.454774 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f18e3d-4e0d-4fb0-a5bf-12889e07be62 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:43.468279 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f18e3d-4e0d-4fb0-a5bf-12889e07be62 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:43.472939 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2047b48-5139-42cf-b22b-aa33ae5fe491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:43.473705 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2047b48-5139-42cf-b22b-aa33ae5fe491 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:43.473990 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2047b48-5139-42cf-b22b-aa33ae5fe491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:43.474261 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2047b48-5139-42cf-b22b-aa33ae5fe491 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:43.474973 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2047b48-5139-42cf-b22b-aa33ae5fe491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:43.477141 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2047b48-5139-42cf-b22b-aa33ae5fe491 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:43.488035 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1151/2294] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:14:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:14:43.493625 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0a859-a9d2-4354-8a46-91665cbfbe2a admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:43.508361 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0a859-a9d2-4354-8a46-91665cbfbe2a admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:43.516460 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c94e14-62d3-46c8-b043-d5d19490a0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:43.517295 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c94e14-62d3-46c8-b043-d5d19490a0b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:43.517705 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c94e14-62d3-46c8-b043-d5d19490a0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:43.518090 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c94e14-62d3-46c8-b043-d5d19490a0b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:43.519098 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c94e14-62d3-46c8-b043-d5d19490a0b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:43.522513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c94e14-62d3-46c8-b043-d5d19490a0b1 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:43.534739 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1144/2295] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:14:43 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:14:43.541362 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2047b48-5139-42cf-b22b-aa33ae5fe491 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:43.555612 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2047b48-5139-42cf-b22b-aa33ae5fe491 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:43.561648 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c77c4-a889-4fcf-9139-445a624f86d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:43.562863 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c77c4-a889-4fcf-9139-445a624f86d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:43.563293 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c77c4-a889-4fcf-9139-445a624f86d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:43.563718 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c77c4-a889-4fcf-9139-445a624f86d6 admin admin] PATH_INFO: `/v3/projects/53c6f3efb5f54a2689a2566a859df9e4/users/7e5d546a221f4378b42bf7cd5fe60b65/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:43.585594 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c77c4-a889-4fcf-9139-445a624f86d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53c6f3efb5f54a2689a2566a859df9e4, user_id=7e5d546a221f4378b42bf7cd5fe60b65, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:43.588816 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c77c4-a889-4fcf-9139-445a624f86d6 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:43.619356 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1152/2296] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:14:43 2022] PUT /identity/v3/projects/53c6f3efb5f54a2689a2566a859df9e4/users/7e5d546a221f4378b42bf7cd5fe60b65/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:14:43.633494 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a3dfc-db38-4daa-8752-a4864a3d7c89 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:43.634080 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a3dfc-db38-4daa-8752-a4864a3d7c89 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:43.634625 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a3dfc-db38-4daa-8752-a4864a3d7c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:43.674896 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-4e4a3dfc-db38-4daa-8752-a4864a3d7c89 None None] MFA Rules not processed for user `7e5d546a221f4378b42bf7cd5fe60b65`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:14:43.676145 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-4e4a3dfc-db38-4daa-8752-a4864a3d7c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:14:43.763301 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1145/2297] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:14:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:14:43.768533 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c77c4-a889-4fcf-9139-445a624f86d6 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:43.833285 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:14:43.846745 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c77c4-a889-4fcf-9139-445a624f86d6 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:43.853748 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec25b927-12b8-4e1b-a06d-a4c68f9cfd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:43.854425 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec25b927-12b8-4e1b-a06d-a4c68f9cfd2c admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:43.854708 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec25b927-12b8-4e1b-a06d-a4c68f9cfd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:43.854987 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec25b927-12b8-4e1b-a06d-a4c68f9cfd2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:43.855685 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec25b927-12b8-4e1b-a06d-a4c68f9cfd2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:43.857626 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec25b927-12b8-4e1b-a06d-a4c68f9cfd2c admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:43.887265 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1153/2298] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:14:43 2022] POST /identity/v3/projects => generated 391 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:14:43.892360 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a3dfc-db38-4daa-8752-a4864a3d7c89 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:43.906440 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a3dfc-db38-4daa-8752-a4864a3d7c89 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:43.957190 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:14:43.977402 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7892b7-6bcf-4361-a7ce-1e22683273ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:43.978091 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7892b7-6bcf-4361-a7ce-1e22683273ba admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:43.978378 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7892b7-6bcf-4361-a7ce-1e22683273ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:43.978659 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7892b7-6bcf-4361-a7ce-1e22683273ba admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:43.979361 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7892b7-6bcf-4361-a7ce-1e22683273ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:43.981391 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7892b7-6bcf-4361-a7ce-1e22683273ba admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:44.004089 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1146/2299] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:14:43 2022] POST /identity/v3/users => generated 302 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:14:44.008724 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec25b927-12b8-4e1b-a06d-a4c68f9cfd2c admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:44.020184 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec25b927-12b8-4e1b-a06d-a4c68f9cfd2c admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:44.025378 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5563027-0269-4ea5-b2b7-47f8763f5062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:44.026088 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5563027-0269-4ea5-b2b7-47f8763f5062 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:44.026378 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5563027-0269-4ea5-b2b7-47f8763f5062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:44.026660 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5563027-0269-4ea5-b2b7-47f8763f5062 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:44.027407 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5563027-0269-4ea5-b2b7-47f8763f5062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:44.029089 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5563027-0269-4ea5-b2b7-47f8763f5062 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:44.041764 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1154/2300] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:14:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:14:44.046104 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7892b7-6bcf-4361-a7ce-1e22683273ba admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:44.058218 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7892b7-6bcf-4361-a7ce-1e22683273ba admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:44.063469 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0b19f-77ef-4709-bfe6-a675d86219d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:44.065144 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0b19f-77ef-4709-bfe6-a675d86219d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:44.065602 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0b19f-77ef-4709-bfe6-a675d86219d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:44.066091 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0b19f-77ef-4709-bfe6-a675d86219d3 admin admin] PATH_INFO: `/v3/projects/143e7fdb7a544d7689afd6d00b0288cf/users/39081ba4371c43bc9985eb48b748c0e8/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:44.083760 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd0b19f-77ef-4709-bfe6-a675d86219d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=143e7fdb7a544d7689afd6d00b0288cf, user_id=39081ba4371c43bc9985eb48b748c0e8, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:44.086458 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd0b19f-77ef-4709-bfe6-a675d86219d3 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:44.101430 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1147/2301] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:14:44 2022] PUT /identity/v3/projects/143e7fdb7a544d7689afd6d00b0288cf/users/39081ba4371c43bc9985eb48b748c0e8/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:14:44.105491 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5563027-0269-4ea5-b2b7-47f8763f5062 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:44.116518 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5563027-0269-4ea5-b2b7-47f8763f5062 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:44.181872 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0c480-448b-4209-90e1-e0f0b03e126e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:44.182324 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0c480-448b-4209-90e1-e0f0b03e126e admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:44.182547 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0c480-448b-4209-90e1-e0f0b03e126e admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:44.182813 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0c480-448b-4209-90e1-e0f0b03e126e admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:44.183553 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d0c480-448b-4209-90e1-e0f0b03e126e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:44.185303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d0c480-448b-4209-90e1-e0f0b03e126e admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:44.196473 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1155/2302] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:14:44 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:14:44.200767 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0b19f-77ef-4709-bfe6-a675d86219d3 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:44.215446 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0b19f-77ef-4709-bfe6-a675d86219d3 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:44.220312 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049234c-2b32-4d64-88d4-cc6dbe630dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:44.221233 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049234c-2b32-4d64-88d4-cc6dbe630dc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:44.221677 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049234c-2b32-4d64-88d4-cc6dbe630dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:44.221950 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049234c-2b32-4d64-88d4-cc6dbe630dc3 admin admin] PATH_INFO: `/v3/projects/143e7fdb7a544d7689afd6d00b0288cf/users/39081ba4371c43bc9985eb48b748c0e8/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:44.224095 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a049234c-2b32-4d64-88d4-cc6dbe630dc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=143e7fdb7a544d7689afd6d00b0288cf, user_id=39081ba4371c43bc9985eb48b748c0e8, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:44.227095 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a049234c-2b32-4d64-88d4-cc6dbe630dc3 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:44.240610 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1148/2303] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:14:44 2022] PUT /identity/v3/projects/143e7fdb7a544d7689afd6d00b0288cf/users/39081ba4371c43bc9985eb48b748c0e8/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:14:44.266030 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a956115-7a13-4c60-8dae-6598c2bb0b6d None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:44.266500 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a956115-7a13-4c60-8dae-6598c2bb0b6d None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:44.266981 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a956115-7a13-4c60-8dae-6598c2bb0b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:44.300503 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-6a956115-7a13-4c60-8dae-6598c2bb0b6d None None] MFA Rules not processed for user `39081ba4371c43bc9985eb48b748c0e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:14:44.302260 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-6a956115-7a13-4c60-8dae-6598c2bb0b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:14:44.387916 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1156/2304] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:14:44 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:14:44.400522 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049234c-2b32-4d64-88d4-cc6dbe630dc3 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:44.402575 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a049234c-2b32-4d64-88d4-cc6dbe630dc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:14:44.481229 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049234c-2b32-4d64-88d4-cc6dbe630dc3 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:44.485852 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b7ebf-26ae-47b2-859d-bce5c2dc9341 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:44.487014 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b7ebf-26ae-47b2-859d-bce5c2dc9341 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:44.487530 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b7ebf-26ae-47b2-859d-bce5c2dc9341 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:44.488036 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b7ebf-26ae-47b2-859d-bce5c2dc9341 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:44.501540 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b7ebf-26ae-47b2-859d-bce5c2dc9341 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:44.503321 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b7ebf-26ae-47b2-859d-bce5c2dc9341 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:44.515445 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1149/2305] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:14:44 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:14:44.577137 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a956115-7a13-4c60-8dae-6598c2bb0b6d None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:44.579835 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-6a956115-7a13-4c60-8dae-6598c2bb0b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:14:44.602702 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a956115-7a13-4c60-8dae-6598c2bb0b6d None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:44.611040 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b39396-590f-43ce-9bb8-bd024f56e051 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:44.611830 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b39396-590f-43ce-9bb8-bd024f56e051 service cinder] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:44.612401 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b39396-590f-43ce-9bb8-bd024f56e051 service cinder] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:44.612517 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b39396-590f-43ce-9bb8-bd024f56e051 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:44.679108 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:14:44.698040 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b39396-590f-43ce-9bb8-bd024f56e051 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:44.699790 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b39396-590f-43ce-9bb8-bd024f56e051 service cinder] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:44.713021 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1157/2306] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:14:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:14:47.492071 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b7ebf-26ae-47b2-859d-bce5c2dc9341 service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:47.494463 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-729b7ebf-26ae-47b2-859d-bce5c2dc9341 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:14:47.573130 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b7ebf-26ae-47b2-859d-bce5c2dc9341 service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:47.578746 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9784837-a1d8-48c6-bc6f-9e78f08aca9c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9009560a846414b849d42efa8625ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:47.579503 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9784837-a1d8-48c6-bc6f-9e78f08aca9c service placement] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:47.579794 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9784837-a1d8-48c6-bc6f-9e78f08aca9c service placement] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:47.580079 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9784837-a1d8-48c6-bc6f-9e78f08aca9c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:47.582113 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b9784837-a1d8-48c6-bc6f-9e78f08aca9c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:14:47.597436 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9784837-a1d8-48c6-bc6f-9e78f08aca9c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:47.599088 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9784837-a1d8-48c6-bc6f-9e78f08aca9c service placement] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:47.610686 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1150/2307] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:14:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:14:48.144632 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b39396-590f-43ce-9bb8-bd024f56e051 service cinder] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:48.220976 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b39396-590f-43ce-9bb8-bd024f56e051 service cinder] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:48.225763 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333113c4-bf0b-4d4a-9d84-6506325f7530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:48.226936 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333113c4-bf0b-4d4a-9d84-6506325f7530 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:48.227220 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333113c4-bf0b-4d4a-9d84-6506325f7530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:48.227496 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333113c4-bf0b-4d4a-9d84-6506325f7530 admin admin] PATH_INFO: `/v3/users/7e5d546a221f4378b42bf7cd5fe60b65` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:48.228749 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333113c4-bf0b-4d4a-9d84-6506325f7530 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e5d546a221f4378b42bf7cd5fe60b65)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:48.230716 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333113c4-bf0b-4d4a-9d84-6506325f7530 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:48.284232 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-333113c4-bf0b-4d4a-9d84-6506325f7530 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e5d546a221f4378b42bf7cd5fe60b65'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:48.293068 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-333113c4-bf0b-4d4a-9d84-6506325f7530 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e5d546a221f4378b42bf7cd5fe60b65'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:48.293788 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-333113c4-bf0b-4d4a-9d84-6506325f7530 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e5d546a221f4378b42bf7cd5fe60b65'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:48.294397 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-333113c4-bf0b-4d4a-9d84-6506325f7530 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e5d546a221f4378b42bf7cd5fe60b65'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:48.308242 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-333113c4-bf0b-4d4a-9d84-6506325f7530 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e5d546a221f4378b42bf7cd5fe60b65'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:48.324146 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1158/2308] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:14:48 2022] DELETE /identity/v3/users/7e5d546a221f4378b42bf7cd5fe60b65 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:14:48.328917 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba681b7a-a6a1-4713-bb14-f0d4c280305f None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:48.329210 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba681b7a-a6a1-4713-bb14-f0d4c280305f None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:48.329486 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba681b7a-a6a1-4713-bb14-f0d4c280305f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:48.348837 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-ba681b7a-a6a1-4713-bb14-f0d4c280305f None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:14:48.350499 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ba681b7a-a6a1-4713-bb14-f0d4c280305f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:14:48.377807 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:14:48.425132 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1151/2309] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:14:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:14:48.435804 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333113c4-bf0b-4d4a-9d84-6506325f7530 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:48.437418 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-333113c4-bf0b-4d4a-9d84-6506325f7530 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:14:48.513465 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333113c4-bf0b-4d4a-9d84-6506325f7530 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:48.517297 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0fccbf-2217-4a78-b6a0-7c7d7af3dfc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:48.517970 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fccbf-2217-4a78-b6a0-7c7d7af3dfc0 service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:48.518250 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fccbf-2217-4a78-b6a0-7c7d7af3dfc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:48.518524 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fccbf-2217-4a78-b6a0-7c7d7af3dfc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:48.530301 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0fccbf-2217-4a78-b6a0-7c7d7af3dfc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:48.531924 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0fccbf-2217-4a78-b6a0-7c7d7af3dfc0 service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:48.544359 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1159/2310] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:14:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:14:49.035424 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba681b7a-a6a1-4713-bb14-f0d4c280305f None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:49.036991 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ba681b7a-a6a1-4713-bb14-f0d4c280305f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:14:49.056308 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba681b7a-a6a1-4713-bb14-f0d4c280305f None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:49.061735 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfdf3bc-749b-488c-a1e0-58ae18328e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:49.062685 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfdf3bc-749b-488c-a1e0-58ae18328e36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:49.063134 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfdf3bc-749b-488c-a1e0-58ae18328e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:49.063426 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfdf3bc-749b-488c-a1e0-58ae18328e36 admin admin] PATH_INFO: `/v3/projects/53c6f3efb5f54a2689a2566a859df9e4` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:49.064803 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfdf3bc-749b-488c-a1e0-58ae18328e36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53c6f3efb5f54a2689a2566a859df9e4)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:49.066814 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfdf3bc-749b-488c-a1e0-58ae18328e36 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:49.139171 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-fcfdf3bc-749b-488c-a1e0-58ae18328e36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53c6f3efb5f54a2689a2566a859df9e4', 'request_id': 'req-fcfdf3bc-749b-488c-a1e0-58ae18328e36'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:49.150474 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-fcfdf3bc-749b-488c-a1e0-58ae18328e36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53c6f3efb5f54a2689a2566a859df9e4', 'request_id': 'req-fcfdf3bc-749b-488c-a1e0-58ae18328e36'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:49.158077 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-fcfdf3bc-749b-488c-a1e0-58ae18328e36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53c6f3efb5f54a2689a2566a859df9e4', 'request_id': 'req-fcfdf3bc-749b-488c-a1e0-58ae18328e36'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:49.170560 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-fcfdf3bc-749b-488c-a1e0-58ae18328e36 admin admin] The token cache is being invalidate because project 53c6f3efb5f54a2689a2566a859df9e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:14:49.171107 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-fcfdf3bc-749b-488c-a1e0-58ae18328e36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:49.171778 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-fcfdf3bc-749b-488c-a1e0-58ae18328e36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:49.174313 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1152/2311] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:14:49 2022] DELETE /identity/v3/projects/53c6f3efb5f54a2689a2566a859df9e4 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:14:49.178853 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0fccbf-2217-4a78-b6a0-7c7d7af3dfc0 service neutron] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:49.189225 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0fccbf-2217-4a78-b6a0-7c7d7af3dfc0 service neutron] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:49.194768 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:14:49.257413 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec355474-20ad-4bb3-9eaf-ad7e8554084c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:49.258458 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec355474-20ad-4bb3-9eaf-ad7e8554084c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:49.258744 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec355474-20ad-4bb3-9eaf-ad7e8554084c admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:49.259022 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec355474-20ad-4bb3-9eaf-ad7e8554084c admin admin] PATH_INFO: `/v3/users/39081ba4371c43bc9985eb48b748c0e8` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:49.260303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec355474-20ad-4bb3-9eaf-ad7e8554084c admin admin] RBAC: Authorizing `identity:delete_user(user_id=39081ba4371c43bc9985eb48b748c0e8)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:49.262252 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec355474-20ad-4bb3-9eaf-ad7e8554084c admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:49.311562 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-ec355474-20ad-4bb3-9eaf-ad7e8554084c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39081ba4371c43bc9985eb48b748c0e8'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:49.320038 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-ec355474-20ad-4bb3-9eaf-ad7e8554084c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39081ba4371c43bc9985eb48b748c0e8'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:49.320993 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-ec355474-20ad-4bb3-9eaf-ad7e8554084c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39081ba4371c43bc9985eb48b748c0e8'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:49.321596 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-ec355474-20ad-4bb3-9eaf-ad7e8554084c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39081ba4371c43bc9985eb48b748c0e8'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:49.335367 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-ec355474-20ad-4bb3-9eaf-ad7e8554084c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39081ba4371c43bc9985eb48b748c0e8'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:49.350329 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1160/2312] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:14:49 2022] DELETE /identity/v3/users/39081ba4371c43bc9985eb48b748c0e8 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:14:49.640924 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfdf3bc-749b-488c-a1e0-58ae18328e36 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:49.643021 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-fcfdf3bc-749b-488c-a1e0-58ae18328e36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:14:49.659668 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfdf3bc-749b-488c-a1e0-58ae18328e36 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:49.720615 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89c5f7-55c6-4ecc-a94e-4c02b203a73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:49.721485 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89c5f7-55c6-4ecc-a94e-4c02b203a73a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:49.721773 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89c5f7-55c6-4ecc-a94e-4c02b203a73a admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:49.722049 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89c5f7-55c6-4ecc-a94e-4c02b203a73a admin admin] PATH_INFO: `/v3/projects/143e7fdb7a544d7689afd6d00b0288cf` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:49.723296 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad89c5f7-55c6-4ecc-a94e-4c02b203a73a admin admin] RBAC: Authorizing `identity:delete_project(project_id=143e7fdb7a544d7689afd6d00b0288cf)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:49.725339 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad89c5f7-55c6-4ecc-a94e-4c02b203a73a admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:49.775365 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ad89c5f7-55c6-4ecc-a94e-4c02b203a73a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '143e7fdb7a544d7689afd6d00b0288cf', 'request_id': 'req-ad89c5f7-55c6-4ecc-a94e-4c02b203a73a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:49.777785 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:14:49.782979 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ad89c5f7-55c6-4ecc-a94e-4c02b203a73a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '143e7fdb7a544d7689afd6d00b0288cf', 'request_id': 'req-ad89c5f7-55c6-4ecc-a94e-4c02b203a73a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:49.790258 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ad89c5f7-55c6-4ecc-a94e-4c02b203a73a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '143e7fdb7a544d7689afd6d00b0288cf', 'request_id': 'req-ad89c5f7-55c6-4ecc-a94e-4c02b203a73a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:49.801201 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ad89c5f7-55c6-4ecc-a94e-4c02b203a73a admin admin] The token cache is being invalidate because project 143e7fdb7a544d7689afd6d00b0288cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:14:49.802199 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ad89c5f7-55c6-4ecc-a94e-4c02b203a73a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:49.803192 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ad89c5f7-55c6-4ecc-a94e-4c02b203a73a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:49.804761 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1153/2313] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:14:49 2022] DELETE /identity/v3/projects/143e7fdb7a544d7689afd6d00b0288cf => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:14:49.810660 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccbbd70-6689-4f91-9035-2337d6d9fc7e None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:49.810897 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccbbd70-6689-4f91-9035-2337d6d9fc7e None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:49.811183 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccbbd70-6689-4f91-9035-2337d6d9fc7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:49.833610 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-1ccbbd70-6689-4f91-9035-2337d6d9fc7e None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:14:49.834873 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-1ccbbd70-6689-4f91-9035-2337d6d9fc7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:14:49.905096 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1161/2314] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:14:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:14:49.913876 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b6ebe-1aaa-4877-9d8b-59346c8f0ad3 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:49.914268 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b6ebe-1aaa-4877-9d8b-59346c8f0ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:49.914656 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b6ebe-1aaa-4877-9d8b-59346c8f0ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:49.934333 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-fd2b6ebe-1aaa-4877-9d8b-59346c8f0ad3 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:14:49.935548 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-fd2b6ebe-1aaa-4877-9d8b-59346c8f0ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:14:49.943684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1154/2315] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:14:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:14:49.948074 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccbbd70-6689-4f91-9035-2337d6d9fc7e None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:49.964723 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccbbd70-6689-4f91-9035-2337d6d9fc7e None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:49.969980 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b2fa6c-787e-4de6-a447-182e4b05d2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:49.970639 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2fa6c-787e-4de6-a447-182e4b05d2f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:49.970920 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2fa6c-787e-4de6-a447-182e4b05d2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:49.971189 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2fa6c-787e-4de6-a447-182e4b05d2f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:49.971909 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b2fa6c-787e-4de6-a447-182e4b05d2f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:14:49.972236 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b2fa6c-787e-4de6-a447-182e4b05d2f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:49.975646 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b2fa6c-787e-4de6-a447-182e4b05d2f1 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:49.987522 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1162/2316] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:14:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:14:49.992618 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b6ebe-1aaa-4877-9d8b-59346c8f0ad3 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:50.001772 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b6ebe-1aaa-4877-9d8b-59346c8f0ad3 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:50.006456 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f8988-f079-449b-9f31-9c17b908d8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:50.007130 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f8988-f079-449b-9f31-9c17b908d8d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:50.007411 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f8988-f079-449b-9f31-9c17b908d8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:50.007684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f8988-f079-449b-9f31-9c17b908d8d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:50.008426 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0f8988-f079-449b-9f31-9c17b908d8d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:50.010364 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0f8988-f079-449b-9f31-9c17b908d8d1 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:50.040955 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1155/2317] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:14:49 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:14:50.044744 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b2fa6c-787e-4de6-a447-182e4b05d2f1 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:50.055580 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b2fa6c-787e-4de6-a447-182e4b05d2f1 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:50.067128 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:14:50.114973 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baaf9ad-c533-4cb5-b528-9994f4f246c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:50.116329 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baaf9ad-c533-4cb5-b528-9994f4f246c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:50.116619 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baaf9ad-c533-4cb5-b528-9994f4f246c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:50.116896 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baaf9ad-c533-4cb5-b528-9994f4f246c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:50.117585 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baaf9ad-c533-4cb5-b528-9994f4f246c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:50.119508 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baaf9ad-c533-4cb5-b528-9994f4f246c9 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:50.138985 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1163/2318] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:14:50 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:14:50.143119 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f8988-f079-449b-9f31-9c17b908d8d1 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:50.154197 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f8988-f079-449b-9f31-9c17b908d8d1 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:50.159298 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae0388-ce09-4ff5-85d1-a1d1861a87ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:50.159973 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae0388-ce09-4ff5-85d1-a1d1861a87ae admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:50.160295 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae0388-ce09-4ff5-85d1-a1d1861a87ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:50.160599 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae0388-ce09-4ff5-85d1-a1d1861a87ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:50.162280 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ae0388-ce09-4ff5-85d1-a1d1861a87ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:50.164143 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ae0388-ce09-4ff5-85d1-a1d1861a87ae admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:50.179972 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1156/2319] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:14:50.183988 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baaf9ad-c533-4cb5-b528-9994f4f246c9 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:50.195984 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baaf9ad-c533-4cb5-b528-9994f4f246c9 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:50.200659 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d27a4f-4a19-4174-a0c3-afbefc4dfef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:50.201355 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d27a4f-4a19-4174-a0c3-afbefc4dfef4 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:50.201641 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d27a4f-4a19-4174-a0c3-afbefc4dfef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:50.201926 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d27a4f-4a19-4174-a0c3-afbefc4dfef4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:50.202648 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d27a4f-4a19-4174-a0c3-afbefc4dfef4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:50.204320 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d27a4f-4a19-4174-a0c3-afbefc4dfef4 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:50.214870 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1164/2320] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:14:50.218996 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae0388-ce09-4ff5-85d1-a1d1861a87ae admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:50.230068 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae0388-ce09-4ff5-85d1-a1d1861a87ae admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:50.234608 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b9e2b-2ce9-4805-9e03-4c7437e74b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:50.235480 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b9e2b-2ce9-4805-9e03-4c7437e74b1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:50.235756 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b9e2b-2ce9-4805-9e03-4c7437e74b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:50.236027 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b9e2b-2ce9-4805-9e03-4c7437e74b1c admin admin] PATH_INFO: `/v3/projects/577fd5b1fb2040d09af5555e6cc13160/users/20b75e294aaf4bf2a086bd4f92042106/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:50.250202 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49b9e2b-2ce9-4805-9e03-4c7437e74b1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=577fd5b1fb2040d09af5555e6cc13160, user_id=20b75e294aaf4bf2a086bd4f92042106, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:50.252873 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49b9e2b-2ce9-4805-9e03-4c7437e74b1c admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:50.265496 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1157/2321] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:14:50 2022] PUT /identity/v3/projects/577fd5b1fb2040d09af5555e6cc13160/users/20b75e294aaf4bf2a086bd4f92042106/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:14:50.276111 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92ae26-55d2-4ebc-be11-c6877d092eed None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:50.276438 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92ae26-55d2-4ebc-be11-c6877d092eed None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:50.276726 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92ae26-55d2-4ebc-be11-c6877d092eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:50.303534 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-9f92ae26-55d2-4ebc-be11-c6877d092eed None None] MFA Rules not processed for user `20b75e294aaf4bf2a086bd4f92042106`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:14:50.304778 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-9f92ae26-55d2-4ebc-be11-c6877d092eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:14:50.367291 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1165/2322] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:14:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:14:50.371779 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b9e2b-2ce9-4805-9e03-4c7437e74b1c admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:50.432394 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b9e2b-2ce9-4805-9e03-4c7437e74b1c admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:50.437138 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f8f11f-43cc-46e3-bd7b-be9afb318008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:50.437789 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8f11f-43cc-46e3-bd7b-be9afb318008 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:50.438071 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8f11f-43cc-46e3-bd7b-be9afb318008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:50.438350 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8f11f-43cc-46e3-bd7b-be9afb318008 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:50.439028 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f8f11f-43cc-46e3-bd7b-be9afb318008 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:50.440963 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f8f11f-43cc-46e3-bd7b-be9afb318008 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:50.467615 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1158/2323] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:14:50 2022] POST /identity/v3/projects => generated 375 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:14:50.471276 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f92ae26-55d2-4ebc-be11-c6877d092eed None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:50.483036 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f92ae26-55d2-4ebc-be11-c6877d092eed None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:50.540245 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413b862-ae76-4979-9122-18132b80f237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:50.540918 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413b862-ae76-4979-9122-18132b80f237 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:50.541197 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413b862-ae76-4979-9122-18132b80f237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:50.541466 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413b862-ae76-4979-9122-18132b80f237 admin admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:50.542154 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413b862-ae76-4979-9122-18132b80f237 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:50.544052 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413b862-ae76-4979-9122-18132b80f237 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:50.563265 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1166/2324] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:14:50 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:14:50.567895 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f8f11f-43cc-46e3-bd7b-be9afb318008 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:50.577987 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f8f11f-43cc-46e3-bd7b-be9afb318008 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:50.583175 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab5db5c-8fcd-433c-ac50-dc8b2965985e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:50.583828 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab5db5c-8fcd-433c-ac50-dc8b2965985e admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:50.584105 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab5db5c-8fcd-433c-ac50-dc8b2965985e admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:50.584405 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab5db5c-8fcd-433c-ac50-dc8b2965985e admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:50.585122 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab5db5c-8fcd-433c-ac50-dc8b2965985e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:50.586715 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab5db5c-8fcd-433c-ac50-dc8b2965985e admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:50.597902 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1159/2325] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:14:50.602760 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413b862-ae76-4979-9122-18132b80f237 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:50.612673 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413b862-ae76-4979-9122-18132b80f237 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:50.617466 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615395cf-09a6-49d3-af6c-f08397fc47dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:50.618279 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615395cf-09a6-49d3-af6c-f08397fc47dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:50.618559 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615395cf-09a6-49d3-af6c-f08397fc47dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:50.618831 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615395cf-09a6-49d3-af6c-f08397fc47dd admin admin] PATH_INFO: `/v3/projects/a26246e24ec04949b136dbf436cb139c/users/ee0e725c33d1414fa7321f9d022395cb/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:50.630695 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:14:50.635188 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615395cf-09a6-49d3-af6c-f08397fc47dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a26246e24ec04949b136dbf436cb139c, user_id=ee0e725c33d1414fa7321f9d022395cb, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:50.637971 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615395cf-09a6-49d3-af6c-f08397fc47dd admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:50.651751 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1167/2326] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:14:50 2022] PUT /identity/v3/projects/a26246e24ec04949b136dbf436cb139c/users/ee0e725c33d1414fa7321f9d022395cb/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:14:50.655762 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab5db5c-8fcd-433c-ac50-dc8b2965985e admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:50.666282 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab5db5c-8fcd-433c-ac50-dc8b2965985e admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:50.712281 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:14:50.723818 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a178eba-06c1-419f-962e-60eae1d6add9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:50.724513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a178eba-06c1-419f-962e-60eae1d6add9 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:50.724803 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a178eba-06c1-419f-962e-60eae1d6add9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:50.725083 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a178eba-06c1-419f-962e-60eae1d6add9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:50.725806 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a178eba-06c1-419f-962e-60eae1d6add9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:50.727683 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a178eba-06c1-419f-962e-60eae1d6add9 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:50.737470 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1160/2327] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:14:50.742199 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615395cf-09a6-49d3-af6c-f08397fc47dd admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:50.752286 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615395cf-09a6-49d3-af6c-f08397fc47dd admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:50.757035 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac3408-7640-431e-9de9-f27db61bf862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:50.757908 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac3408-7640-431e-9de9-f27db61bf862 admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:50.758196 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac3408-7640-431e-9de9-f27db61bf862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:50.758474 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac3408-7640-431e-9de9-f27db61bf862 admin admin] PATH_INFO: `/v3/projects/a26246e24ec04949b136dbf436cb139c/users/ee0e725c33d1414fa7321f9d022395cb/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:50.760468 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ac3408-7640-431e-9de9-f27db61bf862 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a26246e24ec04949b136dbf436cb139c, user_id=ee0e725c33d1414fa7321f9d022395cb, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:50.763092 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ac3408-7640-431e-9de9-f27db61bf862 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:50.773157 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1168/2328] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:14:50 2022] PUT /identity/v3/projects/a26246e24ec04949b136dbf436cb139c/users/ee0e725c33d1414fa7321f9d022395cb/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:14:50.784006 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfae60b-958f-44e7-aa89-22d7b11c0b99 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:50.784336 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfae60b-958f-44e7-aa89-22d7b11c0b99 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:50.784645 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfae60b-958f-44e7-aa89-22d7b11c0b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:50.811687 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-fdfae60b-958f-44e7-aa89-22d7b11c0b99 None None] MFA Rules not processed for user `ee0e725c33d1414fa7321f9d022395cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:14:50.812932 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-fdfae60b-958f-44e7-aa89-22d7b11c0b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:14:50.878970 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1161/2329] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:14:50 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:14:50.889913 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac3408-7640-431e-9de9-f27db61bf862 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:50.891606 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-51ac3408-7640-431e-9de9-f27db61bf862 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:14:50.949701 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac3408-7640-431e-9de9-f27db61bf862 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:50.953350 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c837da3-afbe-4d42-ae11-580181bfd955 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:50.954000 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c837da3-afbe-4d42-ae11-580181bfd955 service cinder] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:50.954287 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c837da3-afbe-4d42-ae11-580181bfd955 service cinder] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:50.954563 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c837da3-afbe-4d42-ae11-580181bfd955 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:50.964061 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c837da3-afbe-4d42-ae11-580181bfd955 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:50.965525 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c837da3-afbe-4d42-ae11-580181bfd955 service cinder] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:50.975657 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1169/2330] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:14:50 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:14:51.082914 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfae60b-958f-44e7-aa89-22d7b11c0b99 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:51.092547 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfae60b-958f-44e7-aa89-22d7b11c0b99 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:51.096230 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d723c-2740-4a51-8cca-b61bb8e73b7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:51.096876 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d723c-2740-4a51-8cca-b61bb8e73b7c service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:51.097161 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d723c-2740-4a51-8cca-b61bb8e73b7c service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:51.097437 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d723c-2740-4a51-8cca-b61bb8e73b7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:51.161932 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088d723c-2740-4a51-8cca-b61bb8e73b7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:51.163389 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088d723c-2740-4a51-8cca-b61bb8e73b7c service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:51.172762 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1162/2331] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:14:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:14:53.779456 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c837da3-afbe-4d42-ae11-580181bfd955 service cinder] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:53.865576 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c837da3-afbe-4d42-ae11-580181bfd955 service cinder] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:53.870685 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ae3c6-45af-489e-a135-c44b8c5771dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:53.871715 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ae3c6-45af-489e-a135-c44b8c5771dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:53.872040 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ae3c6-45af-489e-a135-c44b8c5771dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:53.872450 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ae3c6-45af-489e-a135-c44b8c5771dc admin admin] PATH_INFO: `/v3/users/20b75e294aaf4bf2a086bd4f92042106` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:53.873754 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1ae3c6-45af-489e-a135-c44b8c5771dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=20b75e294aaf4bf2a086bd4f92042106)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:53.875883 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1ae3c6-45af-489e-a135-c44b8c5771dc admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:53.946526 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-0f1ae3c6-45af-489e-a135-c44b8c5771dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20b75e294aaf4bf2a086bd4f92042106'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:53.956736 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-0f1ae3c6-45af-489e-a135-c44b8c5771dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20b75e294aaf4bf2a086bd4f92042106'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:53.957641 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-0f1ae3c6-45af-489e-a135-c44b8c5771dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20b75e294aaf4bf2a086bd4f92042106'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:53.958368 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-0f1ae3c6-45af-489e-a135-c44b8c5771dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20b75e294aaf4bf2a086bd4f92042106'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:53.974537 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-0f1ae3c6-45af-489e-a135-c44b8c5771dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20b75e294aaf4bf2a086bd4f92042106'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:53.985621 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:14:53.997165 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1170/2332] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:14:53 2022] DELETE /identity/v3/users/20b75e294aaf4bf2a086bd4f92042106 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:14:54.001639 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1d830-821d-4894-ac2d-25f010405458 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:54.002190 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1d830-821d-4894-ac2d-25f010405458 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:54.002519 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1d830-821d-4894-ac2d-25f010405458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:54.023155 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-17c1d830-821d-4894-ac2d-25f010405458 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:14:54.024649 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-17c1d830-821d-4894-ac2d-25f010405458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:14:54.120701 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1163/2333] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:14:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:14:54.131955 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ae3c6-45af-489e-a135-c44b8c5771dc admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:54.133980 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-0f1ae3c6-45af-489e-a135-c44b8c5771dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:14:54.204725 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ae3c6-45af-489e-a135-c44b8c5771dc admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:54.209437 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd5d16e-5a06-4bba-a123-853f96130035 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:54.210152 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5d16e-5a06-4bba-a123-853f96130035 service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:54.210594 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5d16e-5a06-4bba-a123-853f96130035 service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:54.210877 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5d16e-5a06-4bba-a123-853f96130035 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:54.221135 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd5d16e-5a06-4bba-a123-853f96130035 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:54.222602 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd5d16e-5a06-4bba-a123-853f96130035 service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:54.234074 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1171/2334] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:14:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:14:54.524593 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1d830-821d-4894-ac2d-25f010405458 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:54.526047 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-17c1d830-821d-4894-ac2d-25f010405458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:14:54.555095 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1d830-821d-4894-ac2d-25f010405458 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:54.561501 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c80c8fc-7493-44ed-b407-9b36481164fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:54.562566 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c80c8fc-7493-44ed-b407-9b36481164fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:54.562956 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c80c8fc-7493-44ed-b407-9b36481164fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:54.563308 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c80c8fc-7493-44ed-b407-9b36481164fb admin admin] PATH_INFO: `/v3/projects/577fd5b1fb2040d09af5555e6cc13160` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:54.565346 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c80c8fc-7493-44ed-b407-9b36481164fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=577fd5b1fb2040d09af5555e6cc13160)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:54.567273 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c80c8fc-7493-44ed-b407-9b36481164fb admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:54.579515 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:14:54.653666 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-8c80c8fc-7493-44ed-b407-9b36481164fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '577fd5b1fb2040d09af5555e6cc13160', 'request_id': 'req-8c80c8fc-7493-44ed-b407-9b36481164fb'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:54.666104 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-8c80c8fc-7493-44ed-b407-9b36481164fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '577fd5b1fb2040d09af5555e6cc13160', 'request_id': 'req-8c80c8fc-7493-44ed-b407-9b36481164fb'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:54.681113 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-8c80c8fc-7493-44ed-b407-9b36481164fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '577fd5b1fb2040d09af5555e6cc13160', 'request_id': 'req-8c80c8fc-7493-44ed-b407-9b36481164fb'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:54.685321 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158e6b7-d468-4f47-b513-e7bea9d2d9d3 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:54.685622 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158e6b7-d468-4f47-b513-e7bea9d2d9d3 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:54.685903 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158e6b7-d468-4f47-b513-e7bea9d2d9d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:54.696470 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-8c80c8fc-7493-44ed-b407-9b36481164fb admin admin] The token cache is being invalidate because project 577fd5b1fb2040d09af5555e6cc13160 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:14:54.696920 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-8c80c8fc-7493-44ed-b407-9b36481164fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:54.697715 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-8c80c8fc-7493-44ed-b407-9b36481164fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:54.699789 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1164/2335] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:14:54 2022] DELETE /identity/v3/projects/577fd5b1fb2040d09af5555e6cc13160 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:14:54.703672 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c80c8fc-7493-44ed-b407-9b36481164fb admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:54.705253 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-8c80c8fc-7493-44ed-b407-9b36481164fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:14:54.709164 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-7158e6b7-d468-4f47-b513-e7bea9d2d9d3 None None] MFA Rules not processed for user `5a2945ee4e3f4c6a91fef4978bcbfd88`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:14:54.710413 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-7158e6b7-d468-4f47-b513-e7bea9d2d9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:14:54.775826 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1172/2336] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:14:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:14:54.786800 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c80c8fc-7493-44ed-b407-9b36481164fb admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:54.791843 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8183e2-9362-42ea-ab6c-89cdbc15726c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:54.792843 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8183e2-9362-42ea-ab6c-89cdbc15726c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:54.793232 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8183e2-9362-42ea-ab6c-89cdbc15726c admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:54.793581 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8183e2-9362-42ea-ab6c-89cdbc15726c admin admin] PATH_INFO: `/v3/users/ee0e725c33d1414fa7321f9d022395cb` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:54.794999 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8183e2-9362-42ea-ab6c-89cdbc15726c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee0e725c33d1414fa7321f9d022395cb)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:54.797369 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8183e2-9362-42ea-ab6c-89cdbc15726c admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:54.851779 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1c8183e2-9362-42ea-ab6c-89cdbc15726c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee0e725c33d1414fa7321f9d022395cb'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:54.852477 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1c8183e2-9362-42ea-ab6c-89cdbc15726c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee0e725c33d1414fa7321f9d022395cb'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:54.853096 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1c8183e2-9362-42ea-ab6c-89cdbc15726c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee0e725c33d1414fa7321f9d022395cb'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:54.861004 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1c8183e2-9362-42ea-ab6c-89cdbc15726c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee0e725c33d1414fa7321f9d022395cb'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:54.873809 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1c8183e2-9362-42ea-ab6c-89cdbc15726c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee0e725c33d1414fa7321f9d022395cb'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:54.889925 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1165/2337] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:14:54 2022] DELETE /identity/v3/users/ee0e725c33d1414fa7321f9d022395cb => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:14:55.198428 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7158e6b7-d468-4f47-b513-e7bea9d2d9d3 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:55.210478 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7158e6b7-d468-4f47-b513-e7bea9d2d9d3 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:55.274609 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6127ec-b877-4348-9c4c-cf31458eba95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:55.275480 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6127ec-b877-4348-9c4c-cf31458eba95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:55.275763 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6127ec-b877-4348-9c4c-cf31458eba95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:55.276039 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6127ec-b877-4348-9c4c-cf31458eba95 admin admin] PATH_INFO: `/v3/projects/a26246e24ec04949b136dbf436cb139c` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:55.277249 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6127ec-b877-4348-9c4c-cf31458eba95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a26246e24ec04949b136dbf436cb139c)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:55.279769 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6127ec-b877-4348-9c4c-cf31458eba95 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:55.333064 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:14:55.335216 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-ad6127ec-b877-4348-9c4c-cf31458eba95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a26246e24ec04949b136dbf436cb139c', 'request_id': 'req-ad6127ec-b877-4348-9c4c-cf31458eba95'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:55.344902 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-ad6127ec-b877-4348-9c4c-cf31458eba95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a26246e24ec04949b136dbf436cb139c', 'request_id': 'req-ad6127ec-b877-4348-9c4c-cf31458eba95'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:55.353168 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-ad6127ec-b877-4348-9c4c-cf31458eba95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a26246e24ec04949b136dbf436cb139c', 'request_id': 'req-ad6127ec-b877-4348-9c4c-cf31458eba95'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:55.370830 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-ad6127ec-b877-4348-9c4c-cf31458eba95 admin admin] The token cache is being invalidate because project a26246e24ec04949b136dbf436cb139c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:14:55.371355 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-ad6127ec-b877-4348-9c4c-cf31458eba95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:55.372211 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-ad6127ec-b877-4348-9c4c-cf31458eba95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:55.374356 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1173/2338] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:14:55 2022] DELETE /identity/v3/projects/a26246e24ec04949b136dbf436cb139c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:14:55.380669 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb1988-4c6a-4baf-a403-a1aa7649f4f2 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:55.381226 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb1988-4c6a-4baf-a403-a1aa7649f4f2 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:55.381462 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb1988-4c6a-4baf-a403-a1aa7649f4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:55.411477 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-dbbb1988-4c6a-4baf-a403-a1aa7649f4f2 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:14:55.413182 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-dbbb1988-4c6a-4baf-a403-a1aa7649f4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:14:55.423161 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:14:55.497844 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1166/2339] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:14:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:14:55.510948 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df701158-1037-4a1c-9166-1799285a109d None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:55.510948 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df701158-1037-4a1c-9166-1799285a109d None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:55.511412 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df701158-1037-4a1c-9166-1799285a109d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:55.536403 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-df701158-1037-4a1c-9166-1799285a109d None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:14:55.538399 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-df701158-1037-4a1c-9166-1799285a109d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:14:55.558946 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1174/2340] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:14:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:14:55.564423 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb1988-4c6a-4baf-a403-a1aa7649f4f2 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:55.585383 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb1988-4c6a-4baf-a403-a1aa7649f4f2 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:55.596014 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a5527d-c15e-4cd2-9060-91b48abb298b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:55.597952 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5527d-c15e-4cd2-9060-91b48abb298b admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:55.598672 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5527d-c15e-4cd2-9060-91b48abb298b admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:55.599105 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5527d-c15e-4cd2-9060-91b48abb298b admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:55.600467 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a5527d-c15e-4cd2-9060-91b48abb298b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:14:55.600741 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a5527d-c15e-4cd2-9060-91b48abb298b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:55.603043 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a5527d-c15e-4cd2-9060-91b48abb298b admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:55.622526 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1167/2341] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:14:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:14:55.624103 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df701158-1037-4a1c-9166-1799285a109d None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:55.638824 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df701158-1037-4a1c-9166-1799285a109d None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:55.643926 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd459db-0bee-4234-ad8b-cc4c804a4fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:55.644883 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd459db-0bee-4234-ad8b-cc4c804a4fd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:55.645320 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd459db-0bee-4234-ad8b-cc4c804a4fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:55.645848 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd459db-0bee-4234-ad8b-cc4c804a4fd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:55.647167 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd459db-0bee-4234-ad8b-cc4c804a4fd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:55.649727 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd459db-0bee-4234-ad8b-cc4c804a4fd8 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:55.716239 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1175/2342] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:14:55 2022] POST /identity/v3/projects => generated 375 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:14:55.719824 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a5527d-c15e-4cd2-9060-91b48abb298b admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:55.736732 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a5527d-c15e-4cd2-9060-91b48abb298b admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:55.811126 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3803821-9d51-4527-b88d-b6cd32ee9233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:55.812226 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3803821-9d51-4527-b88d-b6cd32ee9233 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:55.812387 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3803821-9d51-4527-b88d-b6cd32ee9233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:55.812890 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3803821-9d51-4527-b88d-b6cd32ee9233 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:55.813888 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3803821-9d51-4527-b88d-b6cd32ee9233 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:55.815819 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3803821-9d51-4527-b88d-b6cd32ee9233 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:55.844967 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1168/2343] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:14:55 2022] POST /identity/v3/users => generated 288 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:14:55.846885 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd459db-0bee-4234-ad8b-cc4c804a4fd8 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:55.866996 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd459db-0bee-4234-ad8b-cc4c804a4fd8 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:55.872944 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe79e42b-483d-4dcd-b3e4-0113fba52f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:55.874153 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79e42b-483d-4dcd-b3e4-0113fba52f80 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:55.874476 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79e42b-483d-4dcd-b3e4-0113fba52f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:55.874759 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79e42b-483d-4dcd-b3e4-0113fba52f80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:55.875517 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe79e42b-483d-4dcd-b3e4-0113fba52f80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:55.877263 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe79e42b-483d-4dcd-b3e4-0113fba52f80 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:55.894607 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1176/2344] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:14:55.900675 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3803821-9d51-4527-b88d-b6cd32ee9233 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:55.918898 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3803821-9d51-4527-b88d-b6cd32ee9233 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:55.925967 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac00f0-4806-420e-a97a-6f5b36f02aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:55.926226 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac00f0-4806-420e-a97a-6f5b36f02aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:55.926513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac00f0-4806-420e-a97a-6f5b36f02aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:55.926793 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac00f0-4806-420e-a97a-6f5b36f02aa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:55.927530 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eac00f0-4806-420e-a97a-6f5b36f02aa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:55.929212 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eac00f0-4806-420e-a97a-6f5b36f02aa9 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:55.942891 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1169/2345] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:14:55.948426 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe79e42b-483d-4dcd-b3e4-0113fba52f80 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:55.962651 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe79e42b-483d-4dcd-b3e4-0113fba52f80 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:55.970135 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41589410-2fe2-49ca-9870-2c450abf6ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:55.971714 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41589410-2fe2-49ca-9870-2c450abf6ef0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:55.972253 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41589410-2fe2-49ca-9870-2c450abf6ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:55.972812 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41589410-2fe2-49ca-9870-2c450abf6ef0 admin admin] PATH_INFO: `/v3/projects/b4b18a5a487547959e3f8d861ec15d68/users/8e3c58a004ff40158b06963db9fa4411/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:55.992010 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41589410-2fe2-49ca-9870-2c450abf6ef0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4b18a5a487547959e3f8d861ec15d68, user_id=8e3c58a004ff40158b06963db9fa4411, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:55.995709 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41589410-2fe2-49ca-9870-2c450abf6ef0 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:56.014057 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1177/2346] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:14:55 2022] PUT /identity/v3/projects/b4b18a5a487547959e3f8d861ec15d68/users/8e3c58a004ff40158b06963db9fa4411/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:14:56.029280 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9fe5a-7413-4170-bea0-d9651d754033 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:56.029955 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9fe5a-7413-4170-bea0-d9651d754033 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:56.030265 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9fe5a-7413-4170-bea0-d9651d754033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:56.072382 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-c7a9fe5a-7413-4170-bea0-d9651d754033 None None] MFA Rules not processed for user `8e3c58a004ff40158b06963db9fa4411`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:14:56.074035 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-c7a9fe5a-7413-4170-bea0-d9651d754033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:14:56.167696 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1170/2347] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:14:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:14:56.175012 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41589410-2fe2-49ca-9870-2c450abf6ef0 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:56.267475 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41589410-2fe2-49ca-9870-2c450abf6ef0 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:56.275110 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19952fc-ba7b-45fd-be4c-bd71f5414f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:56.276264 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19952fc-ba7b-45fd-be4c-bd71f5414f2b admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:56.276732 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19952fc-ba7b-45fd-be4c-bd71f5414f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:56.277180 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19952fc-ba7b-45fd-be4c-bd71f5414f2b admin admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:56.278329 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19952fc-ba7b-45fd-be4c-bd71f5414f2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:56.281523 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19952fc-ba7b-45fd-be4c-bd71f5414f2b admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:56.316295 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1178/2348] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:14:56 2022] POST /identity/v3/projects => generated 373 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:14:56.322139 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9fe5a-7413-4170-bea0-d9651d754033 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:56.335252 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9fe5a-7413-4170-bea0-d9651d754033 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:56.341170 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:14:56.445192 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5765af8d-df25-4575-b347-fdefde5455d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:56.446303 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765af8d-df25-4575-b347-fdefde5455d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:56.446740 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765af8d-df25-4575-b347-fdefde5455d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:56.447391 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765af8d-df25-4575-b347-fdefde5455d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:56.448619 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5765af8d-df25-4575-b347-fdefde5455d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:56.451474 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5765af8d-df25-4575-b347-fdefde5455d1 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:56.482069 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1171/2349] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:14:56 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:14:56.488945 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19952fc-ba7b-45fd-be4c-bd71f5414f2b admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:56.509390 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19952fc-ba7b-45fd-be4c-bd71f5414f2b admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:56.517518 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dbe9fe-366d-4bd6-addf-9310c9391f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:56.518498 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dbe9fe-366d-4bd6-addf-9310c9391f4d admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:56.518961 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dbe9fe-366d-4bd6-addf-9310c9391f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:56.519428 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dbe9fe-366d-4bd6-addf-9310c9391f4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:56.522436 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dbe9fe-366d-4bd6-addf-9310c9391f4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:56.525461 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dbe9fe-366d-4bd6-addf-9310c9391f4d admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:56.545361 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1179/2350] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:14:56 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:14:56.555697 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5765af8d-df25-4575-b347-fdefde5455d1 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:56.572014 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5765af8d-df25-4575-b347-fdefde5455d1 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:56.578472 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99665f06-8580-4512-916b-4908a3838c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:56.579787 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99665f06-8580-4512-916b-4908a3838c04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:56.580071 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99665f06-8580-4512-916b-4908a3838c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:56.582017 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99665f06-8580-4512-916b-4908a3838c04 admin admin] PATH_INFO: `/v3/projects/11eb1526e1a8410e9f91f9287414587a/users/b025d7404a074649a1859a39991fbac5/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:56.603886 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99665f06-8580-4512-916b-4908a3838c04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11eb1526e1a8410e9f91f9287414587a, user_id=b025d7404a074649a1859a39991fbac5, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:56.606639 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99665f06-8580-4512-916b-4908a3838c04 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:56.622661 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1172/2351] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:14:56 2022] PUT /identity/v3/projects/11eb1526e1a8410e9f91f9287414587a/users/b025d7404a074649a1859a39991fbac5/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:14:56.626974 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dbe9fe-366d-4bd6-addf-9310c9391f4d admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:56.638889 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dbe9fe-366d-4bd6-addf-9310c9391f4d admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:56.688334 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:14:56.709086 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795eb8c-fedc-450b-8758-21f6ae980587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:56.709775 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795eb8c-fedc-450b-8758-21f6ae980587 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:56.710061 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795eb8c-fedc-450b-8758-21f6ae980587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:56.710350 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795eb8c-fedc-450b-8758-21f6ae980587 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:56.711091 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7795eb8c-fedc-450b-8758-21f6ae980587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:56.712795 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7795eb8c-fedc-450b-8758-21f6ae980587 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:56.727742 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1180/2352] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:14:56 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:14:56.730891 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99665f06-8580-4512-916b-4908a3838c04 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:56.743998 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99665f06-8580-4512-916b-4908a3838c04 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:56.749607 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6751626f-618f-4376-afd8-4c5d46cf706d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:56.750512 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751626f-618f-4376-afd8-4c5d46cf706d admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:56.750795 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751626f-618f-4376-afd8-4c5d46cf706d admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:56.751136 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751626f-618f-4376-afd8-4c5d46cf706d admin admin] PATH_INFO: `/v3/projects/11eb1526e1a8410e9f91f9287414587a/users/b025d7404a074649a1859a39991fbac5/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:56.753141 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6751626f-618f-4376-afd8-4c5d46cf706d admin admin] RBAC: Authorizing `identity:create_grant(project_id=11eb1526e1a8410e9f91f9287414587a, user_id=b025d7404a074649a1859a39991fbac5, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:56.756806 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6751626f-618f-4376-afd8-4c5d46cf706d admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:56.768327 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1173/2353] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:14:56 2022] PUT /identity/v3/projects/11eb1526e1a8410e9f91f9287414587a/users/b025d7404a074649a1859a39991fbac5/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:14:56.780316 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73130ec-a162-4a40-8c7c-dde33ad54a54 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:56.780651 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73130ec-a162-4a40-8c7c-dde33ad54a54 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:56.780935 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73130ec-a162-4a40-8c7c-dde33ad54a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:56.825322 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-c73130ec-a162-4a40-8c7c-dde33ad54a54 None None] MFA Rules not processed for user `b025d7404a074649a1859a39991fbac5`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:14:56.826602 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-c73130ec-a162-4a40-8c7c-dde33ad54a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:14:56.940294 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1181/2354] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:14:56 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:14:56.951459 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6751626f-618f-4376-afd8-4c5d46cf706d admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:56.953197 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-6751626f-618f-4376-afd8-4c5d46cf706d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:14:57.015764 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6751626f-618f-4376-afd8-4c5d46cf706d admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:57.019528 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a216c-5cc3-468d-bbed-58ae4b2a096a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:57.021092 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a216c-5cc3-468d-bbed-58ae4b2a096a service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:57.021405 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a216c-5cc3-468d-bbed-58ae4b2a096a service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:57.021779 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a216c-5cc3-468d-bbed-58ae4b2a096a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:57.085680 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188a216c-5cc3-468d-bbed-58ae4b2a096a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:57.087140 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188a216c-5cc3-468d-bbed-58ae4b2a096a service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:57.096688 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1174/2355] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:14:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:14:59.828161 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73130ec-a162-4a40-8c7c-dde33ad54a54 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:14:59.892451 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73130ec-a162-4a40-8c7c-dde33ad54a54 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:14:59.897660 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923457e-edef-4daf-af1c-2749fc0541aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:14:59.898540 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923457e-edef-4daf-af1c-2749fc0541aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:59.898824 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923457e-edef-4daf-af1c-2749fc0541aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:59.899126 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923457e-edef-4daf-af1c-2749fc0541aa admin admin] PATH_INFO: `/v3/users/8e3c58a004ff40158b06963db9fa4411` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:14:59.900350 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4923457e-edef-4daf-af1c-2749fc0541aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e3c58a004ff40158b06963db9fa4411)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:14:59.902321 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4923457e-edef-4daf-af1c-2749fc0541aa admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:14:59.951679 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-4923457e-edef-4daf-af1c-2749fc0541aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e3c58a004ff40158b06963db9fa4411'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:59.959541 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-4923457e-edef-4daf-af1c-2749fc0541aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e3c58a004ff40158b06963db9fa4411'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:59.960255 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-4923457e-edef-4daf-af1c-2749fc0541aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e3c58a004ff40158b06963db9fa4411'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:59.960873 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-4923457e-edef-4daf-af1c-2749fc0541aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e3c58a004ff40158b06963db9fa4411'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:59.971398 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:14:59.974843 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-4923457e-edef-4daf-af1c-2749fc0541aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e3c58a004ff40158b06963db9fa4411'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:14:59.992906 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1182/2356] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:14:59 2022] DELETE /identity/v3/users/8e3c58a004ff40158b06963db9fa4411 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:14:59.997778 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f26fb2-508f-40e6-bf82-4faa49863bed None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:14:59.998548 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f26fb2-508f-40e6-bf82-4faa49863bed None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:14:59.998548 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f26fb2-508f-40e6-bf82-4faa49863bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:15:00.017964 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-98f26fb2-508f-40e6-bf82-4faa49863bed None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:15:00.019400 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-98f26fb2-508f-40e6-bf82-4faa49863bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:15:00.030311 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:15:00.095794 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1175/2357] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:14:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:15:00.107119 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923457e-edef-4daf-af1c-2749fc0541aa admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:15:00.108613 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-4923457e-edef-4daf-af1c-2749fc0541aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:15:00.174281 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923457e-edef-4daf-af1c-2749fc0541aa admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:15:00.178575 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f1b66-02f6-414a-b74b-e233e26d7467 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:15:00.179262 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f1b66-02f6-414a-b74b-e233e26d7467 service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:15:00.179569 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f1b66-02f6-414a-b74b-e233e26d7467 service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:15:00.179843 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f1b66-02f6-414a-b74b-e233e26d7467 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:15:00.190983 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535f1b66-02f6-414a-b74b-e233e26d7467 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:15:00.193111 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535f1b66-02f6-414a-b74b-e233e26d7467 service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:15:00.203662 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1183/2358] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:15:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:15:00.843242 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f26fb2-508f-40e6-bf82-4faa49863bed None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:15:00.844904 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-98f26fb2-508f-40e6-bf82-4faa49863bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:15:00.860672 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f26fb2-508f-40e6-bf82-4faa49863bed None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:15:00.865859 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03af883-7845-4d6f-af6f-08732bcec513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:15:00.866661 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03af883-7845-4d6f-af6f-08732bcec513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:15:00.867556 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03af883-7845-4d6f-af6f-08732bcec513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:15:00.867839 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03af883-7845-4d6f-af6f-08732bcec513 admin admin] PATH_INFO: `/v3/projects/b4b18a5a487547959e3f8d861ec15d68` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:15:00.869407 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03af883-7845-4d6f-af6f-08732bcec513 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4b18a5a487547959e3f8d861ec15d68)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:15:00.871241 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03af883-7845-4d6f-af6f-08732bcec513 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:15:00.929738 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a03af883-7845-4d6f-af6f-08732bcec513 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4b18a5a487547959e3f8d861ec15d68', 'request_id': 'req-a03af883-7845-4d6f-af6f-08732bcec513'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:15:00.938279 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a03af883-7845-4d6f-af6f-08732bcec513 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4b18a5a487547959e3f8d861ec15d68', 'request_id': 'req-a03af883-7845-4d6f-af6f-08732bcec513'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:15:00.947026 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a03af883-7845-4d6f-af6f-08732bcec513 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4b18a5a487547959e3f8d861ec15d68', 'request_id': 'req-a03af883-7845-4d6f-af6f-08732bcec513'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:15:00.960857 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a03af883-7845-4d6f-af6f-08732bcec513 admin admin] The token cache is being invalidate because project b4b18a5a487547959e3f8d861ec15d68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:15:00.961407 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a03af883-7845-4d6f-af6f-08732bcec513 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:15:00.962490 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a03af883-7845-4d6f-af6f-08732bcec513 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:15:00.964103 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1176/2359] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:15:00 2022] DELETE /identity/v3/projects/b4b18a5a487547959e3f8d861ec15d68 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:15:00.968420 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f1b66-02f6-414a-b74b-e233e26d7467 service neutron] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:15:00.979606 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f1b66-02f6-414a-b74b-e233e26d7467 service neutron] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:15:01.039918 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737e899-4d36-45da-be6d-3a9047627d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:15:01.040570 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737e899-4d36-45da-be6d-3a9047627d43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:15:01.040862 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737e899-4d36-45da-be6d-3a9047627d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:15:01.041145 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737e899-4d36-45da-be6d-3a9047627d43 admin admin] PATH_INFO: `/v3/users/b025d7404a074649a1859a39991fbac5` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:15:01.042348 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f737e899-4d36-45da-be6d-3a9047627d43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b025d7404a074649a1859a39991fbac5)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:15:01.044336 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f737e899-4d36-45da-be6d-3a9047627d43 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:15:01.104230 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-f737e899-4d36-45da-be6d-3a9047627d43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b025d7404a074649a1859a39991fbac5'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:15:01.111354 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-f737e899-4d36-45da-be6d-3a9047627d43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b025d7404a074649a1859a39991fbac5'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:15:01.112098 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-f737e899-4d36-45da-be6d-3a9047627d43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b025d7404a074649a1859a39991fbac5'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:15:01.112780 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-f737e899-4d36-45da-be6d-3a9047627d43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b025d7404a074649a1859a39991fbac5'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:15:01.134932 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-f737e899-4d36-45da-be6d-3a9047627d43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b025d7404a074649a1859a39991fbac5'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:15:01.151220 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1184/2360] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:15:00 2022] DELETE /identity/v3/users/b025d7404a074649a1859a39991fbac5 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:15:01.451713 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03af883-7845-4d6f-af6f-08732bcec513 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:15:01.453256 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a03af883-7845-4d6f-af6f-08732bcec513 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:15:01.468353 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03af883-7845-4d6f-af6f-08732bcec513 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:15:01.549147 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4565b-5955-49ab-bc55-9bea6a17f8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:15:01.549920 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4565b-5955-49ab-bc55-9bea6a17f8ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:15:01.550205 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4565b-5955-49ab-bc55-9bea6a17f8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:15:01.550485 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4565b-5955-49ab-bc55-9bea6a17f8ae admin admin] PATH_INFO: `/v3/projects/11eb1526e1a8410e9f91f9287414587a` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:15:01.552008 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4565b-5955-49ab-bc55-9bea6a17f8ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=11eb1526e1a8410e9f91f9287414587a)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:15:01.553958 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4565b-5955-49ab-bc55-9bea6a17f8ae admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:15:01.595483 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:15:01.604133 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-7fa4565b-5955-49ab-bc55-9bea6a17f8ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11eb1526e1a8410e9f91f9287414587a', 'request_id': 'req-7fa4565b-5955-49ab-bc55-9bea6a17f8ae'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:15:01.611898 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-7fa4565b-5955-49ab-bc55-9bea6a17f8ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11eb1526e1a8410e9f91f9287414587a', 'request_id': 'req-7fa4565b-5955-49ab-bc55-9bea6a17f8ae'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:15:01.618273 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-7fa4565b-5955-49ab-bc55-9bea6a17f8ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11eb1526e1a8410e9f91f9287414587a', 'request_id': 'req-7fa4565b-5955-49ab-bc55-9bea6a17f8ae'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:15:01.629522 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-7fa4565b-5955-49ab-bc55-9bea6a17f8ae admin admin] The token cache is being invalidate because project 11eb1526e1a8410e9f91f9287414587a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:15:01.629737 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-7fa4565b-5955-49ab-bc55-9bea6a17f8ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:15:01.630392 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-7fa4565b-5955-49ab-bc55-9bea6a17f8ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:15:01.631915 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1177/2361] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:15:01 2022] DELETE /identity/v3/projects/11eb1526e1a8410e9f91f9287414587a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:15:01.636914 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea3485-8cd2-4e26-8b48-16a6dabf697e None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:15:01.637201 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea3485-8cd2-4e26-8b48-16a6dabf697e None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:15:01.637472 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea3485-8cd2-4e26-8b48-16a6dabf697e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:15:01.656108 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-2eea3485-8cd2-4e26-8b48-16a6dabf697e None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:15:01.657342 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-2eea3485-8cd2-4e26-8b48-16a6dabf697e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:15:01.662036 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:15:01.721618 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1185/2362] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:15:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:15:01.730745 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265aedf-6662-46f9-ac96-96ea9f6734ae None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:15:01.731039 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265aedf-6662-46f9-ac96-96ea9f6734ae None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:15:01.731314 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265aedf-6662-46f9-ac96-96ea9f6734ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:15:01.750520 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-b265aedf-6662-46f9-ac96-96ea9f6734ae None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:15:01.751788 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b265aedf-6662-46f9-ac96-96ea9f6734ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:15:01.760255 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1178/2363] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:15:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:15:01.764502 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea3485-8cd2-4e26-8b48-16a6dabf697e None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:15:01.775399 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea3485-8cd2-4e26-8b48-16a6dabf697e None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:15:01.780249 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3ca17-c97b-4429-81ca-9e07b7c42011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:15:01.780844 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3ca17-c97b-4429-81ca-9e07b7c42011 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:15:01.781127 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3ca17-c97b-4429-81ca-9e07b7c42011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:15:01.781400 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3ca17-c97b-4429-81ca-9e07b7c42011 admin admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:15:01.782130 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec3ca17-c97b-4429-81ca-9e07b7c42011 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:15:01.782436 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec3ca17-c97b-4429-81ca-9e07b7c42011 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:15:01.784053 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec3ca17-c97b-4429-81ca-9e07b7c42011 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:15:01.796064 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1186/2364] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:15:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:15:01.800539 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265aedf-6662-46f9-ac96-96ea9f6734ae None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:15:01.810325 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265aedf-6662-46f9-ac96-96ea9f6734ae None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:15:01.815269 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ef9cc-ebde-4b51-b393-45b7e8f69b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:15:01.816009 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ef9cc-ebde-4b51-b393-45b7e8f69b21 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:15:01.816911 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ef9cc-ebde-4b51-b393-45b7e8f69b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:15:01.817262 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ef9cc-ebde-4b51-b393-45b7e8f69b21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:15:01.818136 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ef9cc-ebde-4b51-b393-45b7e8f69b21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:15:01.820143 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ef9cc-ebde-4b51-b393-45b7e8f69b21 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:15:01.850250 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1179/2365] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:15:01 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:15:01.851721 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3ca17-c97b-4429-81ca-9e07b7c42011 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:15:01.861850 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3ca17-c97b-4429-81ca-9e07b7c42011 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:15:01.931206 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45345048-2ade-4d3f-aa21-5ee224d4a3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:15:01.931845 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45345048-2ade-4d3f-aa21-5ee224d4a3f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:15:01.932131 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45345048-2ade-4d3f-aa21-5ee224d4a3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:15:01.932438 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45345048-2ade-4d3f-aa21-5ee224d4a3f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:15:01.933183 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45345048-2ade-4d3f-aa21-5ee224d4a3f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:15:01.935100 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45345048-2ade-4d3f-aa21-5ee224d4a3f3 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:15:01.958298 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1187/2366] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:15:01 2022] POST /identity/v3/users => generated 292 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 12:15:01.962384 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ef9cc-ebde-4b51-b393-45b7e8f69b21 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:15:01.972761 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ef9cc-ebde-4b51-b393-45b7e8f69b21 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:15:01.977975 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6943d54-ed9d-4dcc-a4d3-c0118a83c5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:15:01.978644 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6943d54-ed9d-4dcc-a4d3-c0118a83c5f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:15:01.978933 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6943d54-ed9d-4dcc-a4d3-c0118a83c5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:15:01.979213 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6943d54-ed9d-4dcc-a4d3-c0118a83c5f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:15:01.979939 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6943d54-ed9d-4dcc-a4d3-c0118a83c5f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:15:01.981603 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6943d54-ed9d-4dcc-a4d3-c0118a83c5f0 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:15:01.992684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1180/2367] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:15:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:15:01.996858 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45345048-2ade-4d3f-aa21-5ee224d4a3f3 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:15:02.007452 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45345048-2ade-4d3f-aa21-5ee224d4a3f3 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:15:02.012064 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc331eb-5d6a-44d6-8d9a-af1e8a8911c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:15:02.012774 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc331eb-5d6a-44d6-8d9a-af1e8a8911c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:15:02.013058 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc331eb-5d6a-44d6-8d9a-af1e8a8911c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:15:02.013334 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc331eb-5d6a-44d6-8d9a-af1e8a8911c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:15:02.014116 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc331eb-5d6a-44d6-8d9a-af1e8a8911c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:15:02.015717 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc331eb-5d6a-44d6-8d9a-af1e8a8911c2 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:15:02.026834 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1188/2368] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:15:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:15:02.031268 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6943d54-ed9d-4dcc-a4d3-c0118a83c5f0 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:15:02.041553 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6943d54-ed9d-4dcc-a4d3-c0118a83c5f0 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:15:02.046876 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd0b15-1b46-450c-85a3-defbabe66d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:15:02.047761 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd0b15-1b46-450c-85a3-defbabe66d5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:15:02.048042 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd0b15-1b46-450c-85a3-defbabe66d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:15:02.048346 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd0b15-1b46-450c-85a3-defbabe66d5c admin admin] PATH_INFO: `/v3/projects/43bc53c31a9b4f32a53ddf4e13a6abac/users/82d697ab683546cba41c3149ea1bc231/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:15:02.063111 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cd0b15-1b46-450c-85a3-defbabe66d5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=43bc53c31a9b4f32a53ddf4e13a6abac, user_id=82d697ab683546cba41c3149ea1bc231, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:15:02.065724 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cd0b15-1b46-450c-85a3-defbabe66d5c admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:15:02.080943 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1181/2369] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:15:02 2022] PUT /identity/v3/projects/43bc53c31a9b4f32a53ddf4e13a6abac/users/82d697ab683546cba41c3149ea1bc231/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:15:02.087395 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a2988-ed86-46e8-8709-f2e08721bd21 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:15:02.087752 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a2988-ed86-46e8-8709-f2e08721bd21 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:15:02.088108 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a2988-ed86-46e8-8709-f2e08721bd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:15:02.106469 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-a57a2988-ed86-46e8-8709-f2e08721bd21 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:15:02.107699 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-a57a2988-ed86-46e8-8709-f2e08721bd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:15:02.171710 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1189/2370] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:15:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:15:02.182297 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd0b15-1b46-450c-85a3-defbabe66d5c admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:15:02.183979 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-78cd0b15-1b46-450c-85a3-defbabe66d5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:15:02.253332 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd0b15-1b46-450c-85a3-defbabe66d5c admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:15:02.260077 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a74e5d8-6ced-4665-be7f-17473e0fd931 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:15:02.260767 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74e5d8-6ced-4665-be7f-17473e0fd931 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:15:02.261045 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74e5d8-6ced-4665-be7f-17473e0fd931 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:15:02.261315 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74e5d8-6ced-4665-be7f-17473e0fd931 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:15:02.273435 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a74e5d8-6ced-4665-be7f-17473e0fd931 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:15:02.274879 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a74e5d8-6ced-4665-be7f-17473e0fd931 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:15:02.284457 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1182/2371] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:15:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:15:02.966056 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea5b91-c8ec-4031-b43b-ddbf2b412b91 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:15:02.966387 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea5b91-c8ec-4031-b43b-ddbf2b412b91 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:15:02.966730 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea5b91-c8ec-4031-b43b-ddbf2b412b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:15:02.996476 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-d4ea5b91-c8ec-4031-b43b-ddbf2b412b91 None None] MFA Rules not processed for user `82d697ab683546cba41c3149ea1bc231`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:15:02.997697 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-d4ea5b91-c8ec-4031-b43b-ddbf2b412b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:15:03.003636 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:15:03.089099 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1190/2372] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:15:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:15:03.102585 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a74e5d8-6ced-4665-be7f-17473e0fd931 service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:15:03.104785 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-6a74e5d8-6ced-4665-be7f-17473e0fd931 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:15:03.188346 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a74e5d8-6ced-4665-be7f-17473e0fd931 service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:15:03.192724 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb37310-3cea-412f-8b48-6d1dc04b52f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:15:03.193376 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb37310-3cea-412f-8b48-6d1dc04b52f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:15:03.193655 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb37310-3cea-412f-8b48-6d1dc04b52f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:15:03.193927 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb37310-3cea-412f-8b48-6d1dc04b52f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:15:03.202555 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb37310-3cea-412f-8b48-6d1dc04b52f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:15:03.203982 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb37310-3cea-412f-8b48-6d1dc04b52f8 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:15:03.213582 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1183/2373] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:15:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:15:04.621405 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d70392-6e79-488d-b727-9052c01a1648 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:15:04.621938 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d70392-6e79-488d-b727-9052c01a1648 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:15:04.622029 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d70392-6e79-488d-b727-9052c01a1648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:15:04.640013 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-c0d70392-6e79-488d-b727-9052c01a1648 None None] MFA Rules not processed for user `82d697ab683546cba41c3149ea1bc231`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:15:04.641245 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-c0d70392-6e79-488d-b727-9052c01a1648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:15:04.648485 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1191/2374] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:15:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:15:13.209125 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=88,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:15:14.634870 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=28 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:15:32.968612 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96babb57-08d4-4286-9126-b5b006ce9753 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:15:32.969135 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96babb57-08d4-4286-9126-b5b006ce9753 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:15:32.969251 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96babb57-08d4-4286-9126-b5b006ce9753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:15:32.987416 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-96babb57-08d4-4286-9126-b5b006ce9753 None None] MFA Rules not processed for user `38475bbe086b451fb78750ce6606dfa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:15:32.988687 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-96babb57-08d4-4286-9126-b5b006ce9753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:15:33.054959 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1184/2375] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:15:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:15:43.047321 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=25 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:16:22.064087 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d0cff-b3a6-4311-8f6b-b0e0ab25e7fe None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:16:22.064625 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d0cff-b3a6-4311-8f6b-b0e0ab25e7fe None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:16:22.064731 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d0cff-b3a6-4311-8f6b-b0e0ab25e7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:16:22.082635 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-233d0cff-b3a6-4311-8f6b-b0e0ab25e7fe None None] MFA Rules not processed for user `d52efc21c66d4300a8a979d92dbfeb47`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:16:22.083831 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-233d0cff-b3a6-4311-8f6b-b0e0ab25e7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:16:22.139229 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1192/2376] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Jun 8 12:16:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:16:22.184875 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96babb57-08d4-4286-9126-b5b006ce9753 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:16:22.186286 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-96babb57-08d4-4286-9126-b5b006ce9753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:16:22.261407 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96babb57-08d4-4286-9126-b5b006ce9753 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:16:22.266956 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ea40e-deec-4ff3-a2bd-b123ff31d178 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753bde6a72d64045abd3ad44b9b0de04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:16:22.267610 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ea40e-deec-4ff3-a2bd-b123ff31d178 service swift] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:16:22.267894 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ea40e-deec-4ff3-a2bd-b123ff31d178 service swift] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:16:22.268212 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ea40e-deec-4ff3-a2bd-b123ff31d178 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:16:22.277188 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ea40e-deec-4ff3-a2bd-b123ff31d178 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:16:22.278736 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ea40e-deec-4ff3-a2bd-b123ff31d178 service swift] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:16:22.286864 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1185/2377] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Jun 8 12:16:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 12:16:27.182217 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864fbec-27da-4112-b5d2-33c585d07989 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:16:27.182780 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864fbec-27da-4112-b5d2-33c585d07989 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:16:27.182780 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864fbec-27da-4112-b5d2-33c585d07989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:16:27.203560 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-8864fbec-27da-4112-b5d2-33c585d07989 None None] MFA Rules not processed for user `82d697ab683546cba41c3149ea1bc231`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:16:27.207079 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-8864fbec-27da-4112-b5d2-33c585d07989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:16:27.213055 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1193/2378] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:16:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:16:32.283565 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=32 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:16:35.124641 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ea40e-deec-4ff3-a2bd-b123ff31d178 service swift] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:16:35.126043 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b44ea40e-deec-4ff3-a2bd-b123ff31d178 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:16:35.138303 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ea40e-deec-4ff3-a2bd-b123ff31d178 service swift] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:16:35.141852 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f0b43-26c6-45c3-87b4-f252c8b76501 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:16:35.142507 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f0b43-26c6-45c3-87b4-f252c8b76501 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:16:35.142789 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f0b43-26c6-45c3-87b4-f252c8b76501 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:16:35.143069 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f0b43-26c6-45c3-87b4-f252c8b76501 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:16:35.144780 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-288f0b43-26c6-45c3-87b4-f252c8b76501 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:16:35.219159 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288f0b43-26c6-45c3-87b4-f252c8b76501 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:16:35.220836 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288f0b43-26c6-45c3-87b4-f252c8b76501 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:16:35.235113 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1186/2379] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:16:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:16:35.669569 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8864fbec-27da-4112-b5d2-33c585d07989 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:16:35.680288 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8864fbec-27da-4112-b5d2-33c585d07989 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:16:35.684576 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f17141-b157-45cf-8a8a-a07909eacf93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:16:35.685473 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f17141-b157-45cf-8a8a-a07909eacf93 service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:16:35.685949 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f17141-b157-45cf-8a8a-a07909eacf93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:16:35.686421 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f17141-b157-45cf-8a8a-a07909eacf93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:16:35.692634 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-f4f17141-b157-45cf-8a8a-a07909eacf93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:16:35.710987 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f17141-b157-45cf-8a8a-a07909eacf93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:16:35.712780 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f17141-b157-45cf-8a8a-a07909eacf93 service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:16:35.725841 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1194/2380] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:16:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:16:39.083572 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35805b3-4a66-4073-a7db-9f714463de3a None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:16:39.084648 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35805b3-4a66-4073-a7db-9f714463de3a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:16:39.084738 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35805b3-4a66-4073-a7db-9f714463de3a None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:16:39.086350 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1187/2381] 10.222.0.39 () {54 vars in 921 bytes} [Wed Jun 8 12:16:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:16:39.093287 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94194cc-3f19-48d7-aaa1-7cf649f282e7 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:16:39.093748 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94194cc-3f19-48d7-aaa1-7cf649f282e7 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:16:39.093748 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94194cc-3f19-48d7-aaa1-7cf649f282e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:16:39.114657 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-e94194cc-3f19-48d7-aaa1-7cf649f282e7 None None] MFA Rules not processed for user `7ef7edb5e9ce49e6b098f48bf060b228`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:16:39.115914 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-e94194cc-3f19-48d7-aaa1-7cf649f282e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:16:39.125439 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1195/2382] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Jun 8 12:16:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:16:39.137620 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35805b3-4a66-4073-a7db-9f714463de3a None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:16:39.139309 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a35805b3-4a66-4073-a7db-9f714463de3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:16:39.198427 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35805b3-4a66-4073-a7db-9f714463de3a None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:16:39.202713 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26596f04-2e1b-4ef1-8207-52bf3d017902 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2f8b5040a048c5bf4eef36f2ecd678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:16:39.203368 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26596f04-2e1b-4ef1-8207-52bf3d017902 service glance] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:16:39.203649 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26596f04-2e1b-4ef1-8207-52bf3d017902 service glance] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:16:39.203924 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26596f04-2e1b-4ef1-8207-52bf3d017902 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:16:39.215182 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26596f04-2e1b-4ef1-8207-52bf3d017902 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:16:39.216645 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26596f04-2e1b-4ef1-8207-52bf3d017902 service glance] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:16:39.227722 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1188/2383] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:16:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 12:16:39.296037 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ea612-1f48-4561-8f2d-78b09a45c4da None None] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:16:39.296384 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ea612-1f48-4561-8f2d-78b09a45c4da None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:16:39.296666 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ea612-1f48-4561-8f2d-78b09a45c4da None None] PATH_INFO: `/` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:16:39.298050 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1196/2384] 10.222.0.39 () {54 vars in 921 bytes} [Wed Jun 8 12:16:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:16:39.302732 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d396b-5356-406c-ba9a-63876e161114 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:16:39.303152 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d396b-5356-406c-ba9a-63876e161114 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:16:39.303152 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d396b-5356-406c-ba9a-63876e161114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:16:39.340392 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-0c2d396b-5356-406c-ba9a-63876e161114 None None] MFA Rules not processed for user `2fef074aa2ea4570928109f62ea1aa96`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:16:39.341597 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-0c2d396b-5356-406c-ba9a-63876e161114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:16:39.348104 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1189/2385] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Jun 8 12:16:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:16:39.359695 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ea612-1f48-4561-8f2d-78b09a45c4da None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:16:39.370571 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ea612-1f48-4561-8f2d-78b09a45c4da None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:16:39.374035 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada7ae9-6e41-4b47-b345-c07c0f20b1b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:16:39.374663 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada7ae9-6e41-4b47-b345-c07c0f20b1b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:16:39.374949 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada7ae9-6e41-4b47-b345-c07c0f20b1b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:16:39.375217 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada7ae9-6e41-4b47-b345-c07c0f20b1b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:16:39.382710 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada7ae9-6e41-4b47-b345-c07c0f20b1b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:16:39.384124 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada7ae9-6e41-4b47-b345-c07c0f20b1b0 service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:16:39.391572 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1197/2386] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:16:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:16:39.474001 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76beae58-b8f6-49f5-8f0d-a90b673e2794 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:16:39.474297 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76beae58-b8f6-49f5-8f0d-a90b673e2794 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:16:39.474579 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76beae58-b8f6-49f5-8f0d-a90b673e2794 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:16:39.476102 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1190/2387] 10.222.0.39 () {54 vars in 921 bytes} [Wed Jun 8 12:16:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 08 12:16:39.481711 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e78a7d-6a26-4ebb-a244-610f88b6e5bf None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:16:39.482008 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e78a7d-6a26-4ebb-a244-610f88b6e5bf None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:16:39.482287 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e78a7d-6a26-4ebb-a244-610f88b6e5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:16:39.500242 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-70e78a7d-6a26-4ebb-a244-610f88b6e5bf None None] MFA Rules not processed for user `7ef7edb5e9ce49e6b098f48bf060b228`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:16:39.501431 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-70e78a7d-6a26-4ebb-a244-610f88b6e5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:16:39.511061 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1198/2388] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Jun 8 12:16:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:16:39.521158 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76beae58-b8f6-49f5-8f0d-a90b673e2794 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:16:39.532848 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76beae58-b8f6-49f5-8f0d-a90b673e2794 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:16:39.536514 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e0c0a-653b-4609-a51a-ae63983bc61c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:16:39.537245 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e0c0a-653b-4609-a51a-ae63983bc61c service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:16:39.537532 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e0c0a-653b-4609-a51a-ae63983bc61c service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:16:39.537833 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e0c0a-653b-4609-a51a-ae63983bc61c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:16:39.548351 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e0c0a-653b-4609-a51a-ae63983bc61c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:16:39.549788 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e0c0a-653b-4609-a51a-ae63983bc61c service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:16:39.562636 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1191/2389] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:16:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:16:41.413971 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2c63c-bbe4-41e9-ac0b-c15bc8653cca None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:16:41.415443 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2c63c-bbe4-41e9-ac0b-c15bc8653cca None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:16:41.415443 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2c63c-bbe4-41e9-ac0b-c15bc8653cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:16:41.432555 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-10c2c63c-bbe4-41e9-ac0b-c15bc8653cca None None] MFA Rules not processed for user `d52efc21c66d4300a8a979d92dbfeb47`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:16:41.433784 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-10c2c63c-bbe4-41e9-ac0b-c15bc8653cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:16:41.441041 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1199/2390] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Jun 8 12:16:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:16:41.454376 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e0c0a-653b-4609-a51a-ae63983bc61c service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:16:41.469185 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e0c0a-653b-4609-a51a-ae63983bc61c service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:16:41.474772 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af11d60-4789-4980-8e27-cc65e8e46156 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753bde6a72d64045abd3ad44b9b0de04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:16:41.475555 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af11d60-4789-4980-8e27-cc65e8e46156 service swift] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:16:41.476042 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af11d60-4789-4980-8e27-cc65e8e46156 service swift] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:16:41.476472 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af11d60-4789-4980-8e27-cc65e8e46156 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:16:41.487459 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af11d60-4789-4980-8e27-cc65e8e46156 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:16:41.489166 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af11d60-4789-4980-8e27-cc65e8e46156 service swift] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:16:41.497771 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1192/2391] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Jun 8 12:16:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 12:16:51.426934 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=49 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:16:51.494534 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=81 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:17:11.375491 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c2c63c-bbe4-41e9-ac0b-c15bc8653cca None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:17:11.386339 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c2c63c-bbe4-41e9-ac0b-c15bc8653cca None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:17:11.390570 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eba992-dd2e-4a99-92eb-d060af509fee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:17:11.391225 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eba992-dd2e-4a99-92eb-d060af509fee service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:17:11.391513 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eba992-dd2e-4a99-92eb-d060af509fee service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:17:11.391794 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eba992-dd2e-4a99-92eb-d060af509fee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:17:11.393594 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-f0eba992-dd2e-4a99-92eb-d060af509fee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:17:11.405100 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eba992-dd2e-4a99-92eb-d060af509fee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:17:11.406578 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eba992-dd2e-4a99-92eb-d060af509fee service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:17:11.416370 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1200/2392] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:17:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:17:21.412693 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=6 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:17:25.773620 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e837f9b3-6e08-4979-a658-0cc982828c2a None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:17:25.774808 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e837f9b3-6e08-4979-a658-0cc982828c2a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:17:25.774808 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e837f9b3-6e08-4979-a658-0cc982828c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:17:25.801642 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-e837f9b3-6e08-4979-a658-0cc982828c2a None None] MFA Rules not processed for user `d52efc21c66d4300a8a979d92dbfeb47`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:17:25.802855 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-e837f9b3-6e08-4979-a658-0cc982828c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:17:25.811371 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1193/2393] 10.222.0.39 () {58 vars in 967 bytes} [Wed Jun 8 12:17:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:17:25.832415 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eba992-dd2e-4a99-92eb-d060af509fee service neutron] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:17:25.844249 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eba992-dd2e-4a99-92eb-d060af509fee service neutron] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:17:25.849202 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a5ecc3-0eeb-44c5-a31c-97cb08b37467 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753bde6a72d64045abd3ad44b9b0de04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:17:25.849823 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5ecc3-0eeb-44c5-a31c-97cb08b37467 service swift] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:17:25.850106 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5ecc3-0eeb-44c5-a31c-97cb08b37467 service swift] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:17:25.850381 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5ecc3-0eeb-44c5-a31c-97cb08b37467 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:17:25.862835 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a5ecc3-0eeb-44c5-a31c-97cb08b37467 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:17:25.864468 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a5ecc3-0eeb-44c5-a31c-97cb08b37467 service swift] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:17:25.873758 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1201/2394] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Jun 8 12:17:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 12:17:35.796002 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:17:35.870409 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=6 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:17:40.316843 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e837f9b3-6e08-4979-a658-0cc982828c2a None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:17:40.318261 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-e837f9b3-6e08-4979-a658-0cc982828c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:17:40.330191 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e837f9b3-6e08-4979-a658-0cc982828c2a None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:17:40.333793 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8adf6ab-9600-42e5-8cfd-198c2407c7fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:17:40.334427 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8adf6ab-9600-42e5-8cfd-198c2407c7fb service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:17:40.334732 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8adf6ab-9600-42e5-8cfd-198c2407c7fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:17:40.335007 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8adf6ab-9600-42e5-8cfd-198c2407c7fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:17:40.336730 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f8adf6ab-9600-42e5-8cfd-198c2407c7fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:17:40.414859 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8adf6ab-9600-42e5-8cfd-198c2407c7fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:17:40.416323 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8adf6ab-9600-42e5-8cfd-198c2407c7fb service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:17:40.434756 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1194/2395] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:17:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 12:17:48.318511 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a5ecc3-0eeb-44c5-a31c-97cb08b37467 service swift] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:17:48.327772 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a5ecc3-0eeb-44c5-a31c-97cb08b37467 service swift] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:17:48.331309 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d47e06f-5542-451b-82d0-6d575eaf2a3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:17:48.331938 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47e06f-5542-451b-82d0-6d575eaf2a3c service cinder] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:17:48.332251 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47e06f-5542-451b-82d0-6d575eaf2a3c service cinder] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:17:48.332529 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47e06f-5542-451b-82d0-6d575eaf2a3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:17:48.334284 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-0d47e06f-5542-451b-82d0-6d575eaf2a3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:17:48.391259 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d47e06f-5542-451b-82d0-6d575eaf2a3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:17:48.392725 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d47e06f-5542-451b-82d0-6d575eaf2a3c service cinder] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:17:48.402208 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1202/2396] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:17:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:17:50.431540 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=41 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:17:58.398178 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=28 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:18:01.560511 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8adf6ab-9600-42e5-8cfd-198c2407c7fb service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:01.569974 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8adf6ab-9600-42e5-8cfd-198c2407c7fb service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:01.574054 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f933a80d-f596-4ab6-895a-3f1a441b2163 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:01.574768 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933a80d-f596-4ab6-895a-3f1a441b2163 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:01.575538 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933a80d-f596-4ab6-895a-3f1a441b2163 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:01.576274 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933a80d-f596-4ab6-895a-3f1a441b2163 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:01.578639 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f933a80d-f596-4ab6-895a-3f1a441b2163 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:01.595271 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f933a80d-f596-4ab6-895a-3f1a441b2163 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:01.596642 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f933a80d-f596-4ab6-895a-3f1a441b2163 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:01.607939 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1195/2397] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:18:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:18:04.833395 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54571254-d929-4a60-975a-662001775a7e None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:04.833894 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54571254-d929-4a60-975a-662001775a7e None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:04.834086 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54571254-d929-4a60-975a-662001775a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:04.856765 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-54571254-d929-4a60-975a-662001775a7e None None] MFA Rules not processed for user `5a2945ee4e3f4c6a91fef4978bcbfd88`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:18:04.858210 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-54571254-d929-4a60-975a-662001775a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:04.874929 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1203/2398] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:18:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:18:05.021333 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f933a80d-f596-4ab6-895a-3f1a441b2163 service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:05.024114 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f933a80d-f596-4ab6-895a-3f1a441b2163 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:05.084208 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54571254-d929-4a60-975a-662001775a7e None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:05.085630 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-54571254-d929-4a60-975a-662001775a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:05.109383 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54571254-d929-4a60-975a-662001775a7e None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:05.114910 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3746c35b-0d27-4213-a512-a2d76fd34124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:05.115452 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f933a80d-f596-4ab6-895a-3f1a441b2163 service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:05.116147 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746c35b-0d27-4213-a512-a2d76fd34124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:05.116499 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746c35b-0d27-4213-a512-a2d76fd34124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:05.116780 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746c35b-0d27-4213-a512-a2d76fd34124 admin admin] PATH_INFO: `/v3/users/f3d3e9767e814d0d995be5c660c36fc7` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:05.118064 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3746c35b-0d27-4213-a512-a2d76fd34124 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3d3e9767e814d0d995be5c660c36fc7)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:05.120299 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3746c35b-0d27-4213-a512-a2d76fd34124 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:05.122509 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa91f3-8b29-4fd3-be33-59658aaf3315 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9009560a846414b849d42efa8625ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:05.123183 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa91f3-8b29-4fd3-be33-59658aaf3315 service placement] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:05.123865 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa91f3-8b29-4fd3-be33-59658aaf3315 service placement] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:05.124155 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa91f3-8b29-4fd3-be33-59658aaf3315 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:05.126228 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-29fa91f3-8b29-4fd3-be33-59658aaf3315 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:05.142908 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fa91f3-8b29-4fd3-be33-59658aaf3315 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:05.144832 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fa91f3-8b29-4fd3-be33-59658aaf3315 service placement] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:05.160686 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1196/2399] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:18:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:18:05.182853 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-3746c35b-0d27-4213-a512-a2d76fd34124 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3d3e9767e814d0d995be5c660c36fc7'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:05.190540 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-3746c35b-0d27-4213-a512-a2d76fd34124 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3d3e9767e814d0d995be5c660c36fc7'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:05.191491 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-3746c35b-0d27-4213-a512-a2d76fd34124 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3d3e9767e814d0d995be5c660c36fc7'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:05.194255 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-3746c35b-0d27-4213-a512-a2d76fd34124 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3d3e9767e814d0d995be5c660c36fc7'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:05.219447 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-3746c35b-0d27-4213-a512-a2d76fd34124 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3d3e9767e814d0d995be5c660c36fc7'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:05.237327 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1204/2400] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:18:05 2022] DELETE /identity/v3/users/f3d3e9767e814d0d995be5c660c36fc7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:18:05.256822 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa91f3-8b29-4fd3-be33-59658aaf3315 service placement] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:05.267996 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa91f3-8b29-4fd3-be33-59658aaf3315 service placement] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:05.326723 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f18a3-49ba-49a1-a193-a4a2ef46de36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:05.327542 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f18a3-49ba-49a1-a193-a4a2ef46de36 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:05.327829 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f18a3-49ba-49a1-a193-a4a2ef46de36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:05.328111 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f18a3-49ba-49a1-a193-a4a2ef46de36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:05.329931 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ee8f18a3-49ba-49a1-a193-a4a2ef46de36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:05.340147 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8f18a3-49ba-49a1-a193-a4a2ef46de36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:05.341615 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8f18a3-49ba-49a1-a193-a4a2ef46de36 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:05.350076 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1197/2401] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:18:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:18:05.417638 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3746c35b-0d27-4213-a512-a2d76fd34124 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:05.419228 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-3746c35b-0d27-4213-a512-a2d76fd34124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:05.502652 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3746c35b-0d27-4213-a512-a2d76fd34124 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:05.507421 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4376a34-1c48-4b2f-ba40-9761057ec9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:05.508606 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4376a34-1c48-4b2f-ba40-9761057ec9a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:05.508893 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4376a34-1c48-4b2f-ba40-9761057ec9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:05.509171 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4376a34-1c48-4b2f-ba40-9761057ec9a6 admin admin] PATH_INFO: `/v3/projects/bf5c685a584b4312b641f90787527f6a` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:05.510906 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4376a34-1c48-4b2f-ba40-9761057ec9a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf5c685a584b4312b641f90787527f6a)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:05.512958 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4376a34-1c48-4b2f-ba40-9761057ec9a6 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:05.561018 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-a4376a34-1c48-4b2f-ba40-9761057ec9a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf5c685a584b4312b641f90787527f6a', 'request_id': 'req-a4376a34-1c48-4b2f-ba40-9761057ec9a6'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:05.569269 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-a4376a34-1c48-4b2f-ba40-9761057ec9a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf5c685a584b4312b641f90787527f6a', 'request_id': 'req-a4376a34-1c48-4b2f-ba40-9761057ec9a6'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:05.576192 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-a4376a34-1c48-4b2f-ba40-9761057ec9a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf5c685a584b4312b641f90787527f6a', 'request_id': 'req-a4376a34-1c48-4b2f-ba40-9761057ec9a6'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:05.578829 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:18:05.592451 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-a4376a34-1c48-4b2f-ba40-9761057ec9a6 admin admin] The token cache is being invalidate because project bf5c685a584b4312b641f90787527f6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:18:05.592746 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-a4376a34-1c48-4b2f-ba40-9761057ec9a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:05.593398 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-a4376a34-1c48-4b2f-ba40-9761057ec9a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:05.595289 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1205/2402] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:18:05 2022] DELETE /identity/v3/projects/bf5c685a584b4312b641f90787527f6a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:18:05.599928 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8f921-5cee-4221-9ba8-40174abb7fb2 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:05.600253 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8f921-5cee-4221-9ba8-40174abb7fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:05.600565 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8f921-5cee-4221-9ba8-40174abb7fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:05.619825 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-57f8f921-5cee-4221-9ba8-40174abb7fb2 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:18:05.621246 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-57f8f921-5cee-4221-9ba8-40174abb7fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:05.683912 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1198/2403] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:18:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:18:05.694431 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170bd58-f000-475c-8fb3-04df6d5b57ac None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:05.694877 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170bd58-f000-475c-8fb3-04df6d5b57ac None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:05.695202 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170bd58-f000-475c-8fb3-04df6d5b57ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:05.716483 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-d170bd58-f000-475c-8fb3-04df6d5b57ac None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:18:05.717687 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-d170bd58-f000-475c-8fb3-04df6d5b57ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:05.726175 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1206/2404] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:18:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:18:05.731263 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8f921-5cee-4221-9ba8-40174abb7fb2 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:05.741099 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8f921-5cee-4221-9ba8-40174abb7fb2 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:05.747283 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60df7cf2-3509-4228-8e85-8aaece9f534b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:05.747970 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df7cf2-3509-4228-8e85-8aaece9f534b admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:05.748272 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df7cf2-3509-4228-8e85-8aaece9f534b admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:05.748552 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df7cf2-3509-4228-8e85-8aaece9f534b admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:05.749279 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60df7cf2-3509-4228-8e85-8aaece9f534b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:18:05.749874 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60df7cf2-3509-4228-8e85-8aaece9f534b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:05.752521 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60df7cf2-3509-4228-8e85-8aaece9f534b admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:05.769126 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1199/2405] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:18:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:18:05.770522 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d170bd58-f000-475c-8fb3-04df6d5b57ac None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:05.785817 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d170bd58-f000-475c-8fb3-04df6d5b57ac None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:05.802043 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ef815-0124-41a8-b397-c8010b82b5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:05.803067 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ef815-0124-41a8-b397-c8010b82b5a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:05.803933 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ef815-0124-41a8-b397-c8010b82b5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:05.803933 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ef815-0124-41a8-b397-c8010b82b5a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:05.804377 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ef815-0124-41a8-b397-c8010b82b5a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:05.806571 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ef815-0124-41a8-b397-c8010b82b5a4 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:05.809837 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60df7cf2-3509-4228-8e85-8aaece9f534b admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:05.811534 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-60df7cf2-3509-4228-8e85-8aaece9f534b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:05.823157 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:18:05.838340 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1207/2406] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:18:05 2022] POST /identity/v3/projects => generated 365 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 12:18:05.841746 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ef815-0124-41a8-b397-c8010b82b5a4 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:05.893849 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60df7cf2-3509-4228-8e85-8aaece9f534b admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:05.905325 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ef815-0124-41a8-b397-c8010b82b5a4 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:05.909958 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c764215-e499-4878-b605-7b110ec19b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:05.910630 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c764215-e499-4878-b605-7b110ec19b86 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:05.910912 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c764215-e499-4878-b605-7b110ec19b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:05.911194 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c764215-e499-4878-b605-7b110ec19b86 admin admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:05.911875 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c764215-e499-4878-b605-7b110ec19b86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:05.913863 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c764215-e499-4878-b605-7b110ec19b86 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:05.936976 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1208/2407] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:18:05 2022] POST /identity/v3/users => generated 283 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 12:18:05.938008 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c764215-e499-4878-b605-7b110ec19b86 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:05.947262 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c764215-e499-4878-b605-7b110ec19b86 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:05.952847 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc16902-a634-42b0-bc04-796fbfaabcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:05.953491 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc16902-a634-42b0-bc04-796fbfaabcdb admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:05.953780 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc16902-a634-42b0-bc04-796fbfaabcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:05.954053 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc16902-a634-42b0-bc04-796fbfaabcdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:05.954646 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a6cf9-0f07-4535-92ca-73e7b614d952 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9009560a846414b849d42efa8625ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:05.954786 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc16902-a634-42b0-bc04-796fbfaabcdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:05.955306 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a6cf9-0f07-4535-92ca-73e7b614d952 service placement] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:05.955593 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a6cf9-0f07-4535-92ca-73e7b614d952 service placement] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:05.955872 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a6cf9-0f07-4535-92ca-73e7b614d952 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:05.956373 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc16902-a634-42b0-bc04-796fbfaabcdb admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:05.957777 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-921a6cf9-0f07-4535-92ca-73e7b614d952 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:05.967096 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1209/2408] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:18:05.970172 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921a6cf9-0f07-4535-92ca-73e7b614d952 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:05.971012 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc16902-a634-42b0-bc04-796fbfaabcdb admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:05.971499 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921a6cf9-0f07-4535-92ca-73e7b614d952 service placement] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:05.982431 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc16902-a634-42b0-bc04-796fbfaabcdb admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:05.983234 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1200/2409] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:18:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 12:18:05.987856 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c06926f-9cc8-4684-b56b-d851c03db3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:05.987856 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06926f-9cc8-4684-b56b-d851c03db3db admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:05.988101 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06926f-9cc8-4684-b56b-d851c03db3db admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:05.988425 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06926f-9cc8-4684-b56b-d851c03db3db admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:05.989147 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c06926f-9cc8-4684-b56b-d851c03db3db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:05.990771 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c06926f-9cc8-4684-b56b-d851c03db3db admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:06.002950 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1210/2410] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 12:18:06.007334 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a6cf9-0f07-4535-92ca-73e7b614d952 service placement] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:06.018405 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a6cf9-0f07-4535-92ca-73e7b614d952 service placement] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:06.024452 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e7dd3-7209-44e8-be42-9cf6b06ba491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:06.025973 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e7dd3-7209-44e8-be42-9cf6b06ba491 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:06.026082 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e7dd3-7209-44e8-be42-9cf6b06ba491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:06.026471 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e7dd3-7209-44e8-be42-9cf6b06ba491 admin admin] PATH_INFO: `/v3/projects/f06b3040ff3f417e956469a5450a32ab/users/06909ccf23e14236af0e063e9a720993/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:06.043191 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61e7dd3-7209-44e8-be42-9cf6b06ba491 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f06b3040ff3f417e956469a5450a32ab, user_id=06909ccf23e14236af0e063e9a720993, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:06.046069 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61e7dd3-7209-44e8-be42-9cf6b06ba491 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:06.073906 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1201/2411] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:18:06 2022] PUT /identity/v3/projects/f06b3040ff3f417e956469a5450a32ab/users/06909ccf23e14236af0e063e9a720993/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:18:06.075180 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4136364-3698-4699-a096-0428b993e648 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:06.075389 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4136364-3698-4699-a096-0428b993e648 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:06.075671 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4136364-3698-4699-a096-0428b993e648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:06.106542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-d4136364-3698-4699-a096-0428b993e648 None None] MFA Rules not processed for user `06909ccf23e14236af0e063e9a720993`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:18:06.107805 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-d4136364-3698-4699-a096-0428b993e648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:06.179495 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1211/2412] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:18:06 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:18:06.184362 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e7dd3-7209-44e8-be42-9cf6b06ba491 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:06.252927 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e7dd3-7209-44e8-be42-9cf6b06ba491 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:06.258840 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573cc944-134b-4d8f-9e62-d183b578d91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:06.259537 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573cc944-134b-4d8f-9e62-d183b578d91b admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:06.259905 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573cc944-134b-4d8f-9e62-d183b578d91b admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:06.260324 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573cc944-134b-4d8f-9e62-d183b578d91b admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:06.261128 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573cc944-134b-4d8f-9e62-d183b578d91b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:06.263051 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573cc944-134b-4d8f-9e62-d183b578d91b admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:06.284340 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:18:06.295298 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1202/2413] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:18:06 2022] POST /identity/v3/projects => generated 365 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:18:06.296909 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4136364-3698-4699-a096-0428b993e648 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:06.309019 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4136364-3698-4699-a096-0428b993e648 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:06.330767 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:18:06.372100 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086003b-29d8-4cb7-ae86-cd4541aa7db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:06.372816 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086003b-29d8-4cb7-ae86-cd4541aa7db9 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:06.373121 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086003b-29d8-4cb7-ae86-cd4541aa7db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:06.373412 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086003b-29d8-4cb7-ae86-cd4541aa7db9 admin admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:06.374106 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7086003b-29d8-4cb7-ae86-cd4541aa7db9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:06.376018 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7086003b-29d8-4cb7-ae86-cd4541aa7db9 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:06.398395 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1212/2414] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:18:06 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:18:06.403411 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573cc944-134b-4d8f-9e62-d183b578d91b admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:06.413944 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573cc944-134b-4d8f-9e62-d183b578d91b admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:06.419670 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe473930-22c3-406e-a484-4cc76a478435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:06.420454 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe473930-22c3-406e-a484-4cc76a478435 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:06.420858 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe473930-22c3-406e-a484-4cc76a478435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:06.421147 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe473930-22c3-406e-a484-4cc76a478435 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:06.421882 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe473930-22c3-406e-a484-4cc76a478435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:06.423538 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe473930-22c3-406e-a484-4cc76a478435 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:06.437843 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1203/2415] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:18:06.442144 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086003b-29d8-4cb7-ae86-cd4541aa7db9 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:06.452880 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086003b-29d8-4cb7-ae86-cd4541aa7db9 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:06.458939 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29cee6-fcca-42a2-a0c7-8d53510bb5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:06.460375 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29cee6-fcca-42a2-a0c7-8d53510bb5dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:06.460670 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29cee6-fcca-42a2-a0c7-8d53510bb5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:06.460949 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29cee6-fcca-42a2-a0c7-8d53510bb5dc admin admin] PATH_INFO: `/v3/projects/411809b320ca4a0d9968243da1a65680/users/3ecd642ad02744c88bb11e7317348020/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:06.480398 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd29cee6-fcca-42a2-a0c7-8d53510bb5dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=411809b320ca4a0d9968243da1a65680, user_id=3ecd642ad02744c88bb11e7317348020, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:06.483143 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd29cee6-fcca-42a2-a0c7-8d53510bb5dc admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:06.497815 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1213/2416] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:18:06 2022] PUT /identity/v3/projects/411809b320ca4a0d9968243da1a65680/users/3ecd642ad02744c88bb11e7317348020/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:18:06.501757 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe473930-22c3-406e-a484-4cc76a478435 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:06.512398 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe473930-22c3-406e-a484-4cc76a478435 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:06.576478 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7eff90-be41-4d4e-bd8e-3fd6e7d665cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:06.577079 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7eff90-be41-4d4e-bd8e-3fd6e7d665cf admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:06.577400 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7eff90-be41-4d4e-bd8e-3fd6e7d665cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:06.579830 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7eff90-be41-4d4e-bd8e-3fd6e7d665cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:06.581108 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7eff90-be41-4d4e-bd8e-3fd6e7d665cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:06.583028 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7eff90-be41-4d4e-bd8e-3fd6e7d665cf admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:06.597740 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1204/2417] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:18:06.602681 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29cee6-fcca-42a2-a0c7-8d53510bb5dc admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:06.614083 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29cee6-fcca-42a2-a0c7-8d53510bb5dc admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:06.618857 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8be479-c869-4728-a677-a3a0cd0f990b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:06.620586 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8be479-c869-4728-a677-a3a0cd0f990b admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:06.620872 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8be479-c869-4728-a677-a3a0cd0f990b admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:06.621153 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8be479-c869-4728-a677-a3a0cd0f990b admin admin] PATH_INFO: `/v3/projects/411809b320ca4a0d9968243da1a65680/users/3ecd642ad02744c88bb11e7317348020/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:06.623177 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8be479-c869-4728-a677-a3a0cd0f990b admin admin] RBAC: Authorizing `identity:create_grant(project_id=411809b320ca4a0d9968243da1a65680, user_id=3ecd642ad02744c88bb11e7317348020, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:06.625863 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8be479-c869-4728-a677-a3a0cd0f990b admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:06.637289 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1214/2418] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:18:06 2022] PUT /identity/v3/projects/411809b320ca4a0d9968243da1a65680/users/3ecd642ad02744c88bb11e7317348020/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:18:06.648602 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4db8fb-ea97-4fd0-8b1c-3407e9d57be1 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:06.648897 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4db8fb-ea97-4fd0-8b1c-3407e9d57be1 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:06.649176 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4db8fb-ea97-4fd0-8b1c-3407e9d57be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:06.676561 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-8a4db8fb-ea97-4fd0-8b1c-3407e9d57be1 None None] MFA Rules not processed for user `3ecd642ad02744c88bb11e7317348020`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:18:06.677796 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-8a4db8fb-ea97-4fd0-8b1c-3407e9d57be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:06.746250 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1205/2419] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:18:06 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:18:06.757270 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8be479-c869-4728-a677-a3a0cd0f990b admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:06.758955 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-8e8be479-c869-4728-a677-a3a0cd0f990b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:06.816193 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8be479-c869-4728-a677-a3a0cd0f990b admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:06.819793 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d491645-b517-4a44-9d35-b695b8d9e5ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:06.820455 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d491645-b517-4a44-9d35-b695b8d9e5ca service cinder] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:06.820738 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d491645-b517-4a44-9d35-b695b8d9e5ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:06.821015 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d491645-b517-4a44-9d35-b695b8d9e5ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:06.830767 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d491645-b517-4a44-9d35-b695b8d9e5ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:06.832414 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d491645-b517-4a44-9d35-b695b8d9e5ca service cinder] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:06.843092 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1215/2420] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:18:06 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:18:07.359543 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4db8fb-ea97-4fd0-8b1c-3407e9d57be1 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:07.424624 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4db8fb-ea97-4fd0-8b1c-3407e9d57be1 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:07.429160 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bbc169-aba9-4a76-91bc-ee1786c44334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:07.430036 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbc169-aba9-4a76-91bc-ee1786c44334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:07.430327 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbc169-aba9-4a76-91bc-ee1786c44334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:07.430612 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbc169-aba9-4a76-91bc-ee1786c44334 admin admin] PATH_INFO: `/v3/users/06909ccf23e14236af0e063e9a720993` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:07.432417 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bbc169-aba9-4a76-91bc-ee1786c44334 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06909ccf23e14236af0e063e9a720993)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:07.435372 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bbc169-aba9-4a76-91bc-ee1786c44334 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:07.448951 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:18:07.490268 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a9bbc169-aba9-4a76-91bc-ee1786c44334 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06909ccf23e14236af0e063e9a720993'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:07.490925 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a9bbc169-aba9-4a76-91bc-ee1786c44334 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06909ccf23e14236af0e063e9a720993'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:07.491527 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a9bbc169-aba9-4a76-91bc-ee1786c44334 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06909ccf23e14236af0e063e9a720993'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:07.500450 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a9bbc169-aba9-4a76-91bc-ee1786c44334 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06909ccf23e14236af0e063e9a720993'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:07.515415 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a9bbc169-aba9-4a76-91bc-ee1786c44334 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06909ccf23e14236af0e063e9a720993'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:07.531406 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1206/2421] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:18:07 2022] DELETE /identity/v3/users/06909ccf23e14236af0e063e9a720993 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:18:07.536472 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c32b4-8ba2-4561-b8c8-d1af03d781c2 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:07.536768 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c32b4-8ba2-4561-b8c8-d1af03d781c2 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:07.537053 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c32b4-8ba2-4561-b8c8-d1af03d781c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:07.556593 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-733c32b4-8ba2-4561-b8c8-d1af03d781c2 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:18:07.558485 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-733c32b4-8ba2-4561-b8c8-d1af03d781c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:07.657547 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1216/2422] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:18:07.669735 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bbc169-aba9-4a76-91bc-ee1786c44334 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:07.671540 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a9bbc169-aba9-4a76-91bc-ee1786c44334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:07.761554 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bbc169-aba9-4a76-91bc-ee1786c44334 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:07.769055 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b213f5-524b-400e-b46a-d381dd23ecea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:07.770032 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b213f5-524b-400e-b46a-d381dd23ecea service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:07.770505 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b213f5-524b-400e-b46a-d381dd23ecea service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:07.770888 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b213f5-524b-400e-b46a-d381dd23ecea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:07.786287 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b213f5-524b-400e-b46a-d381dd23ecea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:07.787905 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b213f5-524b-400e-b46a-d381dd23ecea service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:07.803173 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1207/2423] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:18:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:18:08.185111 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c32b4-8ba2-4561-b8c8-d1af03d781c2 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:08.186560 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-733c32b4-8ba2-4561-b8c8-d1af03d781c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:08.208363 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c32b4-8ba2-4561-b8c8-d1af03d781c2 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:08.224074 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a061b8b9-5e07-48ff-a342-7de8dfb48625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:08.226024 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061b8b9-5e07-48ff-a342-7de8dfb48625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:08.226582 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061b8b9-5e07-48ff-a342-7de8dfb48625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:08.227126 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061b8b9-5e07-48ff-a342-7de8dfb48625 admin admin] PATH_INFO: `/v3/projects/f06b3040ff3f417e956469a5450a32ab` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:08.230107 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a061b8b9-5e07-48ff-a342-7de8dfb48625 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f06b3040ff3f417e956469a5450a32ab)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:08.232749 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a061b8b9-5e07-48ff-a342-7de8dfb48625 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:08.253276 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:18:08.293914 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-a061b8b9-5e07-48ff-a342-7de8dfb48625 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f06b3040ff3f417e956469a5450a32ab', 'request_id': 'req-a061b8b9-5e07-48ff-a342-7de8dfb48625'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:08.304641 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-a061b8b9-5e07-48ff-a342-7de8dfb48625 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f06b3040ff3f417e956469a5450a32ab', 'request_id': 'req-a061b8b9-5e07-48ff-a342-7de8dfb48625'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:08.313443 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-a061b8b9-5e07-48ff-a342-7de8dfb48625 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f06b3040ff3f417e956469a5450a32ab', 'request_id': 'req-a061b8b9-5e07-48ff-a342-7de8dfb48625'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:08.332559 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-a061b8b9-5e07-48ff-a342-7de8dfb48625 admin admin] The token cache is being invalidate because project f06b3040ff3f417e956469a5450a32ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:18:08.332559 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-a061b8b9-5e07-48ff-a342-7de8dfb48625 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:08.332559 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-a061b8b9-5e07-48ff-a342-7de8dfb48625 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:08.332559 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1217/2424] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:18:08 2022] DELETE /identity/v3/projects/f06b3040ff3f417e956469a5450a32ab => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:18:08.334233 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b213f5-524b-400e-b46a-d381dd23ecea service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:08.363074 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b213f5-524b-400e-b46a-d381dd23ecea service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:08.466183 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fcac9b-e816-43c2-9f44-cc9e488f88d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:08.467200 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fcac9b-e816-43c2-9f44-cc9e488f88d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:08.467595 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fcac9b-e816-43c2-9f44-cc9e488f88d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:08.467959 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fcac9b-e816-43c2-9f44-cc9e488f88d5 admin admin] PATH_INFO: `/v3/users/3ecd642ad02744c88bb11e7317348020` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:08.470079 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fcac9b-e816-43c2-9f44-cc9e488f88d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ecd642ad02744c88bb11e7317348020)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:08.473672 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fcac9b-e816-43c2-9f44-cc9e488f88d5 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:08.527663 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:18:08.543765 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-26fcac9b-e816-43c2-9f44-cc9e488f88d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ecd642ad02744c88bb11e7317348020'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:08.544567 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-26fcac9b-e816-43c2-9f44-cc9e488f88d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ecd642ad02744c88bb11e7317348020'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:08.545344 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-26fcac9b-e816-43c2-9f44-cc9e488f88d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ecd642ad02744c88bb11e7317348020'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:08.555490 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-26fcac9b-e816-43c2-9f44-cc9e488f88d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ecd642ad02744c88bb11e7317348020'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:08.576432 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-26fcac9b-e816-43c2-9f44-cc9e488f88d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ecd642ad02744c88bb11e7317348020'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:08.598058 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1208/2425] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:18:08 2022] DELETE /identity/v3/users/3ecd642ad02744c88bb11e7317348020 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:18:08.624113 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a061b8b9-5e07-48ff-a342-7de8dfb48625 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:08.626140 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-a061b8b9-5e07-48ff-a342-7de8dfb48625 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:08.787054 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a061b8b9-5e07-48ff-a342-7de8dfb48625 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:08.864709 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4acf2-8114-44bd-be72-16c53f33306e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef7edb5e9ce49e6b098f48bf060b228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:08.865396 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4acf2-8114-44bd-be72-16c53f33306e service nova] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:08.865680 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4acf2-8114-44bd-be72-16c53f33306e service nova] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:08.865958 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4acf2-8114-44bd-be72-16c53f33306e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:08.868964 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-44e4acf2-8114-44bd-be72-16c53f33306e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:08.889228 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e4acf2-8114-44bd-be72-16c53f33306e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:08.891040 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e4acf2-8114-44bd-be72-16c53f33306e service nova] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:08.904605 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1218/2426] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:18:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:18:09.079212 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fcac9b-e816-43c2-9f44-cc9e488f88d5 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:09.080732 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-26fcac9b-e816-43c2-9f44-cc9e488f88d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:09.149591 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fcac9b-e816-43c2-9f44-cc9e488f88d5 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:09.155665 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e68168-de29-4f60-a567-09aca01d0b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:09.156769 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e68168-de29-4f60-a567-09aca01d0b69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:09.157056 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e68168-de29-4f60-a567-09aca01d0b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:09.157448 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e68168-de29-4f60-a567-09aca01d0b69 admin admin] PATH_INFO: `/v3/projects/411809b320ca4a0d9968243da1a65680` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:09.158532 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e68168-de29-4f60-a567-09aca01d0b69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=411809b320ca4a0d9968243da1a65680)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:09.160568 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e68168-de29-4f60-a567-09aca01d0b69 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:09.210642 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d3e68168-de29-4f60-a567-09aca01d0b69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '411809b320ca4a0d9968243da1a65680', 'request_id': 'req-d3e68168-de29-4f60-a567-09aca01d0b69'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:09.219416 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d3e68168-de29-4f60-a567-09aca01d0b69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '411809b320ca4a0d9968243da1a65680', 'request_id': 'req-d3e68168-de29-4f60-a567-09aca01d0b69'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:09.225193 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d3e68168-de29-4f60-a567-09aca01d0b69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '411809b320ca4a0d9968243da1a65680', 'request_id': 'req-d3e68168-de29-4f60-a567-09aca01d0b69'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:09.237874 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d3e68168-de29-4f60-a567-09aca01d0b69 admin admin] The token cache is being invalidate because project 411809b320ca4a0d9968243da1a65680 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:18:09.238267 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d3e68168-de29-4f60-a567-09aca01d0b69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:09.239008 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d3e68168-de29-4f60-a567-09aca01d0b69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:09.240754 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1209/2427] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:18:09 2022] DELETE /identity/v3/projects/411809b320ca4a0d9968243da1a65680 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:18:09.246601 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804102ce-ff21-415d-9174-6a05da8a56ab None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:09.247084 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804102ce-ff21-415d-9174-6a05da8a56ab None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:09.247318 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804102ce-ff21-415d-9174-6a05da8a56ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:09.265531 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-804102ce-ff21-415d-9174-6a05da8a56ab None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:18:09.266831 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-804102ce-ff21-415d-9174-6a05da8a56ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:09.288607 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:18:09.330518 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1219/2428] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:18:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:18:09.338347 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b51a9e-ac65-40f3-962d-c92f6c45f724 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:09.338642 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b51a9e-ac65-40f3-962d-c92f6c45f724 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:09.338918 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b51a9e-ac65-40f3-962d-c92f6c45f724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:09.357747 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-29b51a9e-ac65-40f3-962d-c92f6c45f724 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:18:09.358959 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-29b51a9e-ac65-40f3-962d-c92f6c45f724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:09.366933 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1210/2429] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:18:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:18:09.371865 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804102ce-ff21-415d-9174-6a05da8a56ab None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:09.382184 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804102ce-ff21-415d-9174-6a05da8a56ab None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:09.386822 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09645a76-8153-4272-afca-8fa4a505d4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:09.387486 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09645a76-8153-4272-afca-8fa4a505d4ff admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:09.387826 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09645a76-8153-4272-afca-8fa4a505d4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:09.388106 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09645a76-8153-4272-afca-8fa4a505d4ff admin admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:09.388863 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09645a76-8153-4272-afca-8fa4a505d4ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:18:09.389171 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09645a76-8153-4272-afca-8fa4a505d4ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:09.390804 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09645a76-8153-4272-afca-8fa4a505d4ff admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:09.403316 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1220/2430] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:18:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:18:09.407537 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b51a9e-ac65-40f3-962d-c92f6c45f724 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:09.417659 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b51a9e-ac65-40f3-962d-c92f6c45f724 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:09.422333 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda6734-97c9-4610-8cb2-cee593faa817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:09.422988 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda6734-97c9-4610-8cb2-cee593faa817 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:09.423273 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda6734-97c9-4610-8cb2-cee593faa817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:09.423551 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda6734-97c9-4610-8cb2-cee593faa817 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:09.424269 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fda6734-97c9-4610-8cb2-cee593faa817 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:09.426164 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fda6734-97c9-4610-8cb2-cee593faa817 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:09.451398 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1211/2431] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:18:09 2022] POST /identity/v3/projects => generated 365 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:18:09.455351 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09645a76-8153-4272-afca-8fa4a505d4ff admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:09.466237 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09645a76-8153-4272-afca-8fa4a505d4ff admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:09.524309 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83adf478-4440-4aca-ba96-50e957fe01ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:09.525115 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83adf478-4440-4aca-ba96-50e957fe01ed admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:09.525983 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83adf478-4440-4aca-ba96-50e957fe01ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:09.526684 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83adf478-4440-4aca-ba96-50e957fe01ed admin admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:09.527181 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83adf478-4440-4aca-ba96-50e957fe01ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:09.529113 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83adf478-4440-4aca-ba96-50e957fe01ed admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:09.550568 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1221/2432] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:18:09 2022] POST /identity/v3/users => generated 283 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:18:09.554981 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda6734-97c9-4610-8cb2-cee593faa817 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:09.565513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda6734-97c9-4610-8cb2-cee593faa817 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:09.570107 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc96dc3e-efc9-4b3a-b84c-29c933638608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:09.570768 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96dc3e-efc9-4b3a-b84c-29c933638608 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:09.571051 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96dc3e-efc9-4b3a-b84c-29c933638608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:09.571335 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96dc3e-efc9-4b3a-b84c-29c933638608 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:09.572062 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc96dc3e-efc9-4b3a-b84c-29c933638608 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:09.573874 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc96dc3e-efc9-4b3a-b84c-29c933638608 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:09.589041 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1212/2433] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:18:09.593081 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83adf478-4440-4aca-ba96-50e957fe01ed admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:09.604822 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83adf478-4440-4aca-ba96-50e957fe01ed admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:09.609525 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed82155-c69b-4884-8051-76bc1766bb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:09.610189 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed82155-c69b-4884-8051-76bc1766bb9f admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:09.610477 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed82155-c69b-4884-8051-76bc1766bb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:09.610754 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed82155-c69b-4884-8051-76bc1766bb9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:09.611471 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed82155-c69b-4884-8051-76bc1766bb9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:09.613104 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed82155-c69b-4884-8051-76bc1766bb9f admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:09.623577 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1222/2434] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:18:09.627647 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc96dc3e-efc9-4b3a-b84c-29c933638608 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:09.632871 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:18:09.639782 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc96dc3e-efc9-4b3a-b84c-29c933638608 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:09.645534 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f61ad-a0f1-4003-9610-904b48c25033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:09.646409 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f61ad-a0f1-4003-9610-904b48c25033 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:09.646692 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f61ad-a0f1-4003-9610-904b48c25033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:09.646966 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f61ad-a0f1-4003-9610-904b48c25033 admin admin] PATH_INFO: `/v3/projects/1bab5c0ac4234e59ac57f255e4588b51/users/2f604dec1d564c8c83c6146fbeec62f4/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:09.662086 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0f61ad-a0f1-4003-9610-904b48c25033 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bab5c0ac4234e59ac57f255e4588b51, user_id=2f604dec1d564c8c83c6146fbeec62f4, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:09.664759 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0f61ad-a0f1-4003-9610-904b48c25033 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:09.678196 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1213/2435] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:18:09 2022] PUT /identity/v3/projects/1bab5c0ac4234e59ac57f255e4588b51/users/2f604dec1d564c8c83c6146fbeec62f4/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:18:09.688978 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d69e2-c6ab-4359-8e43-ef9cbabcab5c None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:09.689321 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d69e2-c6ab-4359-8e43-ef9cbabcab5c None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:09.689616 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d69e2-c6ab-4359-8e43-ef9cbabcab5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:09.718073 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-af6d69e2-c6ab-4359-8e43-ef9cbabcab5c None None] MFA Rules not processed for user `2f604dec1d564c8c83c6146fbeec62f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:18:09.719327 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-af6d69e2-c6ab-4359-8e43-ef9cbabcab5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:09.786236 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1223/2436] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:18:09 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:18:09.792281 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f61ad-a0f1-4003-9610-904b48c25033 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:09.855663 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f61ad-a0f1-4003-9610-904b48c25033 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:09.860329 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36770f-46b6-423c-a97e-4e44a9afd87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:09.860992 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36770f-46b6-423c-a97e-4e44a9afd87e admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:09.861280 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36770f-46b6-423c-a97e-4e44a9afd87e admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:09.861574 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36770f-46b6-423c-a97e-4e44a9afd87e admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:09.862256 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce36770f-46b6-423c-a97e-4e44a9afd87e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:09.864189 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce36770f-46b6-423c-a97e-4e44a9afd87e admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:09.888644 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1214/2437] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:18:09 2022] POST /identity/v3/projects => generated 365 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 12:18:09.892765 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d69e2-c6ab-4359-8e43-ef9cbabcab5c None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:09.904611 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d69e2-c6ab-4359-8e43-ef9cbabcab5c None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:09.922785 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:18:09.962420 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74abfe2b-f2ab-4769-8825-842d7b34259b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:09.963752 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74abfe2b-f2ab-4769-8825-842d7b34259b admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:09.964035 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74abfe2b-f2ab-4769-8825-842d7b34259b admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:09.964339 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74abfe2b-f2ab-4769-8825-842d7b34259b admin admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:09.965034 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74abfe2b-f2ab-4769-8825-842d7b34259b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:09.966967 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74abfe2b-f2ab-4769-8825-842d7b34259b admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:09.986633 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1224/2438] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:18:09 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 12:18:09.990670 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36770f-46b6-423c-a97e-4e44a9afd87e admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:10.000902 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36770f-46b6-423c-a97e-4e44a9afd87e admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:10.005437 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae02f5b-f76f-455c-9192-b1d1641afb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:10.006089 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae02f5b-f76f-455c-9192-b1d1641afb5f admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:10.006369 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae02f5b-f76f-455c-9192-b1d1641afb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:10.006640 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae02f5b-f76f-455c-9192-b1d1641afb5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:10.007352 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae02f5b-f76f-455c-9192-b1d1641afb5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:10.008972 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae02f5b-f76f-455c-9192-b1d1641afb5f admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:10.019776 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1215/2439] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:18:10.023664 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74abfe2b-f2ab-4769-8825-842d7b34259b admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:10.033995 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74abfe2b-f2ab-4769-8825-842d7b34259b admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:10.038516 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c8ba3-bada-4d03-bfd4-6309ac190365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:10.039384 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c8ba3-bada-4d03-bfd4-6309ac190365 admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:10.039666 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c8ba3-bada-4d03-bfd4-6309ac190365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:10.039939 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c8ba3-bada-4d03-bfd4-6309ac190365 admin admin] PATH_INFO: `/v3/projects/cb1a459da5e64768b20a8558d2c07081/users/f429cc950576400ea489797aad9ac1a7/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:10.054653 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819c8ba3-bada-4d03-bfd4-6309ac190365 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb1a459da5e64768b20a8558d2c07081, user_id=f429cc950576400ea489797aad9ac1a7, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:10.057407 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819c8ba3-bada-4d03-bfd4-6309ac190365 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:10.069655 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1225/2440] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:18:10 2022] PUT /identity/v3/projects/cb1a459da5e64768b20a8558d2c07081/users/f429cc950576400ea489797aad9ac1a7/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:18:10.074114 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae02f5b-f76f-455c-9192-b1d1641afb5f admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:10.084007 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae02f5b-f76f-455c-9192-b1d1641afb5f admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:10.141725 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87729c96-047a-4346-b12d-3537cd976805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:10.142427 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87729c96-047a-4346-b12d-3537cd976805 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:10.142719 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87729c96-047a-4346-b12d-3537cd976805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:10.143000 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87729c96-047a-4346-b12d-3537cd976805 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:10.143722 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87729c96-047a-4346-b12d-3537cd976805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:10.145380 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87729c96-047a-4346-b12d-3537cd976805 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:10.155825 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1216/2441] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:18:10 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:18:10.159933 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c8ba3-bada-4d03-bfd4-6309ac190365 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:10.172642 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c8ba3-bada-4d03-bfd4-6309ac190365 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:10.177337 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f2442-73b7-4113-88a4-fab7d5db4daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:10.178229 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f2442-73b7-4113-88a4-fab7d5db4daf admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:10.178543 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f2442-73b7-4113-88a4-fab7d5db4daf admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:10.178823 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f2442-73b7-4113-88a4-fab7d5db4daf admin admin] PATH_INFO: `/v3/projects/cb1a459da5e64768b20a8558d2c07081/users/f429cc950576400ea489797aad9ac1a7/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:10.180797 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f2442-73b7-4113-88a4-fab7d5db4daf admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb1a459da5e64768b20a8558d2c07081, user_id=f429cc950576400ea489797aad9ac1a7, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:10.184053 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f2442-73b7-4113-88a4-fab7d5db4daf admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:10.194364 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1226/2442] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:18:10 2022] PUT /identity/v3/projects/cb1a459da5e64768b20a8558d2c07081/users/f429cc950576400ea489797aad9ac1a7/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:18:10.206478 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0a295-4757-46fd-979f-2b048985b96b None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:10.206772 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0a295-4757-46fd-979f-2b048985b96b None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:10.207051 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0a295-4757-46fd-979f-2b048985b96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:10.232829 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-83b0a295-4757-46fd-979f-2b048985b96b None None] MFA Rules not processed for user `f429cc950576400ea489797aad9ac1a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:18:10.234014 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-83b0a295-4757-46fd-979f-2b048985b96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:10.272248 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:18:10.302438 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1217/2443] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:18:10 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:18:10.314411 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f2442-73b7-4113-88a4-fab7d5db4daf admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:10.316127 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-e73f2442-73b7-4113-88a4-fab7d5db4daf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:10.376842 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f2442-73b7-4113-88a4-fab7d5db4daf admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:10.380496 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2814886-280d-435c-8d28-0fa6d2bfa9fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:10.381148 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2814886-280d-435c-8d28-0fa6d2bfa9fd service cinder] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:10.381434 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2814886-280d-435c-8d28-0fa6d2bfa9fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:10.381718 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2814886-280d-435c-8d28-0fa6d2bfa9fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:10.391538 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2814886-280d-435c-8d28-0fa6d2bfa9fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:10.393021 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2814886-280d-435c-8d28-0fa6d2bfa9fd service cinder] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:10.402681 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1227/2444] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:18:10 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:18:10.482612 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b0a295-4757-46fd-979f-2b048985b96b None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:10.493624 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b0a295-4757-46fd-979f-2b048985b96b None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:10.498443 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70086f92-ad6e-48aa-81b2-407b4d230ef0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:10.499343 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70086f92-ad6e-48aa-81b2-407b4d230ef0 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:10.499798 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70086f92-ad6e-48aa-81b2-407b4d230ef0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:10.500277 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70086f92-ad6e-48aa-81b2-407b4d230ef0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:10.571055 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70086f92-ad6e-48aa-81b2-407b4d230ef0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:10.573211 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70086f92-ad6e-48aa-81b2-407b4d230ef0 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:10.585721 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1218/2445] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:18:10 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:18:13.586516 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2814886-280d-435c-8d28-0fa6d2bfa9fd service cinder] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:13.589150 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-b2814886-280d-435c-8d28-0fa6d2bfa9fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:13.663244 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70086f92-ad6e-48aa-81b2-407b4d230ef0 service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:13.664972 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-70086f92-ad6e-48aa-81b2-407b4d230ef0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:13.681192 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2814886-280d-435c-8d28-0fa6d2bfa9fd service cinder] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:13.687819 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa024af-b600-463c-bf8e-e7bbf1a86f50 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9009560a846414b849d42efa8625ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:13.688515 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa024af-b600-463c-bf8e-e7bbf1a86f50 service placement] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:13.688832 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa024af-b600-463c-bf8e-e7bbf1a86f50 service placement] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:13.689112 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa024af-b600-463c-bf8e-e7bbf1a86f50 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:13.691049 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-1fa024af-b600-463c-bf8e-e7bbf1a86f50 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:13.705246 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa024af-b600-463c-bf8e-e7bbf1a86f50 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:13.706863 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa024af-b600-463c-bf8e-e7bbf1a86f50 service placement] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:13.717877 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1228/2446] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:18:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:18:13.746896 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70086f92-ad6e-48aa-81b2-407b4d230ef0 service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:13.751859 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13dbe76-d9f3-4f9b-afea-8dc3008a86ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:13.752566 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13dbe76-d9f3-4f9b-afea-8dc3008a86ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:13.752852 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13dbe76-d9f3-4f9b-afea-8dc3008a86ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:13.753130 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13dbe76-d9f3-4f9b-afea-8dc3008a86ef admin admin] PATH_INFO: `/v3/users/82d697ab683546cba41c3149ea1bc231` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:13.754517 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13dbe76-d9f3-4f9b-afea-8dc3008a86ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=82d697ab683546cba41c3149ea1bc231)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:13.756478 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13dbe76-d9f3-4f9b-afea-8dc3008a86ef admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:13.818016 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c13dbe76-d9f3-4f9b-afea-8dc3008a86ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82d697ab683546cba41c3149ea1bc231'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:13.818681 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c13dbe76-d9f3-4f9b-afea-8dc3008a86ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82d697ab683546cba41c3149ea1bc231'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:13.819286 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c13dbe76-d9f3-4f9b-afea-8dc3008a86ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82d697ab683546cba41c3149ea1bc231'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:13.827427 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c13dbe76-d9f3-4f9b-afea-8dc3008a86ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82d697ab683546cba41c3149ea1bc231'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:13.849862 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c13dbe76-d9f3-4f9b-afea-8dc3008a86ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82d697ab683546cba41c3149ea1bc231'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:13.852134 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:18:13.864846 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1219/2447] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:18:13 2022] DELETE /identity/v3/users/82d697ab683546cba41c3149ea1bc231 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:18:14.099951 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa024af-b600-463c-bf8e-e7bbf1a86f50 service placement] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:14.111199 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa024af-b600-463c-bf8e-e7bbf1a86f50 service placement] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:14.114904 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:18:14.189430 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc351aab-2f0f-4d4f-9c02-0c6b147c0367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:14.190227 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc351aab-2f0f-4d4f-9c02-0c6b147c0367 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:14.190510 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc351aab-2f0f-4d4f-9c02-0c6b147c0367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:14.190784 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc351aab-2f0f-4d4f-9c02-0c6b147c0367 admin admin] PATH_INFO: `/v3/projects/43bc53c31a9b4f32a53ddf4e13a6abac` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:14.191937 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc351aab-2f0f-4d4f-9c02-0c6b147c0367 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43bc53c31a9b4f32a53ddf4e13a6abac)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:14.193868 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc351aab-2f0f-4d4f-9c02-0c6b147c0367 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:14.239294 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-cc351aab-2f0f-4d4f-9c02-0c6b147c0367 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43bc53c31a9b4f32a53ddf4e13a6abac', 'request_id': 'req-cc351aab-2f0f-4d4f-9c02-0c6b147c0367'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:14.246214 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-cc351aab-2f0f-4d4f-9c02-0c6b147c0367 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43bc53c31a9b4f32a53ddf4e13a6abac', 'request_id': 'req-cc351aab-2f0f-4d4f-9c02-0c6b147c0367'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:14.251672 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-cc351aab-2f0f-4d4f-9c02-0c6b147c0367 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43bc53c31a9b4f32a53ddf4e13a6abac', 'request_id': 'req-cc351aab-2f0f-4d4f-9c02-0c6b147c0367'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:14.262755 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-cc351aab-2f0f-4d4f-9c02-0c6b147c0367 admin admin] The token cache is being invalidate because project 43bc53c31a9b4f32a53ddf4e13a6abac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:18:14.263041 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-cc351aab-2f0f-4d4f-9c02-0c6b147c0367 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:14.263656 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-cc351aab-2f0f-4d4f-9c02-0c6b147c0367 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:14.265313 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1229/2448] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:18:14 2022] DELETE /identity/v3/projects/43bc53c31a9b4f32a53ddf4e13a6abac => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:18:14.270341 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6c228-049b-4335-9b8b-984237609535 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:14.270660 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6c228-049b-4335-9b8b-984237609535 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:14.270944 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6c228-049b-4335-9b8b-984237609535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:14.289354 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-99e6c228-049b-4335-9b8b-984237609535 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:18:14.290650 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-99e6c228-049b-4335-9b8b-984237609535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:14.348563 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1220/2449] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:18:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:18:14.357594 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248c33d-ba59-4662-8211-e0ea1b410d5d None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:14.357883 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248c33d-ba59-4662-8211-e0ea1b410d5d None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:14.358160 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248c33d-ba59-4662-8211-e0ea1b410d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:14.376867 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-3248c33d-ba59-4662-8211-e0ea1b410d5d None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:18:14.378059 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-3248c33d-ba59-4662-8211-e0ea1b410d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:14.385955 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1230/2450] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:18:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:18:14.390110 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e6c228-049b-4335-9b8b-984237609535 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:14.399870 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e6c228-049b-4335-9b8b-984237609535 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:14.404628 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc407d2-f3d3-46cd-9b77-6d4d88ba54a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:14.405283 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc407d2-f3d3-46cd-9b77-6d4d88ba54a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:14.405569 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc407d2-f3d3-46cd-9b77-6d4d88ba54a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:14.405848 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc407d2-f3d3-46cd-9b77-6d4d88ba54a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:14.406574 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc407d2-f3d3-46cd-9b77-6d4d88ba54a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:18:14.406885 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc407d2-f3d3-46cd-9b77-6d4d88ba54a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:14.408522 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc407d2-f3d3-46cd-9b77-6d4d88ba54a9 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:14.420572 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1221/2451] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:18:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:18:14.424877 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3248c33d-ba59-4662-8211-e0ea1b410d5d None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:14.434619 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3248c33d-ba59-4662-8211-e0ea1b410d5d None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:14.439266 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595049f-37c0-47df-a9e6-41761f9425fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:14.439966 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595049f-37c0-47df-a9e6-41761f9425fb admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:14.440209 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595049f-37c0-47df-a9e6-41761f9425fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:14.440487 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595049f-37c0-47df-a9e6-41761f9425fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:14.441178 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9595049f-37c0-47df-a9e6-41761f9425fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:14.443056 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9595049f-37c0-47df-a9e6-41761f9425fb admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:14.468251 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1231/2452] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:18:14 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:18:14.472348 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc407d2-f3d3-46cd-9b77-6d4d88ba54a9 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:14.485445 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc407d2-f3d3-46cd-9b77-6d4d88ba54a9 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:14.541259 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8684186f-0ac7-409b-80aa-0bb77703147f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:14.541936 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684186f-0ac7-409b-80aa-0bb77703147f admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:14.542224 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684186f-0ac7-409b-80aa-0bb77703147f admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:14.542504 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684186f-0ac7-409b-80aa-0bb77703147f admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:14.543197 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8684186f-0ac7-409b-80aa-0bb77703147f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:14.545161 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8684186f-0ac7-409b-80aa-0bb77703147f admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:14.563972 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1222/2453] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:18:14 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 12:18:14.568191 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595049f-37c0-47df-a9e6-41761f9425fb admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:14.579136 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595049f-37c0-47df-a9e6-41761f9425fb admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:14.583980 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689526e6-50cb-4802-9bef-c21a9596fc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:14.584688 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689526e6-50cb-4802-9bef-c21a9596fc20 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:14.584973 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689526e6-50cb-4802-9bef-c21a9596fc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:14.585254 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689526e6-50cb-4802-9bef-c21a9596fc20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:14.585973 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689526e6-50cb-4802-9bef-c21a9596fc20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:14.587607 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689526e6-50cb-4802-9bef-c21a9596fc20 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:14.599028 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1232/2454] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:18:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:18:14.603019 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8684186f-0ac7-409b-80aa-0bb77703147f admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:14.613266 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8684186f-0ac7-409b-80aa-0bb77703147f admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:14.617898 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233395d1-bd96-40b1-acf5-3db09bcc662a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:14.618556 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233395d1-bd96-40b1-acf5-3db09bcc662a admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:14.618845 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233395d1-bd96-40b1-acf5-3db09bcc662a admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:14.619222 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233395d1-bd96-40b1-acf5-3db09bcc662a admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:14.619909 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233395d1-bd96-40b1-acf5-3db09bcc662a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:14.621570 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233395d1-bd96-40b1-acf5-3db09bcc662a admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:14.631402 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1223/2455] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:18:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:18:14.635938 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689526e6-50cb-4802-9bef-c21a9596fc20 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:14.645559 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689526e6-50cb-4802-9bef-c21a9596fc20 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:14.650111 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9c366-f1aa-4ff6-a7a2-18a5bf1743ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:14.651724 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9c366-f1aa-4ff6-a7a2-18a5bf1743ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:14.652100 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9c366-f1aa-4ff6-a7a2-18a5bf1743ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:14.652409 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9c366-f1aa-4ff6-a7a2-18a5bf1743ec admin admin] PATH_INFO: `/v3/projects/cc8a0776e7744420b4bc6bcd39b78d77/users/59e1dc6887b844b7a28ad331021582c4/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:14.666782 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b9c366-f1aa-4ff6-a7a2-18a5bf1743ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc8a0776e7744420b4bc6bcd39b78d77, user_id=59e1dc6887b844b7a28ad331021582c4, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:14.669437 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b9c366-f1aa-4ff6-a7a2-18a5bf1743ec admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:14.682968 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1233/2456] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:18:14 2022] PUT /identity/v3/projects/cc8a0776e7744420b4bc6bcd39b78d77/users/59e1dc6887b844b7a28ad331021582c4/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:18:14.688123 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b23972-b5a8-430e-a8e0-c9d92d1ec62a None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:14.688629 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b23972-b5a8-430e-a8e0-c9d92d1ec62a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:14.688756 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b23972-b5a8-430e-a8e0-c9d92d1ec62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:14.706982 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-d4b23972-b5a8-430e-a8e0-c9d92d1ec62a None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:18:14.708128 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-d4b23972-b5a8-430e-a8e0-c9d92d1ec62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:14.757536 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:18:14.768890 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1224/2457] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:18:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:18:14.778174 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9c366-f1aa-4ff6-a7a2-18a5bf1743ec admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:14.779870 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-b1b9c366-f1aa-4ff6-a7a2-18a5bf1743ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:14.815075 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:18:14.839344 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9c366-f1aa-4ff6-a7a2-18a5bf1743ec admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:14.842972 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec1f20-b918-4a38-9a38-41d81a635497 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:14.843609 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec1f20-b918-4a38-9a38-41d81a635497 service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:14.843890 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec1f20-b918-4a38-9a38-41d81a635497 service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:14.844184 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec1f20-b918-4a38-9a38-41d81a635497 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:14.852996 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fec1f20-b918-4a38-9a38-41d81a635497 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:14.854851 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fec1f20-b918-4a38-9a38-41d81a635497 service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:14.864149 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1234/2458] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:18:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 12:18:19.212215 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b23972-b5a8-430e-a8e0-c9d92d1ec62a None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:19.217883 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-d4b23972-b5a8-430e-a8e0-c9d92d1ec62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:19.300919 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426830d-13fc-461b-8a04-fa602d5b93d5 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:19.301509 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426830d-13fc-461b-8a04-fa602d5b93d5 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:19.301599 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426830d-13fc-461b-8a04-fa602d5b93d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:19.335480 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-1426830d-13fc-461b-8a04-fa602d5b93d5 None None] MFA Rules not processed for user `59e1dc6887b844b7a28ad331021582c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:18:19.336941 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-1426830d-13fc-461b-8a04-fa602d5b93d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:19.383895 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b23972-b5a8-430e-a8e0-c9d92d1ec62a None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:19.392866 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a00159f-5369-4973-b737-bc01b5e02fa4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef7edb5e9ce49e6b098f48bf060b228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:19.393644 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00159f-5369-4973-b737-bc01b5e02fa4 service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:19.394007 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00159f-5369-4973-b737-bc01b5e02fa4 service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:19.394387 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00159f-5369-4973-b737-bc01b5e02fa4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:19.396437 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-0a00159f-5369-4973-b737-bc01b5e02fa4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:19.436330 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1235/2459] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:18:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:18:19.437521 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1426830d-13fc-461b-8a04-fa602d5b93d5 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:19.448666 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1426830d-13fc-461b-8a04-fa602d5b93d5 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:19.453545 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e21de8-1a95-43d5-935c-85a50b46e37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:19.454225 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e21de8-1a95-43d5-935c-85a50b46e37e admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:19.454513 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e21de8-1a95-43d5-935c-85a50b46e37e admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:19.454804 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e21de8-1a95-43d5-935c-85a50b46e37e admin admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:19.455490 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e21de8-1a95-43d5-935c-85a50b46e37e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:19.457501 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e21de8-1a95-43d5-935c-85a50b46e37e admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:19.494969 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1236/2460] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:18:19 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:18:19.496415 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e21de8-1a95-43d5-935c-85a50b46e37e admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:19.514119 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a00159f-5369-4973-b737-bc01b5e02fa4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:19.515684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a00159f-5369-4973-b737-bc01b5e02fa4 service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:19.538928 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1225/2461] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:18:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:18:19.566995 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e21de8-1a95-43d5-935c-85a50b46e37e admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:19.571908 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e24fde-89ea-4a17-a434-cf703c56e67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:19.573465 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e24fde-89ea-4a17-a434-cf703c56e67f admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:19.573896 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e24fde-89ea-4a17-a434-cf703c56e67f admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:19.574248 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e24fde-89ea-4a17-a434-cf703c56e67f admin admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:19.575239 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e24fde-89ea-4a17-a434-cf703c56e67f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:19.577457 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e24fde-89ea-4a17-a434-cf703c56e67f admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:19.609150 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1237/2462] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:18:19 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:18:19.613074 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a00159f-5369-4973-b737-bc01b5e02fa4 service nova] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:19.624612 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a00159f-5369-4973-b737-bc01b5e02fa4 service nova] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:19.629672 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc509da1-ef65-4fb8-b485-137831097ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:19.630345 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc509da1-ef65-4fb8-b485-137831097ecc admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:19.630629 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc509da1-ef65-4fb8-b485-137831097ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:19.630907 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc509da1-ef65-4fb8-b485-137831097ecc admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:19.631639 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc509da1-ef65-4fb8-b485-137831097ecc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:19.633741 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc509da1-ef65-4fb8-b485-137831097ecc admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:19.650070 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1226/2463] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:18:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:18:19.654212 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e24fde-89ea-4a17-a434-cf703c56e67f admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:19.667132 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e24fde-89ea-4a17-a434-cf703c56e67f admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:19.672245 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893b7fb5-15ff-4af5-a315-32810c35ec02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:19.673382 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b7fb5-15ff-4af5-a315-32810c35ec02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:19.673674 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b7fb5-15ff-4af5-a315-32810c35ec02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:19.674082 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b7fb5-15ff-4af5-a315-32810c35ec02 admin admin] PATH_INFO: `/v3/projects/46a749fb9b7b4a9cb1a8011c80b695db/users/678b544e1ad6406bbe332fb2e5f51792/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:19.691037 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893b7fb5-15ff-4af5-a315-32810c35ec02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46a749fb9b7b4a9cb1a8011c80b695db, user_id=678b544e1ad6406bbe332fb2e5f51792, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:19.698680 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893b7fb5-15ff-4af5-a315-32810c35ec02 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:19.724995 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1238/2464] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:18:19 2022] PUT /identity/v3/projects/46a749fb9b7b4a9cb1a8011c80b695db/users/678b544e1ad6406bbe332fb2e5f51792/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:18:19.729358 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc509da1-ef65-4fb8-b485-137831097ecc admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:19.744650 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc509da1-ef65-4fb8-b485-137831097ecc admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:19.814515 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:18:19.826996 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6020d1ce-646b-4ffc-b4f7-848be8b9404b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:19.827807 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020d1ce-646b-4ffc-b4f7-848be8b9404b admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:19.828106 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020d1ce-646b-4ffc-b4f7-848be8b9404b admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:19.828492 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020d1ce-646b-4ffc-b4f7-848be8b9404b admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:19.829279 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6020d1ce-646b-4ffc-b4f7-848be8b9404b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:19.831082 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6020d1ce-646b-4ffc-b4f7-848be8b9404b admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:19.843359 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1227/2465] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:18:19 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:18:19.847798 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893b7fb5-15ff-4af5-a315-32810c35ec02 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:19.864340 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893b7fb5-15ff-4af5-a315-32810c35ec02 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:19.877601 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d92d7e-117f-479d-aef7-9297a643c925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:19.878517 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d92d7e-117f-479d-aef7-9297a643c925 admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:19.878804 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d92d7e-117f-479d-aef7-9297a643c925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:19.879083 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d92d7e-117f-479d-aef7-9297a643c925 admin admin] PATH_INFO: `/v3/projects/46a749fb9b7b4a9cb1a8011c80b695db/users/678b544e1ad6406bbe332fb2e5f51792/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:19.881146 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d92d7e-117f-479d-aef7-9297a643c925 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46a749fb9b7b4a9cb1a8011c80b695db, user_id=678b544e1ad6406bbe332fb2e5f51792, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:19.884070 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d92d7e-117f-479d-aef7-9297a643c925 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:19.888075 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:18:19.898902 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1239/2466] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:18:19 2022] PUT /identity/v3/projects/46a749fb9b7b4a9cb1a8011c80b695db/users/678b544e1ad6406bbe332fb2e5f51792/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:18:23.515367 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6020d1ce-646b-4ffc-b4f7-848be8b9404b admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:23.517780 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-6020d1ce-646b-4ffc-b4f7-848be8b9404b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:23.533073 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6020d1ce-646b-4ffc-b4f7-848be8b9404b admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:23.609993 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44992fb-8662-4188-9689-cb57a0516330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:23.610886 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44992fb-8662-4188-9689-cb57a0516330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:23.611168 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44992fb-8662-4188-9689-cb57a0516330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:23.611447 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44992fb-8662-4188-9689-cb57a0516330 admin admin] PATH_INFO: `/v3/users/2f604dec1d564c8c83c6146fbeec62f4` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:23.616137 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44992fb-8662-4188-9689-cb57a0516330 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f604dec1d564c8c83c6146fbeec62f4)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:23.618124 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44992fb-8662-4188-9689-cb57a0516330 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:23.737775 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d44992fb-8662-4188-9689-cb57a0516330 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f604dec1d564c8c83c6146fbeec62f4'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:23.738759 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d44992fb-8662-4188-9689-cb57a0516330 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f604dec1d564c8c83c6146fbeec62f4'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:23.741256 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d44992fb-8662-4188-9689-cb57a0516330 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f604dec1d564c8c83c6146fbeec62f4'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:23.780482 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d44992fb-8662-4188-9689-cb57a0516330 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f604dec1d564c8c83c6146fbeec62f4'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:23.809796 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d44992fb-8662-4188-9689-cb57a0516330 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f604dec1d564c8c83c6146fbeec62f4'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:23.829443 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1228/2467] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:18:23 2022] DELETE /identity/v3/users/2f604dec1d564c8c83c6146fbeec62f4 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:18:23.833819 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51b37e-67e8-4dea-8cf1-e665f35a6a7d None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:23.834269 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51b37e-67e8-4dea-8cf1-e665f35a6a7d None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:23.834439 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51b37e-67e8-4dea-8cf1-e665f35a6a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:23.863908 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-2e51b37e-67e8-4dea-8cf1-e665f35a6a7d None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:18:23.865532 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-2e51b37e-67e8-4dea-8cf1-e665f35a6a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:23.952836 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1240/2468] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:18:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:18:23.965819 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44992fb-8662-4188-9689-cb57a0516330 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:23.967374 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-d44992fb-8662-4188-9689-cb57a0516330 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:24.067061 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44992fb-8662-4188-9689-cb57a0516330 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:24.071600 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72143911-5c3c-416c-8585-10dc22a2415f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:24.072953 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72143911-5c3c-416c-8585-10dc22a2415f service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:24.073304 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72143911-5c3c-416c-8585-10dc22a2415f service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:24.073673 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72143911-5c3c-416c-8585-10dc22a2415f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:24.090701 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72143911-5c3c-416c-8585-10dc22a2415f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:24.090701 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72143911-5c3c-416c-8585-10dc22a2415f service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:24.106741 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1229/2469] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:18:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:18:24.501810 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e51b37e-67e8-4dea-8cf1-e665f35a6a7d None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:24.504484 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-2e51b37e-67e8-4dea-8cf1-e665f35a6a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:24.523271 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e51b37e-67e8-4dea-8cf1-e665f35a6a7d None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:24.529231 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f467e-2b68-4017-a717-92031ed6ecd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:24.531139 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f467e-2b68-4017-a717-92031ed6ecd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:24.531139 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f467e-2b68-4017-a717-92031ed6ecd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:24.531139 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f467e-2b68-4017-a717-92031ed6ecd1 admin admin] PATH_INFO: `/v3/projects/1bab5c0ac4234e59ac57f255e4588b51` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:24.532321 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2f467e-2b68-4017-a717-92031ed6ecd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bab5c0ac4234e59ac57f255e4588b51)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:24.534371 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2f467e-2b68-4017-a717-92031ed6ecd1 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:24.605704 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-5c2f467e-2b68-4017-a717-92031ed6ecd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bab5c0ac4234e59ac57f255e4588b51', 'request_id': 'req-5c2f467e-2b68-4017-a717-92031ed6ecd1'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:24.613364 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-5c2f467e-2b68-4017-a717-92031ed6ecd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bab5c0ac4234e59ac57f255e4588b51', 'request_id': 'req-5c2f467e-2b68-4017-a717-92031ed6ecd1'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:24.621646 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-5c2f467e-2b68-4017-a717-92031ed6ecd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bab5c0ac4234e59ac57f255e4588b51', 'request_id': 'req-5c2f467e-2b68-4017-a717-92031ed6ecd1'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:24.633242 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-5c2f467e-2b68-4017-a717-92031ed6ecd1 admin admin] The token cache is being invalidate because project 1bab5c0ac4234e59ac57f255e4588b51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:18:24.633546 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-5c2f467e-2b68-4017-a717-92031ed6ecd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:24.634175 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-5c2f467e-2b68-4017-a717-92031ed6ecd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:24.636594 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1241/2470] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:18:24 2022] DELETE /identity/v3/projects/1bab5c0ac4234e59ac57f255e4588b51 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:18:24.640447 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72143911-5c3c-416c-8585-10dc22a2415f service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:24.652922 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72143911-5c3c-416c-8585-10dc22a2415f service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:24.666824 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:18:24.738118 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf5061-610b-4938-8149-238d551d3a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:24.739459 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf5061-610b-4938-8149-238d551d3a9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:24.740051 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf5061-610b-4938-8149-238d551d3a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:24.740432 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf5061-610b-4938-8149-238d551d3a9a admin admin] PATH_INFO: `/v3/users/f429cc950576400ea489797aad9ac1a7` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:24.741695 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bf5061-610b-4938-8149-238d551d3a9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f429cc950576400ea489797aad9ac1a7)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:24.743813 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bf5061-610b-4938-8149-238d551d3a9a admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:24.812580 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a7bf5061-610b-4938-8149-238d551d3a9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f429cc950576400ea489797aad9ac1a7'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:24.813517 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a7bf5061-610b-4938-8149-238d551d3a9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f429cc950576400ea489797aad9ac1a7'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:24.814415 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a7bf5061-610b-4938-8149-238d551d3a9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f429cc950576400ea489797aad9ac1a7'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:24.842946 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a7bf5061-610b-4938-8149-238d551d3a9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f429cc950576400ea489797aad9ac1a7'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:24.858968 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a7bf5061-610b-4938-8149-238d551d3a9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f429cc950576400ea489797aad9ac1a7'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:24.898338 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1230/2471] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:18:24 2022] DELETE /identity/v3/users/f429cc950576400ea489797aad9ac1a7 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:18:25.553717 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44178fd-9eb4-4935-9ca3-15e1bce9ab9e None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:25.554222 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44178fd-9eb4-4935-9ca3-15e1bce9ab9e None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:25.554324 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44178fd-9eb4-4935-9ca3-15e1bce9ab9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:25.595856 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-b44178fd-9eb4-4935-9ca3-15e1bce9ab9e None None] MFA Rules not processed for user `678b544e1ad6406bbe332fb2e5f51792`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:18:25.597061 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-b44178fd-9eb4-4935-9ca3-15e1bce9ab9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:25.683531 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1242/2472] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:18:25 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:18:25.698720 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf5061-610b-4938-8149-238d551d3a9a admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:25.700438 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a7bf5061-610b-4938-8149-238d551d3a9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:25.715699 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44178fd-9eb4-4935-9ca3-15e1bce9ab9e None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:25.717265 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-b44178fd-9eb4-4935-9ca3-15e1bce9ab9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:25.725589 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:18:25.795194 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf5061-610b-4938-8149-238d551d3a9a admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:25.802240 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa11b6e-aa57-4352-b03d-732f163d496a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef7edb5e9ce49e6b098f48bf060b228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:25.803159 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa11b6e-aa57-4352-b03d-732f163d496a service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:25.803649 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa11b6e-aa57-4352-b03d-732f163d496a service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:25.804144 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa11b6e-aa57-4352-b03d-732f163d496a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:25.806521 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-8aa11b6e-aa57-4352-b03d-732f163d496a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:25.811825 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44178fd-9eb4-4935-9ca3-15e1bce9ab9e None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:25.817838 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e18996d-aacd-4fec-95b2-eeaee1b051db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:25.818711 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18996d-aacd-4fec-95b2-eeaee1b051db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:25.819650 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18996d-aacd-4fec-95b2-eeaee1b051db admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:25.819650 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18996d-aacd-4fec-95b2-eeaee1b051db admin admin] PATH_INFO: `/v3/projects/cb1a459da5e64768b20a8558d2c07081` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:25.820742 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e18996d-aacd-4fec-95b2-eeaee1b051db admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb1a459da5e64768b20a8558d2c07081)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:25.824208 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e18996d-aacd-4fec-95b2-eeaee1b051db admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:25.844320 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:18:25.878461 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-8e18996d-aacd-4fec-95b2-eeaee1b051db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb1a459da5e64768b20a8558d2c07081', 'request_id': 'req-8e18996d-aacd-4fec-95b2-eeaee1b051db'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:25.886745 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa11b6e-aa57-4352-b03d-732f163d496a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:25.887302 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-8e18996d-aacd-4fec-95b2-eeaee1b051db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb1a459da5e64768b20a8558d2c07081', 'request_id': 'req-8e18996d-aacd-4fec-95b2-eeaee1b051db'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:25.889124 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa11b6e-aa57-4352-b03d-732f163d496a service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:25.893591 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-8e18996d-aacd-4fec-95b2-eeaee1b051db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb1a459da5e64768b20a8558d2c07081', 'request_id': 'req-8e18996d-aacd-4fec-95b2-eeaee1b051db'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:25.901834 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1231/2473] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:18:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:18:25.914380 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa11b6e-aa57-4352-b03d-732f163d496a service nova] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:25.917120 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-8aa11b6e-aa57-4352-b03d-732f163d496a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:25.929802 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-8e18996d-aacd-4fec-95b2-eeaee1b051db admin admin] The token cache is being invalidate because project cb1a459da5e64768b20a8558d2c07081 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:18:25.929989 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-8e18996d-aacd-4fec-95b2-eeaee1b051db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:25.930771 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-8e18996d-aacd-4fec-95b2-eeaee1b051db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:25.938565 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1243/2474] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:18:25 2022] DELETE /identity/v3/projects/cb1a459da5e64768b20a8558d2c07081 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:18:25.940545 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c74785-7933-4465-a32c-22f48d6db36d None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:25.941008 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c74785-7933-4465-a32c-22f48d6db36d None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:25.941135 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c74785-7933-4465-a32c-22f48d6db36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:25.943689 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa11b6e-aa57-4352-b03d-732f163d496a service nova] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:25.989726 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-d1c74785-7933-4465-a32c-22f48d6db36d None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:18:25.991103 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-d1c74785-7933-4465-a32c-22f48d6db36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:26.037938 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b2e193-6853-4405-9fba-e590ea76efc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef7edb5e9ce49e6b098f48bf060b228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:26.038874 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2e193-6853-4405-9fba-e590ea76efc6 service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:26.039340 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2e193-6853-4405-9fba-e590ea76efc6 service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:26.039781 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2e193-6853-4405-9fba-e590ea76efc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:26.042495 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-36b2e193-6853-4405-9fba-e590ea76efc6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:26.058176 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b2e193-6853-4405-9fba-e590ea76efc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:26.060606 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b2e193-6853-4405-9fba-e590ea76efc6 service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:26.074117 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1232/2475] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:18:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 12:18:26.094086 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1244/2476] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:18:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:18:26.096013 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f97ec-36a2-41e3-87b1-866d974d5fe2 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:26.096574 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f97ec-36a2-41e3-87b1-866d974d5fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:26.096928 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f97ec-36a2-41e3-87b1-866d974d5fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:26.116654 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-e53f97ec-36a2-41e3-87b1-866d974d5fe2 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:18:26.118096 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-e53f97ec-36a2-41e3-87b1-866d974d5fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:26.139586 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1233/2477] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:18:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:18:26.141355 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c74785-7933-4465-a32c-22f48d6db36d None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:26.166434 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c74785-7933-4465-a32c-22f48d6db36d None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:26.178576 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e899c44-30ca-4be2-96f4-4cd09832b8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:26.179621 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e899c44-30ca-4be2-96f4-4cd09832b8af admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:26.179774 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e899c44-30ca-4be2-96f4-4cd09832b8af admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:26.180454 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e899c44-30ca-4be2-96f4-4cd09832b8af admin admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:26.180993 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e899c44-30ca-4be2-96f4-4cd09832b8af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:18:26.181432 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e899c44-30ca-4be2-96f4-4cd09832b8af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:26.183715 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e899c44-30ca-4be2-96f4-4cd09832b8af admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:26.200714 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1245/2478] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:18:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:18:26.208448 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f97ec-36a2-41e3-87b1-866d974d5fe2 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:26.235004 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f97ec-36a2-41e3-87b1-866d974d5fe2 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:26.241804 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfab24d-721d-47d3-a496-e78af08ede0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:26.242621 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfab24d-721d-47d3-a496-e78af08ede0b admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:26.243011 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfab24d-721d-47d3-a496-e78af08ede0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:26.243393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfab24d-721d-47d3-a496-e78af08ede0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:26.244821 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfab24d-721d-47d3-a496-e78af08ede0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:26.249887 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfab24d-721d-47d3-a496-e78af08ede0b admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:26.294939 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1234/2479] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:18:26 2022] POST /identity/v3/projects => generated 381 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:18:26.295439 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e899c44-30ca-4be2-96f4-4cd09832b8af admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:26.309227 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e899c44-30ca-4be2-96f4-4cd09832b8af admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:26.345523 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:18:26.425622 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a630e54-300d-44d9-b6ab-d7b584e0af9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:26.426322 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a630e54-300d-44d9-b6ab-d7b584e0af9b admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:26.426607 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a630e54-300d-44d9-b6ab-d7b584e0af9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:26.426885 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a630e54-300d-44d9-b6ab-d7b584e0af9b admin admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:26.427716 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a630e54-300d-44d9-b6ab-d7b584e0af9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:26.433526 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a630e54-300d-44d9-b6ab-d7b584e0af9b admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:26.462427 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1246/2480] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:18:26 2022] POST /identity/v3/users => generated 291 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 12:18:26.466208 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfab24d-721d-47d3-a496-e78af08ede0b admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:26.481337 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfab24d-721d-47d3-a496-e78af08ede0b admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:26.487728 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a056800-8217-4a53-9487-c1d4253e166f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:26.488734 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a056800-8217-4a53-9487-c1d4253e166f admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:26.489126 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a056800-8217-4a53-9487-c1d4253e166f admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:26.489506 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a056800-8217-4a53-9487-c1d4253e166f admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:26.490452 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a056800-8217-4a53-9487-c1d4253e166f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:26.492436 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a056800-8217-4a53-9487-c1d4253e166f admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:26.522645 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1235/2481] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:18:26.526590 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a630e54-300d-44d9-b6ab-d7b584e0af9b admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:26.539879 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a630e54-300d-44d9-b6ab-d7b584e0af9b admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:26.545908 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fbe4b4-49b7-4916-8cd6-6f4906eb341c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:26.546605 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fbe4b4-49b7-4916-8cd6-6f4906eb341c admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:26.546895 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fbe4b4-49b7-4916-8cd6-6f4906eb341c admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:26.547353 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fbe4b4-49b7-4916-8cd6-6f4906eb341c admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:26.548094 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fbe4b4-49b7-4916-8cd6-6f4906eb341c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:26.549934 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fbe4b4-49b7-4916-8cd6-6f4906eb341c admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:26.568539 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1247/2482] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:18:26.572342 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a056800-8217-4a53-9487-c1d4253e166f admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:26.587334 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a056800-8217-4a53-9487-c1d4253e166f admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:26.593248 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55dd47-cfec-4d2f-b27e-dcfff70f19b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:26.594235 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55dd47-cfec-4d2f-b27e-dcfff70f19b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:26.594658 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55dd47-cfec-4d2f-b27e-dcfff70f19b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:26.594941 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55dd47-cfec-4d2f-b27e-dcfff70f19b7 admin admin] PATH_INFO: `/v3/projects/d3753dbeba1f420a8b5d1a23cc8e3db8/users/f9704f7beca149ed8d64448a7287dfef/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:26.637591 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e55dd47-cfec-4d2f-b27e-dcfff70f19b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3753dbeba1f420a8b5d1a23cc8e3db8, user_id=f9704f7beca149ed8d64448a7287dfef, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:26.640410 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e55dd47-cfec-4d2f-b27e-dcfff70f19b7 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:26.668851 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1236/2483] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:18:26 2022] PUT /identity/v3/projects/d3753dbeba1f420a8b5d1a23cc8e3db8/users/f9704f7beca149ed8d64448a7287dfef/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:18:26.672818 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005338f-48d5-4ece-888e-a5d237758a32 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:26.673259 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005338f-48d5-4ece-888e-a5d237758a32 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:26.673646 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005338f-48d5-4ece-888e-a5d237758a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:26.707879 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-1005338f-48d5-4ece-888e-a5d237758a32 None None] MFA Rules not processed for user `f9704f7beca149ed8d64448a7287dfef`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:18:26.709445 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-1005338f-48d5-4ece-888e-a5d237758a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:26.805543 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1248/2484] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:18:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:18:26.810064 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55dd47-cfec-4d2f-b27e-dcfff70f19b7 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:26.878903 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:18:26.905010 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55dd47-cfec-4d2f-b27e-dcfff70f19b7 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:26.911596 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e149d-793e-442e-9e17-5fcda31c8a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:26.912262 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e149d-793e-442e-9e17-5fcda31c8a64 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:26.912760 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e149d-793e-442e-9e17-5fcda31c8a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:26.913016 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e149d-793e-442e-9e17-5fcda31c8a64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:26.913725 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e149d-793e-442e-9e17-5fcda31c8a64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:26.915747 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e149d-793e-442e-9e17-5fcda31c8a64 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:26.971623 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1237/2485] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:18:26 2022] POST /identity/v3/projects => generated 379 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 12:18:26.975838 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1005338f-48d5-4ece-888e-a5d237758a32 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:26.987377 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1005338f-48d5-4ece-888e-a5d237758a32 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:27.068106 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e5af9-c81a-4b22-9844-c833f988a5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:27.068831 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e5af9-c81a-4b22-9844-c833f988a5f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:27.069116 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e5af9-c81a-4b22-9844-c833f988a5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:27.069554 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e5af9-c81a-4b22-9844-c833f988a5f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:27.070259 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e5af9-c81a-4b22-9844-c833f988a5f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:27.072991 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e5af9-c81a-4b22-9844-c833f988a5f4 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:27.097473 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1249/2486] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:18:26 2022] POST /identity/v3/users => generated 296 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:18:27.105608 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e149d-793e-442e-9e17-5fcda31c8a64 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:27.118075 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e149d-793e-442e-9e17-5fcda31c8a64 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:27.124310 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b4bec-bc16-476c-b056-e81489ac847b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:27.125050 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b4bec-bc16-476c-b056-e81489ac847b admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:27.125361 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b4bec-bc16-476c-b056-e81489ac847b admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:27.125641 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b4bec-bc16-476c-b056-e81489ac847b admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:27.126342 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892b4bec-bc16-476c-b056-e81489ac847b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:27.128048 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892b4bec-bc16-476c-b056-e81489ac847b admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:27.144951 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1238/2487] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:18:27.148878 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e5af9-c81a-4b22-9844-c833f988a5f4 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:27.160133 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e5af9-c81a-4b22-9844-c833f988a5f4 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:27.166708 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff933999-17ae-4b1f-a112-4988d2959261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:27.169275 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff933999-17ae-4b1f-a112-4988d2959261 admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:27.170021 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff933999-17ae-4b1f-a112-4988d2959261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:27.171720 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff933999-17ae-4b1f-a112-4988d2959261 admin admin] PATH_INFO: `/v3/projects/ef99006fb2a94898a8c21af53ef12cf9/users/350d3b18b327443bbedb3b0a442d9abd/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:27.189483 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff933999-17ae-4b1f-a112-4988d2959261 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef99006fb2a94898a8c21af53ef12cf9, user_id=350d3b18b327443bbedb3b0a442d9abd, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:27.192284 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff933999-17ae-4b1f-a112-4988d2959261 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:27.195771 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:18:27.213835 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1250/2488] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:18:27 2022] PUT /identity/v3/projects/ef99006fb2a94898a8c21af53ef12cf9/users/350d3b18b327443bbedb3b0a442d9abd/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:18:27.214630 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b4bec-bc16-476c-b056-e81489ac847b admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:27.226544 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b4bec-bc16-476c-b056-e81489ac847b admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:27.293792 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c9559-2eb3-46d3-a0bf-41ca728463e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:27.294494 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c9559-2eb3-46d3-a0bf-41ca728463e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:27.294774 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c9559-2eb3-46d3-a0bf-41ca728463e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:27.295047 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c9559-2eb3-46d3-a0bf-41ca728463e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:27.295941 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56c9559-2eb3-46d3-a0bf-41ca728463e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:27.297754 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56c9559-2eb3-46d3-a0bf-41ca728463e9 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:27.310542 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1239/2489] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 12:18:27.314565 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff933999-17ae-4b1f-a112-4988d2959261 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:27.337691 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff933999-17ae-4b1f-a112-4988d2959261 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:27.341282 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95cd48-f62c-4918-948a-f006547f5b13 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:27.341571 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95cd48-f62c-4918-948a-f006547f5b13 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:27.341851 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95cd48-f62c-4918-948a-f006547f5b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:27.352920 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c46bd3-6bac-4f43-9e8b-cbc2e72a4c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:27.355047 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c46bd3-6bac-4f43-9e8b-cbc2e72a4c8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:27.355533 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c46bd3-6bac-4f43-9e8b-cbc2e72a4c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:27.355988 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c46bd3-6bac-4f43-9e8b-cbc2e72a4c8d admin admin] PATH_INFO: `/v3/projects/ef99006fb2a94898a8c21af53ef12cf9/users/350d3b18b327443bbedb3b0a442d9abd/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:27.358094 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c46bd3-6bac-4f43-9e8b-cbc2e72a4c8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef99006fb2a94898a8c21af53ef12cf9, user_id=350d3b18b327443bbedb3b0a442d9abd, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:27.366321 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c46bd3-6bac-4f43-9e8b-cbc2e72a4c8d admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:27.378027 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-6d95cd48-f62c-4918-948a-f006547f5b13 None None] MFA Rules not processed for user `59e1dc6887b844b7a28ad331021582c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:18:27.379602 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-6d95cd48-f62c-4918-948a-f006547f5b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:27.383106 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1251/2490] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:18:27 2022] PUT /identity/v3/projects/ef99006fb2a94898a8c21af53ef12cf9/users/350d3b18b327443bbedb3b0a442d9abd/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:18:27.395261 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a960a-8341-4a0d-af0f-486063488065 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:27.395433 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a960a-8341-4a0d-af0f-486063488065 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:27.395708 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a960a-8341-4a0d-af0f-486063488065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:27.443140 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-a80a960a-8341-4a0d-af0f-486063488065 None None] MFA Rules not processed for user `350d3b18b327443bbedb3b0a442d9abd`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:18:27.444559 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-a80a960a-8341-4a0d-af0f-486063488065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:27.490077 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1240/2491] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:18:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:18:27.542979 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1252/2492] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:18:27 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:18:27.557499 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d95cd48-f62c-4918-948a-f006547f5b13 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:27.559231 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-6d95cd48-f62c-4918-948a-f006547f5b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:27.644591 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d95cd48-f62c-4918-948a-f006547f5b13 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:27.649740 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46efbbd1-5593-4034-bc29-8c4df1d6ac29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:27.651049 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46efbbd1-5593-4034-bc29-8c4df1d6ac29 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:27.651560 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46efbbd1-5593-4034-bc29-8c4df1d6ac29 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:27.652264 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46efbbd1-5593-4034-bc29-8c4df1d6ac29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:27.667287 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46efbbd1-5593-4034-bc29-8c4df1d6ac29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:27.668954 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46efbbd1-5593-4034-bc29-8c4df1d6ac29 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:27.685876 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1241/2493] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:18:27 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:18:28.113660 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a960a-8341-4a0d-af0f-486063488065 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:28.123499 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a960a-8341-4a0d-af0f-486063488065 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:28.128113 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc7cc7-544d-440d-8d4a-294a5d1925e9 tempest-VolumeQuotaClassesTest-797697166 tempest-VolumeQuotaClassesTest-797697166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '350d3b18b327443bbedb3b0a442d9abd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef99006fb2a94898a8c21af53ef12cf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:28.128823 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc7cc7-544d-440d-8d4a-294a5d1925e9 tempest-VolumeQuotaClassesTest-797697166 tempest-VolumeQuotaClassesTest-797697166-project-admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:28.129108 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc7cc7-544d-440d-8d4a-294a5d1925e9 tempest-VolumeQuotaClassesTest-797697166 tempest-VolumeQuotaClassesTest-797697166-project-admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:28.129385 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc7cc7-544d-440d-8d4a-294a5d1925e9 tempest-VolumeQuotaClassesTest-797697166 tempest-VolumeQuotaClassesTest-797697166-project-admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:28.130136 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc7cc7-544d-440d-8d4a-294a5d1925e9 tempest-VolumeQuotaClassesTest-797697166 tempest-VolumeQuotaClassesTest-797697166-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:18:28.130446 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc7cc7-544d-440d-8d4a-294a5d1925e9 tempest-VolumeQuotaClassesTest-797697166 tempest-VolumeQuotaClassesTest-797697166-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:28.132041 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc7cc7-544d-440d-8d4a-294a5d1925e9 tempest-VolumeQuotaClassesTest-797697166 tempest-VolumeQuotaClassesTest-797697166-project-admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:28.144591 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1253/2494] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:18:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:18:28.148680 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46efbbd1-5593-4034-bc29-8c4df1d6ac29 service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:28.163079 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46efbbd1-5593-4034-bc29-8c4df1d6ac29 service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:28.169541 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d691fa-b1e6-4638-860c-7b6cb8f6ccd1 tempest-VolumeQuotaClassesTest-797697166 tempest-VolumeQuotaClassesTest-797697166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '350d3b18b327443bbedb3b0a442d9abd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef99006fb2a94898a8c21af53ef12cf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:28.169894 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d691fa-b1e6-4638-860c-7b6cb8f6ccd1 tempest-VolumeQuotaClassesTest-797697166 tempest-VolumeQuotaClassesTest-797697166-project-admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:28.170134 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d691fa-b1e6-4638-860c-7b6cb8f6ccd1 tempest-VolumeQuotaClassesTest-797697166 tempest-VolumeQuotaClassesTest-797697166-project-admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:28.170420 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d691fa-b1e6-4638-860c-7b6cb8f6ccd1 tempest-VolumeQuotaClassesTest-797697166 tempest-VolumeQuotaClassesTest-797697166-project-admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:28.171306 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d691fa-b1e6-4638-860c-7b6cb8f6ccd1 tempest-VolumeQuotaClassesTest-797697166 tempest-VolumeQuotaClassesTest-797697166-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:28.173264 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d691fa-b1e6-4638-860c-7b6cb8f6ccd1 tempest-VolumeQuotaClassesTest-797697166 tempest-VolumeQuotaClassesTest-797697166-project-admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:28.178034 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:18:28.205399 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1242/2495] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:18:28 2022] POST /identity/v3/projects => generated 354 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:18:28.206856 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc7cc7-544d-440d-8d4a-294a5d1925e9 tempest-VolumeQuotaClassesTest-797697166 tempest-VolumeQuotaClassesTest-797697166-project-admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:28.217735 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc7cc7-544d-440d-8d4a-294a5d1925e9 tempest-VolumeQuotaClassesTest-797697166 tempest-VolumeQuotaClassesTest-797697166-project-admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:28.278148 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56225bba-9612-45bf-84fc-88507f68cfc4 tempest-VolumeQuotaClassesTest-797697166 tempest-VolumeQuotaClassesTest-797697166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '350d3b18b327443bbedb3b0a442d9abd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef99006fb2a94898a8c21af53ef12cf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:28.278835 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56225bba-9612-45bf-84fc-88507f68cfc4 tempest-VolumeQuotaClassesTest-797697166 tempest-VolumeQuotaClassesTest-797697166-project-admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:28.279114 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56225bba-9612-45bf-84fc-88507f68cfc4 tempest-VolumeQuotaClassesTest-797697166 tempest-VolumeQuotaClassesTest-797697166-project-admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:28.279390 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56225bba-9612-45bf-84fc-88507f68cfc4 tempest-VolumeQuotaClassesTest-797697166 tempest-VolumeQuotaClassesTest-797697166-project-admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:28.280125 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56225bba-9612-45bf-84fc-88507f68cfc4 tempest-VolumeQuotaClassesTest-797697166 tempest-VolumeQuotaClassesTest-797697166-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:18:28.280473 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56225bba-9612-45bf-84fc-88507f68cfc4 tempest-VolumeQuotaClassesTest-797697166 tempest-VolumeQuotaClassesTest-797697166-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:28.282980 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56225bba-9612-45bf-84fc-88507f68cfc4 tempest-VolumeQuotaClassesTest-797697166 tempest-VolumeQuotaClassesTest-797697166-project-admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:28.300294 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1254/2496] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:18:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:18:28.349918 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d691fa-b1e6-4638-860c-7b6cb8f6ccd1 tempest-VolumeQuotaClassesTest-797697166 tempest-VolumeQuotaClassesTest-797697166-project-admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:28.363520 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d691fa-b1e6-4638-860c-7b6cb8f6ccd1 tempest-VolumeQuotaClassesTest-797697166 tempest-VolumeQuotaClassesTest-797697166-project-admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:28.377935 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7566ce33-4787-471d-aeb3-04bce6f9a778 tempest-VolumeQuotaClassesTest-797697166 tempest-VolumeQuotaClassesTest-797697166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '350d3b18b327443bbedb3b0a442d9abd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef99006fb2a94898a8c21af53ef12cf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:28.379132 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566ce33-4787-471d-aeb3-04bce6f9a778 tempest-VolumeQuotaClassesTest-797697166 tempest-VolumeQuotaClassesTest-797697166-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:28.379445 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566ce33-4787-471d-aeb3-04bce6f9a778 tempest-VolumeQuotaClassesTest-797697166 tempest-VolumeQuotaClassesTest-797697166-project-admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:28.380363 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566ce33-4787-471d-aeb3-04bce6f9a778 tempest-VolumeQuotaClassesTest-797697166 tempest-VolumeQuotaClassesTest-797697166-project-admin] PATH_INFO: `/v3/projects/c13fb6a475db4711ba86510f2d687e26` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:28.381123 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7566ce33-4787-471d-aeb3-04bce6f9a778 tempest-VolumeQuotaClassesTest-797697166 tempest-VolumeQuotaClassesTest-797697166-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c13fb6a475db4711ba86510f2d687e26)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:28.383178 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7566ce33-4787-471d-aeb3-04bce6f9a778 tempest-VolumeQuotaClassesTest-797697166 tempest-VolumeQuotaClassesTest-797697166-project-admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:28.434122 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-7566ce33-4787-471d-aeb3-04bce6f9a778 tempest-VolumeQuotaClassesTest-797697166 tempest-VolumeQuotaClassesTest-797697166-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c13fb6a475db4711ba86510f2d687e26', 'request_id': 'req-7566ce33-4787-471d-aeb3-04bce6f9a778'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:28.441658 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-7566ce33-4787-471d-aeb3-04bce6f9a778 tempest-VolumeQuotaClassesTest-797697166 tempest-VolumeQuotaClassesTest-797697166-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c13fb6a475db4711ba86510f2d687e26', 'request_id': 'req-7566ce33-4787-471d-aeb3-04bce6f9a778'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:28.448815 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-7566ce33-4787-471d-aeb3-04bce6f9a778 tempest-VolumeQuotaClassesTest-797697166 tempest-VolumeQuotaClassesTest-797697166-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c13fb6a475db4711ba86510f2d687e26', 'request_id': 'req-7566ce33-4787-471d-aeb3-04bce6f9a778'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:28.460421 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-7566ce33-4787-471d-aeb3-04bce6f9a778 tempest-VolumeQuotaClassesTest-797697166 tempest-VolumeQuotaClassesTest-797697166-project-admin] The token cache is being invalidate because project c13fb6a475db4711ba86510f2d687e26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:18:28.460706 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-7566ce33-4787-471d-aeb3-04bce6f9a778 tempest-VolumeQuotaClassesTest-797697166 tempest-VolumeQuotaClassesTest-797697166-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:28.461381 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-7566ce33-4787-471d-aeb3-04bce6f9a778 tempest-VolumeQuotaClassesTest-797697166 tempest-VolumeQuotaClassesTest-797697166-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:28.463588 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1243/2497] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:18:28 2022] DELETE /identity/v3/projects/c13fb6a475db4711ba86510f2d687e26 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:18:28.656884 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56225bba-9612-45bf-84fc-88507f68cfc4 tempest-VolumeQuotaClassesTest-797697166 tempest-VolumeQuotaClassesTest-797697166-project-admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:28.658950 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-56225bba-9612-45bf-84fc-88507f68cfc4 tempest-VolumeQuotaClassesTest-797697166 tempest-VolumeQuotaClassesTest-797697166-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:28.720762 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:18:28.748440 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56225bba-9612-45bf-84fc-88507f68cfc4 tempest-VolumeQuotaClassesTest-797697166 tempest-VolumeQuotaClassesTest-797697166-project-admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:28.807567 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ae8a0-11bd-40c7-a912-62c26d29d739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:28.808489 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ae8a0-11bd-40c7-a912-62c26d29d739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:28.808779 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ae8a0-11bd-40c7-a912-62c26d29d739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:28.809049 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ae8a0-11bd-40c7-a912-62c26d29d739 admin admin] PATH_INFO: `/v3/users/f9704f7beca149ed8d64448a7287dfef` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:28.810284 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ae8a0-11bd-40c7-a912-62c26d29d739 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9704f7beca149ed8d64448a7287dfef)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:28.812279 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ae8a0-11bd-40c7-a912-62c26d29d739 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:28.861410 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-ba2ae8a0-11bd-40c7-a912-62c26d29d739 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9704f7beca149ed8d64448a7287dfef'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:28.868709 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-ba2ae8a0-11bd-40c7-a912-62c26d29d739 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9704f7beca149ed8d64448a7287dfef'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:28.869684 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-ba2ae8a0-11bd-40c7-a912-62c26d29d739 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9704f7beca149ed8d64448a7287dfef'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:28.870390 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-ba2ae8a0-11bd-40c7-a912-62c26d29d739 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9704f7beca149ed8d64448a7287dfef'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:28.882652 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-ba2ae8a0-11bd-40c7-a912-62c26d29d739 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9704f7beca149ed8d64448a7287dfef'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:28.897358 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1255/2498] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:18:28 2022] DELETE /identity/v3/users/f9704f7beca149ed8d64448a7287dfef => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:18:28.902912 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e986acf-3e2d-4556-92b5-1313506cb575 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:28.903205 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e986acf-3e2d-4556-92b5-1313506cb575 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:28.903517 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e986acf-3e2d-4556-92b5-1313506cb575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:28.920493 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-6e986acf-3e2d-4556-92b5-1313506cb575 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:18:28.922079 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-6e986acf-3e2d-4556-92b5-1313506cb575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:28.986849 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1244/2499] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:18:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:18:28.997243 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ae8a0-11bd-40c7-a912-62c26d29d739 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:28.998681 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-ba2ae8a0-11bd-40c7-a912-62c26d29d739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:29.061660 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ae8a0-11bd-40c7-a912-62c26d29d739 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:29.065632 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a9525-b30e-4aa4-af8b-2745dd8b42bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:29.066147 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a9525-b30e-4aa4-af8b-2745dd8b42bb service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:29.066403 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a9525-b30e-4aa4-af8b-2745dd8b42bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:29.066735 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a9525-b30e-4aa4-af8b-2745dd8b42bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:29.076951 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a9525-b30e-4aa4-af8b-2745dd8b42bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:29.078395 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a9525-b30e-4aa4-af8b-2745dd8b42bb service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:29.088754 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1256/2500] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:18:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:18:29.511572 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e986acf-3e2d-4556-92b5-1313506cb575 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:29.513098 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-6e986acf-3e2d-4556-92b5-1313506cb575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:29.525133 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e986acf-3e2d-4556-92b5-1313506cb575 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:29.530710 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d24396-553d-42d0-8375-4607f759c69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:29.531566 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d24396-553d-42d0-8375-4607f759c69a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:29.531853 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d24396-553d-42d0-8375-4607f759c69a admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:29.532121 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d24396-553d-42d0-8375-4607f759c69a admin admin] PATH_INFO: `/v3/projects/d3753dbeba1f420a8b5d1a23cc8e3db8` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:29.533314 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d24396-553d-42d0-8375-4607f759c69a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3753dbeba1f420a8b5d1a23cc8e3db8)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:29.535244 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d24396-553d-42d0-8375-4607f759c69a admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:29.587038 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a9525-b30e-4aa4-af8b-2745dd8b42bb service neutron] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:29.599358 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a9525-b30e-4aa4-af8b-2745dd8b42bb service neutron] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:29.614286 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:18:29.615187 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-09d24396-553d-42d0-8375-4607f759c69a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3753dbeba1f420a8b5d1a23cc8e3db8', 'request_id': 'req-09d24396-553d-42d0-8375-4607f759c69a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:29.624558 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-09d24396-553d-42d0-8375-4607f759c69a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3753dbeba1f420a8b5d1a23cc8e3db8', 'request_id': 'req-09d24396-553d-42d0-8375-4607f759c69a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:29.630033 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-09d24396-553d-42d0-8375-4607f759c69a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3753dbeba1f420a8b5d1a23cc8e3db8', 'request_id': 'req-09d24396-553d-42d0-8375-4607f759c69a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:29.631122 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=83,keystone:INSERT=3,keystone:DELETE=14 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:18:29.645687 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-09d24396-553d-42d0-8375-4607f759c69a admin admin] The token cache is being invalidate because project d3753dbeba1f420a8b5d1a23cc8e3db8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:18:29.646403 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-09d24396-553d-42d0-8375-4607f759c69a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:29.647404 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-09d24396-553d-42d0-8375-4607f759c69a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:29.652865 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1245/2501] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:18:29 2022] DELETE /identity/v3/projects/d3753dbeba1f420a8b5d1a23cc8e3db8 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:18:29.653958 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d24396-553d-42d0-8375-4607f759c69a admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:29.655323 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-09d24396-553d-42d0-8375-4607f759c69a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:29.655575 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856a609-af89-4654-895b-71019b8b0d72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:29.656274 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856a609-af89-4654-895b-71019b8b0d72 service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:29.656563 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856a609-af89-4654-895b-71019b8b0d72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:29.656838 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856a609-af89-4654-895b-71019b8b0d72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:29.658565 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-9856a609-af89-4654-895b-71019b8b0d72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:29.725428 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d24396-553d-42d0-8375-4607f759c69a admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:29.725832 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9856a609-af89-4654-895b-71019b8b0d72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:29.727289 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9856a609-af89-4654-895b-71019b8b0d72 service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:29.730535 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bc51ee-71ca-461b-9ac5-d6838075c71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:29.731405 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc51ee-71ca-461b-9ac5-d6838075c71d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:29.731689 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc51ee-71ca-461b-9ac5-d6838075c71d admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:29.731960 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc51ee-71ca-461b-9ac5-d6838075c71d admin admin] PATH_INFO: `/v3/users/350d3b18b327443bbedb3b0a442d9abd` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:29.733258 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bc51ee-71ca-461b-9ac5-d6838075c71d admin admin] RBAC: Authorizing `identity:delete_user(user_id=350d3b18b327443bbedb3b0a442d9abd)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:29.735192 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bc51ee-71ca-461b-9ac5-d6838075c71d admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:29.738118 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1257/2502] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:18:29 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 12:18:29.793657 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a8bc51ee-71ca-461b-9ac5-d6838075c71d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '350d3b18b327443bbedb3b0a442d9abd'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:29.794398 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a8bc51ee-71ca-461b-9ac5-d6838075c71d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '350d3b18b327443bbedb3b0a442d9abd'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:29.795010 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a8bc51ee-71ca-461b-9ac5-d6838075c71d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '350d3b18b327443bbedb3b0a442d9abd'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:29.804797 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a8bc51ee-71ca-461b-9ac5-d6838075c71d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '350d3b18b327443bbedb3b0a442d9abd'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:29.818425 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a8bc51ee-71ca-461b-9ac5-d6838075c71d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '350d3b18b327443bbedb3b0a442d9abd'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:29.831208 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1246/2503] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:18:29 2022] DELETE /identity/v3/users/350d3b18b327443bbedb3b0a442d9abd => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:18:30.158554 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856a609-af89-4654-895b-71019b8b0d72 service neutron] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:30.173331 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856a609-af89-4654-895b-71019b8b0d72 service neutron] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:30.288640 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fba1ae-19b3-4f1b-ba0a-044396c3ca09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:30.290319 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fba1ae-19b3-4f1b-ba0a-044396c3ca09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:30.291165 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fba1ae-19b3-4f1b-ba0a-044396c3ca09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:30.291965 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fba1ae-19b3-4f1b-ba0a-044396c3ca09 admin admin] PATH_INFO: `/v3/projects/ef99006fb2a94898a8c21af53ef12cf9` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:30.293952 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fba1ae-19b3-4f1b-ba0a-044396c3ca09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef99006fb2a94898a8c21af53ef12cf9)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:30.296041 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fba1ae-19b3-4f1b-ba0a-044396c3ca09 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:30.366092 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-d5fba1ae-19b3-4f1b-ba0a-044396c3ca09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef99006fb2a94898a8c21af53ef12cf9', 'request_id': 'req-d5fba1ae-19b3-4f1b-ba0a-044396c3ca09'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:30.386556 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-d5fba1ae-19b3-4f1b-ba0a-044396c3ca09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef99006fb2a94898a8c21af53ef12cf9', 'request_id': 'req-d5fba1ae-19b3-4f1b-ba0a-044396c3ca09'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:30.396751 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-d5fba1ae-19b3-4f1b-ba0a-044396c3ca09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef99006fb2a94898a8c21af53ef12cf9', 'request_id': 'req-d5fba1ae-19b3-4f1b-ba0a-044396c3ca09'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:30.414320 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:18:30.425868 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-d5fba1ae-19b3-4f1b-ba0a-044396c3ca09 admin admin] The token cache is being invalidate because project ef99006fb2a94898a8c21af53ef12cf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:18:30.430746 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-d5fba1ae-19b3-4f1b-ba0a-044396c3ca09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:30.433295 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-d5fba1ae-19b3-4f1b-ba0a-044396c3ca09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:30.435066 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1258/2504] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:18:30 2022] DELETE /identity/v3/projects/ef99006fb2a94898a8c21af53ef12cf9 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:18:30.440767 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c60638-121d-4ef7-8866-355a1e52ecaf None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:30.441194 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c60638-121d-4ef7-8866-355a1e52ecaf None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:30.441577 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c60638-121d-4ef7-8866-355a1e52ecaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:30.471523 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-37c60638-121d-4ef7-8866-355a1e52ecaf None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:18:30.473597 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-37c60638-121d-4ef7-8866-355a1e52ecaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:30.557381 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1247/2505] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:18:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:18:30.562962 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc19b3e-685d-4318-af5a-7e092ba800e0 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:30.563254 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc19b3e-685d-4318-af5a-7e092ba800e0 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:30.563560 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc19b3e-685d-4318-af5a-7e092ba800e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:30.601948 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-9cc19b3e-685d-4318-af5a-7e092ba800e0 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:18:30.603278 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-9cc19b3e-685d-4318-af5a-7e092ba800e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:30.615274 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1259/2506] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:18:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:18:30.630937 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c60638-121d-4ef7-8866-355a1e52ecaf None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:30.643455 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c60638-121d-4ef7-8866-355a1e52ecaf None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:30.651359 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63987955-3cac-4218-a0d8-bae7434538e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:30.652129 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63987955-3cac-4218-a0d8-bae7434538e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:30.652521 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63987955-3cac-4218-a0d8-bae7434538e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:30.653108 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63987955-3cac-4218-a0d8-bae7434538e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:30.654105 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63987955-3cac-4218-a0d8-bae7434538e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:18:30.654493 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63987955-3cac-4218-a0d8-bae7434538e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:30.656715 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63987955-3cac-4218-a0d8-bae7434538e3 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:30.668372 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:18:30.674190 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1248/2507] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:18:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:18:30.677710 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc19b3e-685d-4318-af5a-7e092ba800e0 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:30.693211 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc19b3e-685d-4318-af5a-7e092ba800e0 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:30.700801 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec8dd0-a906-4965-92b1-57960413f698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:30.701494 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec8dd0-a906-4965-92b1-57960413f698 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:30.701849 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec8dd0-a906-4965-92b1-57960413f698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:30.702081 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec8dd0-a906-4965-92b1-57960413f698 admin admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:30.703370 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ec8dd0-a906-4965-92b1-57960413f698 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:30.705339 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ec8dd0-a906-4965-92b1-57960413f698 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:30.749438 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1260/2508] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:18:30 2022] POST /identity/v3/projects => generated 389 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:18:30.753220 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63987955-3cac-4218-a0d8-bae7434538e3 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:30.783652 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63987955-3cac-4218-a0d8-bae7434538e3 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:30.898653 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13f79d-b80e-4f37-b554-e2aac6515315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:30.899829 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13f79d-b80e-4f37-b554-e2aac6515315 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:30.900881 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13f79d-b80e-4f37-b554-e2aac6515315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:30.901364 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13f79d-b80e-4f37-b554-e2aac6515315 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:30.902111 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b13f79d-b80e-4f37-b554-e2aac6515315 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:30.904115 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b13f79d-b80e-4f37-b554-e2aac6515315 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:30.961790 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1249/2509] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:18:30 2022] POST /identity/v3/users => generated 295 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:18:30.963635 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec8dd0-a906-4965-92b1-57960413f698 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:30.975316 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec8dd0-a906-4965-92b1-57960413f698 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:30.982574 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a013cfc-98ec-4626-a40f-e2759561b52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:30.983846 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a013cfc-98ec-4626-a40f-e2759561b52d admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:30.984326 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a013cfc-98ec-4626-a40f-e2759561b52d admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:30.984764 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a013cfc-98ec-4626-a40f-e2759561b52d admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:30.985665 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a013cfc-98ec-4626-a40f-e2759561b52d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:30.987756 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a013cfc-98ec-4626-a40f-e2759561b52d admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:31.002960 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1261/2510] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:18:31.006920 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13f79d-b80e-4f37-b554-e2aac6515315 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:31.019300 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13f79d-b80e-4f37-b554-e2aac6515315 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:31.024077 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6742eebc-5757-44a0-a6ea-77314719653e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:31.024974 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742eebc-5757-44a0-a6ea-77314719653e admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:31.026033 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742eebc-5757-44a0-a6ea-77314719653e admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:31.026388 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742eebc-5757-44a0-a6ea-77314719653e admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:31.027447 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6742eebc-5757-44a0-a6ea-77314719653e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:31.031497 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6742eebc-5757-44a0-a6ea-77314719653e admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:31.049452 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1250/2511] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:18:31.049897 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a013cfc-98ec-4626-a40f-e2759561b52d admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:31.061259 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a013cfc-98ec-4626-a40f-e2759561b52d admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:31.066305 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b590430b-0f8c-4645-abb9-008126beaf6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:31.067253 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590430b-0f8c-4645-abb9-008126beaf6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:31.067539 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590430b-0f8c-4645-abb9-008126beaf6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:31.068003 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590430b-0f8c-4645-abb9-008126beaf6e admin admin] PATH_INFO: `/v3/projects/194d63fce43e4b5d86f4164b9e4266d2/users/7d899d048d974307820af38f7a855d93/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:31.086476 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b590430b-0f8c-4645-abb9-008126beaf6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=194d63fce43e4b5d86f4164b9e4266d2, user_id=7d899d048d974307820af38f7a855d93, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:31.089759 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b590430b-0f8c-4645-abb9-008126beaf6e admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:31.105556 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1262/2512] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:18:31 2022] PUT /identity/v3/projects/194d63fce43e4b5d86f4164b9e4266d2/users/7d899d048d974307820af38f7a855d93/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:18:31.117255 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892db22-8591-4313-8155-556d4563a718 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:31.117644 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892db22-8591-4313-8155-556d4563a718 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:31.117985 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892db22-8591-4313-8155-556d4563a718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:31.156120 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-9892db22-8591-4313-8155-556d4563a718 None None] MFA Rules not processed for user `7d899d048d974307820af38f7a855d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:18:31.157620 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-9892db22-8591-4313-8155-556d4563a718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:31.256234 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1251/2513] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:18:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:18:31.258835 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b590430b-0f8c-4645-abb9-008126beaf6e admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:31.360574 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b590430b-0f8c-4645-abb9-008126beaf6e admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:31.367120 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e45a2-2431-45da-b053-d6634bebb2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:31.368046 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e45a2-2431-45da-b053-d6634bebb2b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:31.368427 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e45a2-2431-45da-b053-d6634bebb2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:31.368743 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e45a2-2431-45da-b053-d6634bebb2b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:31.370717 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5e45a2-2431-45da-b053-d6634bebb2b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:31.373077 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5e45a2-2431-45da-b053-d6634bebb2b4 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:31.417091 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1263/2514] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:18:31 2022] POST /identity/v3/projects => generated 389 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:18:31.418342 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9892db22-8591-4313-8155-556d4563a718 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:31.433827 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9892db22-8591-4313-8155-556d4563a718 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:31.519324 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea19d3c8-9745-4354-992b-98c146dd2b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:31.520047 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19d3c8-9745-4354-992b-98c146dd2b70 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:31.520372 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19d3c8-9745-4354-992b-98c146dd2b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:31.520662 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19d3c8-9745-4354-992b-98c146dd2b70 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:31.522513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea19d3c8-9745-4354-992b-98c146dd2b70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:31.524718 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea19d3c8-9745-4354-992b-98c146dd2b70 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:31.550813 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:18:31.582512 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1252/2515] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:18:31 2022] POST /identity/v3/users => generated 301 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:18:31.584473 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e45a2-2431-45da-b053-d6634bebb2b4 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:31.601841 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e45a2-2431-45da-b053-d6634bebb2b4 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:31.616152 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d51ee3-bcc3-4137-b896-890c2c32ab47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:31.616882 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d51ee3-bcc3-4137-b896-890c2c32ab47 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:31.617360 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d51ee3-bcc3-4137-b896-890c2c32ab47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:31.617801 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d51ee3-bcc3-4137-b896-890c2c32ab47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:31.618755 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d51ee3-bcc3-4137-b896-890c2c32ab47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:31.621580 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d51ee3-bcc3-4137-b896-890c2c32ab47 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:31.634724 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1264/2516] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:18:31.639013 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea19d3c8-9745-4354-992b-98c146dd2b70 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:31.659128 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea19d3c8-9745-4354-992b-98c146dd2b70 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:31.675482 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbecc289-9324-468f-87b5-33a6bc2f55ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:31.676340 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbecc289-9324-468f-87b5-33a6bc2f55ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:31.676623 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbecc289-9324-468f-87b5-33a6bc2f55ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:31.676899 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbecc289-9324-468f-87b5-33a6bc2f55ac admin admin] PATH_INFO: `/v3/projects/50a77592779544f6b21b40ec3e576bdc/users/5802d3c934d740029dfece1e933f0716/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:31.704294 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbecc289-9324-468f-87b5-33a6bc2f55ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=50a77592779544f6b21b40ec3e576bdc, user_id=5802d3c934d740029dfece1e933f0716, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:31.707100 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbecc289-9324-468f-87b5-33a6bc2f55ac admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:31.739387 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1253/2517] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:18:31 2022] PUT /identity/v3/projects/50a77592779544f6b21b40ec3e576bdc/users/5802d3c934d740029dfece1e933f0716/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:18:31.740677 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d51ee3-bcc3-4137-b896-890c2c32ab47 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:31.764133 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d51ee3-bcc3-4137-b896-890c2c32ab47 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:31.898528 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2663f0ce-2072-4e61-aa31-1427a94279f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:31.899591 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663f0ce-2072-4e61-aa31-1427a94279f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:31.900072 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663f0ce-2072-4e61-aa31-1427a94279f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:31.901238 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663f0ce-2072-4e61-aa31-1427a94279f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:31.902112 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2663f0ce-2072-4e61-aa31-1427a94279f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:31.903902 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2663f0ce-2072-4e61-aa31-1427a94279f6 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:31.920109 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1265/2518] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:18:31.920505 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbecc289-9324-468f-87b5-33a6bc2f55ac admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:31.936600 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbecc289-9324-468f-87b5-33a6bc2f55ac admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:31.944949 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9885ef-32bb-4bdf-8a0a-5e1ed73aab31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:31.945873 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9885ef-32bb-4bdf-8a0a-5e1ed73aab31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:31.946160 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9885ef-32bb-4bdf-8a0a-5e1ed73aab31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:31.946440 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9885ef-32bb-4bdf-8a0a-5e1ed73aab31 admin admin] PATH_INFO: `/v3/projects/50a77592779544f6b21b40ec3e576bdc/users/5802d3c934d740029dfece1e933f0716/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:31.949300 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9885ef-32bb-4bdf-8a0a-5e1ed73aab31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50a77592779544f6b21b40ec3e576bdc, user_id=5802d3c934d740029dfece1e933f0716, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:31.952668 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9885ef-32bb-4bdf-8a0a-5e1ed73aab31 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:31.967404 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1254/2519] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:18:31 2022] PUT /identity/v3/projects/50a77592779544f6b21b40ec3e576bdc/users/5802d3c934d740029dfece1e933f0716/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:18:31.978498 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc8429-75e7-4305-9f8c-5c0390013c3a None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:31.978947 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc8429-75e7-4305-9f8c-5c0390013c3a None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:31.983568 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc8429-75e7-4305-9f8c-5c0390013c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:32.013479 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:18:32.051085 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-a2cc8429-75e7-4305-9f8c-5c0390013c3a None None] MFA Rules not processed for user `5802d3c934d740029dfece1e933f0716`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:18:32.051847 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-a2cc8429-75e7-4305-9f8c-5c0390013c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:32.158040 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1266/2520] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:18:31 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:18:32.169472 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9885ef-32bb-4bdf-8a0a-5e1ed73aab31 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:32.171839 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-9d9885ef-32bb-4bdf-8a0a-5e1ed73aab31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:32.319565 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9885ef-32bb-4bdf-8a0a-5e1ed73aab31 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:32.324602 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbfdb1b-15bc-4f3b-817d-d716bace7728 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:32.325476 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbfdb1b-15bc-4f3b-817d-d716bace7728 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:32.325757 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbfdb1b-15bc-4f3b-817d-d716bace7728 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:32.326182 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbfdb1b-15bc-4f3b-817d-d716bace7728 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:32.337083 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbfdb1b-15bc-4f3b-817d-d716bace7728 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:32.338965 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbfdb1b-15bc-4f3b-817d-d716bace7728 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:32.353789 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1255/2521] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:18:32 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:18:32.524319 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc8429-75e7-4305-9f8c-5c0390013c3a None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:32.608439 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc8429-75e7-4305-9f8c-5c0390013c3a None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:32.616688 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11774882-75ce-43f0-9992-49cca5e60990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:32.618277 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11774882-75ce-43f0-9992-49cca5e60990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:32.619004 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11774882-75ce-43f0-9992-49cca5e60990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:32.619476 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11774882-75ce-43f0-9992-49cca5e60990 admin admin] PATH_INFO: `/v3/users/7d899d048d974307820af38f7a855d93` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:32.622399 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11774882-75ce-43f0-9992-49cca5e60990 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d899d048d974307820af38f7a855d93)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:32.624642 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11774882-75ce-43f0-9992-49cca5e60990 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:32.692928 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-11774882-75ce-43f0-9992-49cca5e60990 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d899d048d974307820af38f7a855d93'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:32.702082 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-11774882-75ce-43f0-9992-49cca5e60990 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d899d048d974307820af38f7a855d93'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:32.702929 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-11774882-75ce-43f0-9992-49cca5e60990 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d899d048d974307820af38f7a855d93'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:32.703610 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-11774882-75ce-43f0-9992-49cca5e60990 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d899d048d974307820af38f7a855d93'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:32.721665 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-11774882-75ce-43f0-9992-49cca5e60990 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d899d048d974307820af38f7a855d93'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:32.741283 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1267/2522] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:18:32 2022] DELETE /identity/v3/users/7d899d048d974307820af38f7a855d93 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:18:32.746631 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961176b5-f4a8-400d-b551-c4cb9805a7a6 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:32.747196 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961176b5-f4a8-400d-b551-c4cb9805a7a6 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:32.747196 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961176b5-f4a8-400d-b551-c4cb9805a7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:32.773108 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-961176b5-f4a8-400d-b551-c4cb9805a7a6 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:18:32.774488 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-961176b5-f4a8-400d-b551-c4cb9805a7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:32.869387 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1256/2523] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:18:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:18:32.879532 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11774882-75ce-43f0-9992-49cca5e60990 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:32.881286 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-11774882-75ce-43f0-9992-49cca5e60990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:32.899390 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:18:32.976632 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11774882-75ce-43f0-9992-49cca5e60990 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:32.980968 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80065d50-ef22-48f2-89e9-3a5f34170648 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:32.981649 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80065d50-ef22-48f2-89e9-3a5f34170648 service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:32.981938 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80065d50-ef22-48f2-89e9-3a5f34170648 service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:32.982220 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80065d50-ef22-48f2-89e9-3a5f34170648 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:32.995242 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80065d50-ef22-48f2-89e9-3a5f34170648 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:32.997450 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80065d50-ef22-48f2-89e9-3a5f34170648 service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:33.015083 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1268/2524] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:18:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:18:33.433177 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961176b5-f4a8-400d-b551-c4cb9805a7a6 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:33.434641 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-961176b5-f4a8-400d-b551-c4cb9805a7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:33.449138 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961176b5-f4a8-400d-b551-c4cb9805a7a6 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:33.465949 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8455fa6-7a2d-4747-a8d1-353827e459ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:33.466957 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8455fa6-7a2d-4747-a8d1-353827e459ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:33.467119 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8455fa6-7a2d-4747-a8d1-353827e459ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:33.467396 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8455fa6-7a2d-4747-a8d1-353827e459ce admin admin] PATH_INFO: `/v3/projects/194d63fce43e4b5d86f4164b9e4266d2` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:33.469455 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8455fa6-7a2d-4747-a8d1-353827e459ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=194d63fce43e4b5d86f4164b9e4266d2)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:33.473261 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8455fa6-7a2d-4747-a8d1-353827e459ce admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:33.545988 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c8455fa6-7a2d-4747-a8d1-353827e459ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '194d63fce43e4b5d86f4164b9e4266d2', 'request_id': 'req-c8455fa6-7a2d-4747-a8d1-353827e459ce'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:33.554880 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c8455fa6-7a2d-4747-a8d1-353827e459ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '194d63fce43e4b5d86f4164b9e4266d2', 'request_id': 'req-c8455fa6-7a2d-4747-a8d1-353827e459ce'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:33.561661 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:18:33.567627 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c8455fa6-7a2d-4747-a8d1-353827e459ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '194d63fce43e4b5d86f4164b9e4266d2', 'request_id': 'req-c8455fa6-7a2d-4747-a8d1-353827e459ce'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:33.586703 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c8455fa6-7a2d-4747-a8d1-353827e459ce admin admin] The token cache is being invalidate because project 194d63fce43e4b5d86f4164b9e4266d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:18:33.587300 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c8455fa6-7a2d-4747-a8d1-353827e459ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:33.588511 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c8455fa6-7a2d-4747-a8d1-353827e459ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:33.599227 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1257/2525] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:18:33 2022] DELETE /identity/v3/projects/194d63fce43e4b5d86f4164b9e4266d2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:18:33.604446 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80065d50-ef22-48f2-89e9-3a5f34170648 service neutron] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:33.615463 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80065d50-ef22-48f2-89e9-3a5f34170648 service neutron] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:33.707240 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c0ea6d-c194-427b-b905-7927c4fb39c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:33.708325 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0ea6d-c194-427b-b905-7927c4fb39c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:33.708619 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0ea6d-c194-427b-b905-7927c4fb39c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:33.708940 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0ea6d-c194-427b-b905-7927c4fb39c0 admin admin] PATH_INFO: `/v3/users/5802d3c934d740029dfece1e933f0716` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:33.710128 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c0ea6d-c194-427b-b905-7927c4fb39c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5802d3c934d740029dfece1e933f0716)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:33.712127 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c0ea6d-c194-427b-b905-7927c4fb39c0 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:33.767091 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-20c0ea6d-c194-427b-b905-7927c4fb39c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5802d3c934d740029dfece1e933f0716'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:33.774435 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-20c0ea6d-c194-427b-b905-7927c4fb39c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5802d3c934d740029dfece1e933f0716'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:33.775177 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-20c0ea6d-c194-427b-b905-7927c4fb39c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5802d3c934d740029dfece1e933f0716'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:33.775813 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-20c0ea6d-c194-427b-b905-7927c4fb39c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5802d3c934d740029dfece1e933f0716'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:33.792177 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-20c0ea6d-c194-427b-b905-7927c4fb39c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5802d3c934d740029dfece1e933f0716'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:33.805589 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1269/2526] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:18:33 2022] DELETE /identity/v3/users/5802d3c934d740029dfece1e933f0716 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:18:34.106376 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8455fa6-7a2d-4747-a8d1-353827e459ce admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:34.108639 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-c8455fa6-7a2d-4747-a8d1-353827e459ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:34.125606 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8455fa6-7a2d-4747-a8d1-353827e459ce admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:34.197082 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb1ad5-7bd9-4810-95ed-0fafe11eb6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:34.198476 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb1ad5-7bd9-4810-95ed-0fafe11eb6e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:34.198762 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb1ad5-7bd9-4810-95ed-0fafe11eb6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:34.199037 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb1ad5-7bd9-4810-95ed-0fafe11eb6e1 admin admin] PATH_INFO: `/v3/projects/50a77592779544f6b21b40ec3e576bdc` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:34.200379 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb1ad5-7bd9-4810-95ed-0fafe11eb6e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50a77592779544f6b21b40ec3e576bdc)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:34.202379 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb1ad5-7bd9-4810-95ed-0fafe11eb6e1 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:34.254668 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a6eb1ad5-7bd9-4810-95ed-0fafe11eb6e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50a77592779544f6b21b40ec3e576bdc', 'request_id': 'req-a6eb1ad5-7bd9-4810-95ed-0fafe11eb6e1'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:34.262730 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a6eb1ad5-7bd9-4810-95ed-0fafe11eb6e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50a77592779544f6b21b40ec3e576bdc', 'request_id': 'req-a6eb1ad5-7bd9-4810-95ed-0fafe11eb6e1'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:34.269062 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a6eb1ad5-7bd9-4810-95ed-0fafe11eb6e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50a77592779544f6b21b40ec3e576bdc', 'request_id': 'req-a6eb1ad5-7bd9-4810-95ed-0fafe11eb6e1'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:34.286432 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a6eb1ad5-7bd9-4810-95ed-0fafe11eb6e1 admin admin] The token cache is being invalidate because project 50a77592779544f6b21b40ec3e576bdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:18:34.286773 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a6eb1ad5-7bd9-4810-95ed-0fafe11eb6e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:34.287491 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a6eb1ad5-7bd9-4810-95ed-0fafe11eb6e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:34.289040 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1258/2527] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:18:34 2022] DELETE /identity/v3/projects/50a77592779544f6b21b40ec3e576bdc => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:18:34.295411 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958933a3-3260-468a-b402-4b71cd101aab None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:34.295703 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958933a3-3260-468a-b402-4b71cd101aab None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:34.295983 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958933a3-3260-468a-b402-4b71cd101aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:34.319932 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-958933a3-3260-468a-b402-4b71cd101aab None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:18:34.321296 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-958933a3-3260-468a-b402-4b71cd101aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:34.349135 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:18:34.388779 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1270/2528] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:18:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:18:34.396787 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6fe94-815a-4caf-a173-6474286e73de None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:34.397393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6fe94-815a-4caf-a173-6474286e73de None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:34.397708 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6fe94-815a-4caf-a173-6474286e73de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:34.424454 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-99d6fe94-815a-4caf-a173-6474286e73de None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:18:34.425842 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-99d6fe94-815a-4caf-a173-6474286e73de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:34.433919 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1259/2529] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:18:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:18:34.438105 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958933a3-3260-468a-b402-4b71cd101aab None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:34.447971 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958933a3-3260-468a-b402-4b71cd101aab None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:34.452584 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4627dd6-bd76-4057-b03f-986073a1900b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:34.453241 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4627dd6-bd76-4057-b03f-986073a1900b admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:34.453524 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4627dd6-bd76-4057-b03f-986073a1900b admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:34.453801 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4627dd6-bd76-4057-b03f-986073a1900b admin admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:34.454521 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4627dd6-bd76-4057-b03f-986073a1900b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:18:34.454830 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4627dd6-bd76-4057-b03f-986073a1900b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:34.456560 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4627dd6-bd76-4057-b03f-986073a1900b admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:34.469328 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1271/2530] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:18:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:18:34.473500 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6fe94-815a-4caf-a173-6474286e73de None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:34.484125 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6fe94-815a-4caf-a173-6474286e73de None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:34.488772 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb6468d-c3cd-4fab-9b57-dfb371ebeadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:34.489424 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6468d-c3cd-4fab-9b57-dfb371ebeadf admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:34.489705 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6468d-c3cd-4fab-9b57-dfb371ebeadf admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:34.489979 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6468d-c3cd-4fab-9b57-dfb371ebeadf admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:34.490669 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb6468d-c3cd-4fab-9b57-dfb371ebeadf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:34.492599 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb6468d-c3cd-4fab-9b57-dfb371ebeadf admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:34.521655 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1260/2531] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:18:34 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:18:34.522892 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4627dd6-bd76-4057-b03f-986073a1900b admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:34.534206 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4627dd6-bd76-4057-b03f-986073a1900b admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:34.599107 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ded70-8628-4079-8e12-aee000c3b886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:34.599783 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ded70-8628-4079-8e12-aee000c3b886 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:34.600064 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ded70-8628-4079-8e12-aee000c3b886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:34.600366 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ded70-8628-4079-8e12-aee000c3b886 admin admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:34.601064 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ded70-8628-4079-8e12-aee000c3b886 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:34.602960 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ded70-8628-4079-8e12-aee000c3b886 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:34.624110 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1272/2532] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:18:34 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 12:18:34.628449 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb6468d-c3cd-4fab-9b57-dfb371ebeadf admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:34.639809 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb6468d-c3cd-4fab-9b57-dfb371ebeadf admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:34.644413 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376a853-8bf1-4986-8fee-9c7b0049e228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:34.645069 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376a853-8bf1-4986-8fee-9c7b0049e228 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:34.645353 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376a853-8bf1-4986-8fee-9c7b0049e228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:34.645630 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376a853-8bf1-4986-8fee-9c7b0049e228 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:34.646346 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8376a853-8bf1-4986-8fee-9c7b0049e228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:34.648039 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8376a853-8bf1-4986-8fee-9c7b0049e228 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:34.659649 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1261/2533] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:18:34.663687 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ded70-8628-4079-8e12-aee000c3b886 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:34.674559 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ded70-8628-4079-8e12-aee000c3b886 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:34.679525 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5078f9-64b3-48c3-a708-803666b5928a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:34.680257 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5078f9-64b3-48c3-a708-803666b5928a admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:34.680549 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5078f9-64b3-48c3-a708-803666b5928a admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:34.680830 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5078f9-64b3-48c3-a708-803666b5928a admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:34.681679 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5078f9-64b3-48c3-a708-803666b5928a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:34.683362 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5078f9-64b3-48c3-a708-803666b5928a admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:34.693963 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1273/2534] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:18:34.698686 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376a853-8bf1-4986-8fee-9c7b0049e228 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:34.709972 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376a853-8bf1-4986-8fee-9c7b0049e228 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:34.715958 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012e9625-103c-4faf-9a9b-c12dada9955a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:34.716928 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e9625-103c-4faf-9a9b-c12dada9955a admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:34.717199 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e9625-103c-4faf-9a9b-c12dada9955a admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:34.717524 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e9625-103c-4faf-9a9b-c12dada9955a admin admin] PATH_INFO: `/v3/projects/dab303f634304e3ca69d4f65a14df481/users/b562aa0a937242d3a2699754c6d2d51d/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:34.737254 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012e9625-103c-4faf-9a9b-c12dada9955a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dab303f634304e3ca69d4f65a14df481, user_id=b562aa0a937242d3a2699754c6d2d51d, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:34.740054 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012e9625-103c-4faf-9a9b-c12dada9955a admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:34.753788 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1262/2535] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:18:34 2022] PUT /identity/v3/projects/dab303f634304e3ca69d4f65a14df481/users/b562aa0a937242d3a2699754c6d2d51d/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:18:34.766155 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92657fe8-08b3-4b89-bd68-e35be39b7233 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:34.766705 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92657fe8-08b3-4b89-bd68-e35be39b7233 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:34.766705 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92657fe8-08b3-4b89-bd68-e35be39b7233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:34.796981 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-92657fe8-08b3-4b89-bd68-e35be39b7233 None None] MFA Rules not processed for user `b562aa0a937242d3a2699754c6d2d51d`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:18:34.798150 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-92657fe8-08b3-4b89-bd68-e35be39b7233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:34.873111 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1274/2536] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:18:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:18:34.877507 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012e9625-103c-4faf-9a9b-c12dada9955a admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:34.891485 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:18:34.944222 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012e9625-103c-4faf-9a9b-c12dada9955a admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:34.949452 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe07794e-e8af-44a2-99b3-476656fbf349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:34.950112 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07794e-e8af-44a2-99b3-476656fbf349 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:34.950399 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07794e-e8af-44a2-99b3-476656fbf349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:34.950675 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07794e-e8af-44a2-99b3-476656fbf349 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:34.951370 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe07794e-e8af-44a2-99b3-476656fbf349 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:34.953288 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe07794e-e8af-44a2-99b3-476656fbf349 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:34.978908 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1263/2537] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:18:34 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:18:34.983181 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92657fe8-08b3-4b89-bd68-e35be39b7233 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:34.994461 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92657fe8-08b3-4b89-bd68-e35be39b7233 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:35.019944 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:18:35.054403 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90367bb-4007-4d3e-b030-4ef30b4f9ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:35.055007 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90367bb-4007-4d3e-b030-4ef30b4f9ec1 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:35.055286 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90367bb-4007-4d3e-b030-4ef30b4f9ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:35.055558 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90367bb-4007-4d3e-b030-4ef30b4f9ec1 admin admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:35.056817 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90367bb-4007-4d3e-b030-4ef30b4f9ec1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:35.058859 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90367bb-4007-4d3e-b030-4ef30b4f9ec1 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:35.083016 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1275/2538] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:18:34 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:18:35.084791 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe07794e-e8af-44a2-99b3-476656fbf349 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:35.096011 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe07794e-e8af-44a2-99b3-476656fbf349 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:35.100697 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d9dda-aab4-42c6-9062-f3a5da5444ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:35.101452 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d9dda-aab4-42c6-9062-f3a5da5444ca admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:35.101746 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d9dda-aab4-42c6-9062-f3a5da5444ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:35.102118 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d9dda-aab4-42c6-9062-f3a5da5444ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:35.102975 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81d9dda-aab4-42c6-9062-f3a5da5444ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:35.105473 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81d9dda-aab4-42c6-9062-f3a5da5444ca admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:35.116452 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1264/2539] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:18:35.121467 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90367bb-4007-4d3e-b030-4ef30b4f9ec1 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:35.132196 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90367bb-4007-4d3e-b030-4ef30b4f9ec1 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:35.138169 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8216e1d-72f0-4634-8a13-7f17443d09f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:35.138886 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8216e1d-72f0-4634-8a13-7f17443d09f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:35.139151 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8216e1d-72f0-4634-8a13-7f17443d09f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:35.139425 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8216e1d-72f0-4634-8a13-7f17443d09f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:35.140150 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8216e1d-72f0-4634-8a13-7f17443d09f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:35.141799 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8216e1d-72f0-4634-8a13-7f17443d09f1 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:35.153540 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1276/2540] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:18:35.157915 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d9dda-aab4-42c6-9062-f3a5da5444ca admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:35.167991 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d9dda-aab4-42c6-9062-f3a5da5444ca admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:35.172562 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59707d28-65a1-46e6-903b-caa2386e394f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:35.173549 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59707d28-65a1-46e6-903b-caa2386e394f admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:35.173893 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59707d28-65a1-46e6-903b-caa2386e394f admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:35.174189 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59707d28-65a1-46e6-903b-caa2386e394f admin admin] PATH_INFO: `/v3/projects/ba063cf21f4e4bd6bded671b581d40d8/users/11dbaff227c04fa2b2cf508eb29adaa5/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:35.190664 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59707d28-65a1-46e6-903b-caa2386e394f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba063cf21f4e4bd6bded671b581d40d8, user_id=11dbaff227c04fa2b2cf508eb29adaa5, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:35.193410 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59707d28-65a1-46e6-903b-caa2386e394f admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:35.207038 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1265/2541] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:18:35 2022] PUT /identity/v3/projects/ba063cf21f4e4bd6bded671b581d40d8/users/11dbaff227c04fa2b2cf508eb29adaa5/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:18:35.217673 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf61b8-49c8-4f5d-981d-3358550d0ce8 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:35.217972 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf61b8-49c8-4f5d-981d-3358550d0ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:35.218246 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf61b8-49c8-4f5d-981d-3358550d0ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:35.250869 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-70bf61b8-49c8-4f5d-981d-3358550d0ce8 None None] MFA Rules not processed for user `11dbaff227c04fa2b2cf508eb29adaa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:18:35.252106 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-70bf61b8-49c8-4f5d-981d-3358550d0ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:35.319674 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1277/2542] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:18:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:18:35.324560 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59707d28-65a1-46e6-903b-caa2386e394f admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:35.392114 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59707d28-65a1-46e6-903b-caa2386e394f admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:35.396797 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7776e-375c-481e-8842-097f7bcb4df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:35.397453 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7776e-375c-481e-8842-097f7bcb4df3 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:35.397735 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7776e-375c-481e-8842-097f7bcb4df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:35.398009 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7776e-375c-481e-8842-097f7bcb4df3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:35.398702 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e7776e-375c-481e-8842-097f7bcb4df3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:35.400945 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e7776e-375c-481e-8842-097f7bcb4df3 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:35.427836 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1266/2543] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:18:35 2022] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:18:35.433022 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf61b8-49c8-4f5d-981d-3358550d0ce8 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:35.445775 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf61b8-49c8-4f5d-981d-3358550d0ce8 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:35.508907 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf60f43-ab59-438d-b2ba-5395330a3e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:35.509734 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf60f43-ab59-438d-b2ba-5395330a3e8a admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:35.510019 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf60f43-ab59-438d-b2ba-5395330a3e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:35.510299 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf60f43-ab59-438d-b2ba-5395330a3e8a admin admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:35.510993 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf60f43-ab59-438d-b2ba-5395330a3e8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:35.512962 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf60f43-ab59-438d-b2ba-5395330a3e8a admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:35.532918 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1278/2544] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:18:35 2022] POST /identity/v3/users => generated 296 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 12:18:35.537179 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7776e-375c-481e-8842-097f7bcb4df3 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:35.548146 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7776e-375c-481e-8842-097f7bcb4df3 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:35.552896 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be437c-d999-45d5-9fe5-45132520d309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:35.553574 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be437c-d999-45d5-9fe5-45132520d309 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:35.553864 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be437c-d999-45d5-9fe5-45132520d309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:35.554140 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be437c-d999-45d5-9fe5-45132520d309 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:35.554870 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89be437c-d999-45d5-9fe5-45132520d309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:35.557423 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89be437c-d999-45d5-9fe5-45132520d309 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:35.568461 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1267/2545] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:18:35.572765 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf60f43-ab59-438d-b2ba-5395330a3e8a admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:35.584207 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf60f43-ab59-438d-b2ba-5395330a3e8a admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:35.589140 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbffd113-2486-4942-a15f-c89d5af31892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:35.590046 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffd113-2486-4942-a15f-c89d5af31892 admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:35.590331 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffd113-2486-4942-a15f-c89d5af31892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:35.590608 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffd113-2486-4942-a15f-c89d5af31892 admin admin] PATH_INFO: `/v3/projects/6e3613c9d0054295b8e2e53e7d11df20/users/a5c7af44998b43d0852bbe372d5ffe92/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:35.606960 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbffd113-2486-4942-a15f-c89d5af31892 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e3613c9d0054295b8e2e53e7d11df20, user_id=a5c7af44998b43d0852bbe372d5ffe92, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:35.609715 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbffd113-2486-4942-a15f-c89d5af31892 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:35.618663 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:18:35.625460 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1279/2546] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:18:35 2022] PUT /identity/v3/projects/6e3613c9d0054295b8e2e53e7d11df20/users/a5c7af44998b43d0852bbe372d5ffe92/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:18:35.629510 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be437c-d999-45d5-9fe5-45132520d309 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:35.640229 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be437c-d999-45d5-9fe5-45132520d309 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:35.675248 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:18:35.699600 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e176b4-742e-4b56-a763-0674199cd0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:35.700333 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e176b4-742e-4b56-a763-0674199cd0f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:35.700625 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e176b4-742e-4b56-a763-0674199cd0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:35.700915 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e176b4-742e-4b56-a763-0674199cd0f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:35.701643 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e176b4-742e-4b56-a763-0674199cd0f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:35.703286 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e176b4-742e-4b56-a763-0674199cd0f0 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:35.715149 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1268/2547] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:18:35.719458 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbffd113-2486-4942-a15f-c89d5af31892 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:35.730381 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbffd113-2486-4942-a15f-c89d5af31892 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:35.735018 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326636f-2754-4519-8eab-6459fae6a27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:35.735891 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326636f-2754-4519-8eab-6459fae6a27e admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:35.736192 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326636f-2754-4519-8eab-6459fae6a27e admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:35.736478 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326636f-2754-4519-8eab-6459fae6a27e admin admin] PATH_INFO: `/v3/projects/6e3613c9d0054295b8e2e53e7d11df20/users/a5c7af44998b43d0852bbe372d5ffe92/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:35.738419 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e326636f-2754-4519-8eab-6459fae6a27e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e3613c9d0054295b8e2e53e7d11df20, user_id=a5c7af44998b43d0852bbe372d5ffe92, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:35.741253 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e326636f-2754-4519-8eab-6459fae6a27e admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:35.752751 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1280/2548] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:18:35 2022] PUT /identity/v3/projects/6e3613c9d0054295b8e2e53e7d11df20/users/a5c7af44998b43d0852bbe372d5ffe92/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:18:35.763769 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c5e5b-157e-43d5-81a4-d2f841ef5441 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:35.764085 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c5e5b-157e-43d5-81a4-d2f841ef5441 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:35.764393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c5e5b-157e-43d5-81a4-d2f841ef5441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:35.791702 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-141c5e5b-157e-43d5-81a4-d2f841ef5441 None None] MFA Rules not processed for user `a5c7af44998b43d0852bbe372d5ffe92`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:18:35.792950 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-141c5e5b-157e-43d5-81a4-d2f841ef5441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:35.865211 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1269/2549] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:18:35 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:18:35.877029 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326636f-2754-4519-8eab-6459fae6a27e admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:35.879913 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-e326636f-2754-4519-8eab-6459fae6a27e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:35.975725 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326636f-2754-4519-8eab-6459fae6a27e admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:35.980526 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d2174-842b-4acf-92c4-f8ac36672802 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:35.981481 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d2174-842b-4acf-92c4-f8ac36672802 service cinder] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:35.981665 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d2174-842b-4acf-92c4-f8ac36672802 service cinder] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:35.982001 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d2174-842b-4acf-92c4-f8ac36672802 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:35.997371 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4d2174-842b-4acf-92c4-f8ac36672802 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:35.998950 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4d2174-842b-4acf-92c4-f8ac36672802 service cinder] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:36.010074 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1281/2550] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:18:35 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:18:36.061468 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c5e5b-157e-43d5-81a4-d2f841ef5441 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:36.062925 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-141c5e5b-157e-43d5-81a4-d2f841ef5441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:36.080061 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c5e5b-157e-43d5-81a4-d2f841ef5441 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:36.084549 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce15bfb4-2f1a-4986-83a5-707318ecea04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:36.085617 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15bfb4-2f1a-4986-83a5-707318ecea04 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:36.085617 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15bfb4-2f1a-4986-83a5-707318ecea04 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:36.085851 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15bfb4-2f1a-4986-83a5-707318ecea04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:36.151858 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce15bfb4-2f1a-4986-83a5-707318ecea04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:36.153468 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce15bfb4-2f1a-4986-83a5-707318ecea04 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:36.164101 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1270/2551] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:18:36 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:18:39.176163 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d2174-842b-4acf-92c4-f8ac36672802 service cinder] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:39.247900 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d2174-842b-4acf-92c4-f8ac36672802 service cinder] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:39.254759 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eba184f-4d18-4c32-9f77-535bc6903b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:39.255639 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba184f-4d18-4c32-9f77-535bc6903b45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:39.255919 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba184f-4d18-4c32-9f77-535bc6903b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:39.256222 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba184f-4d18-4c32-9f77-535bc6903b45 admin admin] PATH_INFO: `/v3/users/b562aa0a937242d3a2699754c6d2d51d` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:39.257398 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eba184f-4d18-4c32-9f77-535bc6903b45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b562aa0a937242d3a2699754c6d2d51d)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:39.259949 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eba184f-4d18-4c32-9f77-535bc6903b45 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:39.307667 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-5eba184f-4d18-4c32-9f77-535bc6903b45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b562aa0a937242d3a2699754c6d2d51d'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:39.314663 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-5eba184f-4d18-4c32-9f77-535bc6903b45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b562aa0a937242d3a2699754c6d2d51d'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:39.315326 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-5eba184f-4d18-4c32-9f77-535bc6903b45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b562aa0a937242d3a2699754c6d2d51d'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:39.315924 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-5eba184f-4d18-4c32-9f77-535bc6903b45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b562aa0a937242d3a2699754c6d2d51d'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:39.328120 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-5eba184f-4d18-4c32-9f77-535bc6903b45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b562aa0a937242d3a2699754c6d2d51d'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:39.343589 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1282/2552] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:18:39 2022] DELETE /identity/v3/users/b562aa0a937242d3a2699754c6d2d51d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:18:39.348353 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b630fc3-0323-48e5-b24d-8882ec9585a8 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:39.348833 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b630fc3-0323-48e5-b24d-8882ec9585a8 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:39.349145 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b630fc3-0323-48e5-b24d-8882ec9585a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:39.366274 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-8b630fc3-0323-48e5-b24d-8882ec9585a8 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:18:39.367462 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-8b630fc3-0323-48e5-b24d-8882ec9585a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:39.421398 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:18:39.430981 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1271/2553] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:18:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:18:39.441960 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eba184f-4d18-4c32-9f77-535bc6903b45 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:39.443478 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-5eba184f-4d18-4c32-9f77-535bc6903b45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:39.454866 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:18:39.504814 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eba184f-4d18-4c32-9f77-535bc6903b45 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:39.508534 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9504f22-5538-42b9-a622-b4b8013a7052 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:39.509898 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9504f22-5538-42b9-a622-b4b8013a7052 service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:39.510208 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9504f22-5538-42b9-a622-b4b8013a7052 service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:39.510489 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9504f22-5538-42b9-a622-b4b8013a7052 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:39.520720 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9504f22-5538-42b9-a622-b4b8013a7052 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:39.522288 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9504f22-5538-42b9-a622-b4b8013a7052 service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:39.532486 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1283/2554] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:18:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:18:39.806717 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b630fc3-0323-48e5-b24d-8882ec9585a8 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:39.808489 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-8b630fc3-0323-48e5-b24d-8882ec9585a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:39.821424 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b630fc3-0323-48e5-b24d-8882ec9585a8 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:39.826762 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485761b1-b6ed-48d5-b0db-c2f38bab14b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:39.828345 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485761b1-b6ed-48d5-b0db-c2f38bab14b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:39.828639 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485761b1-b6ed-48d5-b0db-c2f38bab14b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:39.829011 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485761b1-b6ed-48d5-b0db-c2f38bab14b6 admin admin] PATH_INFO: `/v3/projects/dab303f634304e3ca69d4f65a14df481` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:39.830115 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485761b1-b6ed-48d5-b0db-c2f38bab14b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dab303f634304e3ca69d4f65a14df481)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:39.832221 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485761b1-b6ed-48d5-b0db-c2f38bab14b6 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:39.879779 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-485761b1-b6ed-48d5-b0db-c2f38bab14b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dab303f634304e3ca69d4f65a14df481', 'request_id': 'req-485761b1-b6ed-48d5-b0db-c2f38bab14b6'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:39.887704 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-485761b1-b6ed-48d5-b0db-c2f38bab14b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dab303f634304e3ca69d4f65a14df481', 'request_id': 'req-485761b1-b6ed-48d5-b0db-c2f38bab14b6'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:39.893530 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-485761b1-b6ed-48d5-b0db-c2f38bab14b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dab303f634304e3ca69d4f65a14df481', 'request_id': 'req-485761b1-b6ed-48d5-b0db-c2f38bab14b6'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:39.905198 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-485761b1-b6ed-48d5-b0db-c2f38bab14b6 admin admin] The token cache is being invalidate because project dab303f634304e3ca69d4f65a14df481 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:18:39.905485 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-485761b1-b6ed-48d5-b0db-c2f38bab14b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:39.906136 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-485761b1-b6ed-48d5-b0db-c2f38bab14b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:39.907653 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1272/2555] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:18:39 2022] DELETE /identity/v3/projects/dab303f634304e3ca69d4f65a14df481 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:18:39.912074 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9504f22-5538-42b9-a622-b4b8013a7052 service neutron] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:39.921717 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9504f22-5538-42b9-a622-b4b8013a7052 service neutron] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:39.978090 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c9358f-5d70-4a4a-b2a7-5dd69c84dc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:39.978962 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9358f-5d70-4a4a-b2a7-5dd69c84dc20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:39.979245 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9358f-5d70-4a4a-b2a7-5dd69c84dc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:39.979521 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9358f-5d70-4a4a-b2a7-5dd69c84dc20 admin admin] PATH_INFO: `/v3/users/11dbaff227c04fa2b2cf508eb29adaa5` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:39.981105 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c9358f-5d70-4a4a-b2a7-5dd69c84dc20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11dbaff227c04fa2b2cf508eb29adaa5)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:39.983012 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c9358f-5d70-4a4a-b2a7-5dd69c84dc20 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:40.028978 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-41c9358f-5d70-4a4a-b2a7-5dd69c84dc20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11dbaff227c04fa2b2cf508eb29adaa5'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:40.036089 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-41c9358f-5d70-4a4a-b2a7-5dd69c84dc20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11dbaff227c04fa2b2cf508eb29adaa5'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:40.036805 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-41c9358f-5d70-4a4a-b2a7-5dd69c84dc20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11dbaff227c04fa2b2cf508eb29adaa5'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:40.037411 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-41c9358f-5d70-4a4a-b2a7-5dd69c84dc20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11dbaff227c04fa2b2cf508eb29adaa5'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:40.049317 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-41c9358f-5d70-4a4a-b2a7-5dd69c84dc20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11dbaff227c04fa2b2cf508eb29adaa5'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:40.062823 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1284/2556] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:18:39 2022] DELETE /identity/v3/users/11dbaff227c04fa2b2cf508eb29adaa5 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:18:40.350626 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485761b1-b6ed-48d5-b0db-c2f38bab14b6 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:40.353736 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-485761b1-b6ed-48d5-b0db-c2f38bab14b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:40.369809 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485761b1-b6ed-48d5-b0db-c2f38bab14b6 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:40.427520 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3648077-f798-4f82-8f13-fd5ab0ad0a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:40.428355 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3648077-f798-4f82-8f13-fd5ab0ad0a29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:40.428644 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3648077-f798-4f82-8f13-fd5ab0ad0a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:40.428921 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3648077-f798-4f82-8f13-fd5ab0ad0a29 admin admin] PATH_INFO: `/v3/projects/ba063cf21f4e4bd6bded671b581d40d8` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:40.430093 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3648077-f798-4f82-8f13-fd5ab0ad0a29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba063cf21f4e4bd6bded671b581d40d8)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:40.432726 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3648077-f798-4f82-8f13-fd5ab0ad0a29 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:40.477814 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-e3648077-f798-4f82-8f13-fd5ab0ad0a29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba063cf21f4e4bd6bded671b581d40d8', 'request_id': 'req-e3648077-f798-4f82-8f13-fd5ab0ad0a29'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:40.486319 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-e3648077-f798-4f82-8f13-fd5ab0ad0a29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba063cf21f4e4bd6bded671b581d40d8', 'request_id': 'req-e3648077-f798-4f82-8f13-fd5ab0ad0a29'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:40.491962 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-e3648077-f798-4f82-8f13-fd5ab0ad0a29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba063cf21f4e4bd6bded671b581d40d8', 'request_id': 'req-e3648077-f798-4f82-8f13-fd5ab0ad0a29'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:40.503444 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-e3648077-f798-4f82-8f13-fd5ab0ad0a29 admin admin] The token cache is being invalidate because project ba063cf21f4e4bd6bded671b581d40d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:18:40.503728 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-e3648077-f798-4f82-8f13-fd5ab0ad0a29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:40.504373 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-e3648077-f798-4f82-8f13-fd5ab0ad0a29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:40.505899 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1273/2557] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:18:40 2022] DELETE /identity/v3/projects/ba063cf21f4e4bd6bded671b581d40d8 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:18:40.510525 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c9358f-5d70-4a4a-b2a7-5dd69c84dc20 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:40.511982 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-41c9358f-5d70-4a4a-b2a7-5dd69c84dc20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:40.525389 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c9358f-5d70-4a4a-b2a7-5dd69c84dc20 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:40.558136 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:18:40.598148 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5436ca3-4747-4005-add5-9f5dfd2ee763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:40.599053 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5436ca3-4747-4005-add5-9f5dfd2ee763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:40.599337 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5436ca3-4747-4005-add5-9f5dfd2ee763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:40.599636 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5436ca3-4747-4005-add5-9f5dfd2ee763 admin admin] PATH_INFO: `/v3/users/a5c7af44998b43d0852bbe372d5ffe92` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:40.600859 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5436ca3-4747-4005-add5-9f5dfd2ee763 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5c7af44998b43d0852bbe372d5ffe92)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:40.602827 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5436ca3-4747-4005-add5-9f5dfd2ee763 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:40.654571 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-c5436ca3-4747-4005-add5-9f5dfd2ee763 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5c7af44998b43d0852bbe372d5ffe92'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:40.661387 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-c5436ca3-4747-4005-add5-9f5dfd2ee763 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5c7af44998b43d0852bbe372d5ffe92'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:40.662038 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-c5436ca3-4747-4005-add5-9f5dfd2ee763 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5c7af44998b43d0852bbe372d5ffe92'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:40.662637 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-c5436ca3-4747-4005-add5-9f5dfd2ee763 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5c7af44998b43d0852bbe372d5ffe92'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:40.674723 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-c5436ca3-4747-4005-add5-9f5dfd2ee763 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5c7af44998b43d0852bbe372d5ffe92'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:40.688409 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1285/2558] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:18:40 2022] DELETE /identity/v3/users/a5c7af44998b43d0852bbe372d5ffe92 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:18:40.975573 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3648077-f798-4f82-8f13-fd5ab0ad0a29 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:40.977024 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-e3648077-f798-4f82-8f13-fd5ab0ad0a29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:40.990182 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3648077-f798-4f82-8f13-fd5ab0ad0a29 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:40.999162 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:18:41.049556 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f062fc-cf12-4340-9c04-90774b5fea09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:41.050414 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f062fc-cf12-4340-9c04-90774b5fea09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:41.050704 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f062fc-cf12-4340-9c04-90774b5fea09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:41.050986 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f062fc-cf12-4340-9c04-90774b5fea09 admin admin] PATH_INFO: `/v3/projects/6e3613c9d0054295b8e2e53e7d11df20` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:41.052174 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f062fc-cf12-4340-9c04-90774b5fea09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e3613c9d0054295b8e2e53e7d11df20)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:41.054140 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f062fc-cf12-4340-9c04-90774b5fea09 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:41.100134 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-03f062fc-cf12-4340-9c04-90774b5fea09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e3613c9d0054295b8e2e53e7d11df20', 'request_id': 'req-03f062fc-cf12-4340-9c04-90774b5fea09'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:41.108849 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-03f062fc-cf12-4340-9c04-90774b5fea09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e3613c9d0054295b8e2e53e7d11df20', 'request_id': 'req-03f062fc-cf12-4340-9c04-90774b5fea09'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:41.115060 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-03f062fc-cf12-4340-9c04-90774b5fea09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e3613c9d0054295b8e2e53e7d11df20', 'request_id': 'req-03f062fc-cf12-4340-9c04-90774b5fea09'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:41.126849 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-03f062fc-cf12-4340-9c04-90774b5fea09 admin admin] The token cache is being invalidate because project 6e3613c9d0054295b8e2e53e7d11df20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:18:41.127139 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-03f062fc-cf12-4340-9c04-90774b5fea09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:41.127790 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-03f062fc-cf12-4340-9c04-90774b5fea09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:41.129360 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1274/2559] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:18:40 2022] DELETE /identity/v3/projects/6e3613c9d0054295b8e2e53e7d11df20 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:18:41.135914 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12854764-b101-4c6b-a9e3-cfdd2582f865 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:41.136233 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12854764-b101-4c6b-a9e3-cfdd2582f865 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:41.136521 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12854764-b101-4c6b-a9e3-cfdd2582f865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:41.156181 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-12854764-b101-4c6b-a9e3-cfdd2582f865 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:18:41.157405 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-12854764-b101-4c6b-a9e3-cfdd2582f865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:41.220377 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1286/2560] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:18:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:18:41.284506 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d8528-cadd-4837-885f-36be6ed1bbfe None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:41.284794 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d8528-cadd-4837-885f-36be6ed1bbfe None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:41.285072 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d8528-cadd-4837-885f-36be6ed1bbfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:41.304118 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-6a5d8528-cadd-4837-885f-36be6ed1bbfe None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:18:41.305296 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-6a5d8528-cadd-4837-885f-36be6ed1bbfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:41.314443 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1275/2561] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:18:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:18:41.321442 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12854764-b101-4c6b-a9e3-cfdd2582f865 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:41.331510 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12854764-b101-4c6b-a9e3-cfdd2582f865 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:41.336570 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6d229-75a1-4fad-be1d-a95ab707d08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:41.337270 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6d229-75a1-4fad-be1d-a95ab707d08f admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:41.337851 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6d229-75a1-4fad-be1d-a95ab707d08f admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:41.338745 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6d229-75a1-4fad-be1d-a95ab707d08f admin admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:41.339551 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf6d229-75a1-4fad-be1d-a95ab707d08f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:18:41.339865 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf6d229-75a1-4fad-be1d-a95ab707d08f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:41.341660 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf6d229-75a1-4fad-be1d-a95ab707d08f admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:41.361941 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1287/2562] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:18:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:18:41.363217 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d8528-cadd-4837-885f-36be6ed1bbfe None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:41.371648 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d8528-cadd-4837-885f-36be6ed1bbfe None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:41.377098 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9a5bd-052c-4638-bd73-212999987411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:41.377766 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9a5bd-052c-4638-bd73-212999987411 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:41.378110 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9a5bd-052c-4638-bd73-212999987411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:41.378302 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9a5bd-052c-4638-bd73-212999987411 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:41.378999 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9a5bd-052c-4638-bd73-212999987411 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:41.381004 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9a5bd-052c-4638-bd73-212999987411 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:41.413052 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1276/2563] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:18:41 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:18:41.418114 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6d229-75a1-4fad-be1d-a95ab707d08f admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:41.430330 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6d229-75a1-4fad-be1d-a95ab707d08f admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:41.468711 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:18:41.498084 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a5cb4-cca7-4c0d-8268-6c7883d95d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:41.498889 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a5cb4-cca7-4c0d-8268-6c7883d95d45 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:41.499245 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a5cb4-cca7-4c0d-8268-6c7883d95d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:41.499654 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a5cb4-cca7-4c0d-8268-6c7883d95d45 admin admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:41.500536 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2a5cb4-cca7-4c0d-8268-6c7883d95d45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:41.502441 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2a5cb4-cca7-4c0d-8268-6c7883d95d45 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:41.526565 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1288/2564] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:18:41 2022] POST /identity/v3/users => generated 290 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:18:41.528670 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9a5bd-052c-4638-bd73-212999987411 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:41.541478 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9a5bd-052c-4638-bd73-212999987411 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:41.546862 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae319b8-ff75-4baa-9620-9deb0af3d842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:41.547771 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae319b8-ff75-4baa-9620-9deb0af3d842 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:41.548330 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae319b8-ff75-4baa-9620-9deb0af3d842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:41.548685 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae319b8-ff75-4baa-9620-9deb0af3d842 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:41.549725 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae319b8-ff75-4baa-9620-9deb0af3d842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:41.551506 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae319b8-ff75-4baa-9620-9deb0af3d842 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:41.563900 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1277/2565] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:18:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:18:41.568016 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a5cb4-cca7-4c0d-8268-6c7883d95d45 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:41.579562 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a5cb4-cca7-4c0d-8268-6c7883d95d45 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:41.584249 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7e759-547e-4e89-aa4a-ac5be40f38aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:41.584923 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7e759-547e-4e89-aa4a-ac5be40f38aa admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:41.585212 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7e759-547e-4e89-aa4a-ac5be40f38aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:41.585510 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7e759-547e-4e89-aa4a-ac5be40f38aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:41.586219 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c7e759-547e-4e89-aa4a-ac5be40f38aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:41.588467 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c7e759-547e-4e89-aa4a-ac5be40f38aa admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:41.600149 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1289/2566] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:18:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 12:18:41.605369 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae319b8-ff75-4baa-9620-9deb0af3d842 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:41.616687 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae319b8-ff75-4baa-9620-9deb0af3d842 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:41.622242 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30724f5-f9cb-4971-b0d5-cc97f7369e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:41.623185 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30724f5-f9cb-4971-b0d5-cc97f7369e28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:41.623467 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30724f5-f9cb-4971-b0d5-cc97f7369e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:41.623741 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30724f5-f9cb-4971-b0d5-cc97f7369e28 admin admin] PATH_INFO: `/v3/projects/044c34207eb04c8ab5a65229ff5c0757/users/fe73921ab9a046fda038fdcc07a6ba5f/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:41.639923 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30724f5-f9cb-4971-b0d5-cc97f7369e28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=044c34207eb04c8ab5a65229ff5c0757, user_id=fe73921ab9a046fda038fdcc07a6ba5f, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:41.642623 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30724f5-f9cb-4971-b0d5-cc97f7369e28 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:41.656118 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1278/2567] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:18:41 2022] PUT /identity/v3/projects/044c34207eb04c8ab5a65229ff5c0757/users/fe73921ab9a046fda038fdcc07a6ba5f/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:18:41.667928 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cba7fd-52ca-49c5-bc9f-70a0dc83bcff None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:41.668259 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cba7fd-52ca-49c5-bc9f-70a0dc83bcff None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:41.668545 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cba7fd-52ca-49c5-bc9f-70a0dc83bcff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:41.694181 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-e7cba7fd-52ca-49c5-bc9f-70a0dc83bcff None None] MFA Rules not processed for user `fe73921ab9a046fda038fdcc07a6ba5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:18:41.695386 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-e7cba7fd-52ca-49c5-bc9f-70a0dc83bcff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:41.758439 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1290/2568] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:18:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:18:41.763628 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30724f5-f9cb-4971-b0d5-cc97f7369e28 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:41.808538 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:18:41.830553 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30724f5-f9cb-4971-b0d5-cc97f7369e28 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:41.835308 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed30a1da-62c0-4905-b7b1-acd08554ba54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:41.835972 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30a1da-62c0-4905-b7b1-acd08554ba54 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:41.836289 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30a1da-62c0-4905-b7b1-acd08554ba54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:41.836571 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30a1da-62c0-4905-b7b1-acd08554ba54 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:41.837777 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed30a1da-62c0-4905-b7b1-acd08554ba54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:41.839998 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed30a1da-62c0-4905-b7b1-acd08554ba54 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:41.867141 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1279/2569] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:18:41 2022] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:18:41.871916 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cba7fd-52ca-49c5-bc9f-70a0dc83bcff None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:41.882753 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cba7fd-52ca-49c5-bc9f-70a0dc83bcff None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:41.943274 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5dc35-84fc-49f5-825a-ff959a5822ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:41.943961 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5dc35-84fc-49f5-825a-ff959a5822ac admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:41.944291 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5dc35-84fc-49f5-825a-ff959a5822ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:41.944573 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5dc35-84fc-49f5-825a-ff959a5822ac admin admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:41.945276 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db5dc35-84fc-49f5-825a-ff959a5822ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:41.947911 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db5dc35-84fc-49f5-825a-ff959a5822ac admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:41.968775 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1291/2570] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:18:41 2022] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:18:41.972769 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed30a1da-62c0-4905-b7b1-acd08554ba54 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:41.983270 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed30a1da-62c0-4905-b7b1-acd08554ba54 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:41.987940 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5808d-0270-4b77-bee7-140ff9c87389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:41.988636 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5808d-0270-4b77-bee7-140ff9c87389 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:41.988922 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5808d-0270-4b77-bee7-140ff9c87389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:41.989233 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5808d-0270-4b77-bee7-140ff9c87389 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:41.989974 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b5808d-0270-4b77-bee7-140ff9c87389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:41.991554 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b5808d-0270-4b77-bee7-140ff9c87389 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:42.002793 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1280/2571] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:18:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:18:42.006936 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5dc35-84fc-49f5-825a-ff959a5822ac admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:42.017726 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5dc35-84fc-49f5-825a-ff959a5822ac admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:42.022279 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c33b6-4ee8-492b-8252-3cff361d8b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:42.023158 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c33b6-4ee8-492b-8252-3cff361d8b05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:42.023444 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c33b6-4ee8-492b-8252-3cff361d8b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:42.023721 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c33b6-4ee8-492b-8252-3cff361d8b05 admin admin] PATH_INFO: `/v3/projects/2babb25d46f24e64a6e62605d46fb02b/users/d4969b6aac014a359621e46a0efd347c/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:42.038419 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550c33b6-4ee8-492b-8252-3cff361d8b05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2babb25d46f24e64a6e62605d46fb02b, user_id=d4969b6aac014a359621e46a0efd347c, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:42.041926 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550c33b6-4ee8-492b-8252-3cff361d8b05 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:42.054390 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1292/2572] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:18:42 2022] PUT /identity/v3/projects/2babb25d46f24e64a6e62605d46fb02b/users/d4969b6aac014a359621e46a0efd347c/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:18:42.058906 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5808d-0270-4b77-bee7-140ff9c87389 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:42.068746 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5808d-0270-4b77-bee7-140ff9c87389 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:42.124531 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb4bbe-ad69-44a0-896d-ffc399d07d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:42.125195 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb4bbe-ad69-44a0-896d-ffc399d07d38 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:42.125478 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb4bbe-ad69-44a0-896d-ffc399d07d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:42.125775 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb4bbe-ad69-44a0-896d-ffc399d07d38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:42.126508 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb4bbe-ad69-44a0-896d-ffc399d07d38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:42.128222 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb4bbe-ad69-44a0-896d-ffc399d07d38 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:42.138210 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1281/2573] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:18:42.142611 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c33b6-4ee8-492b-8252-3cff361d8b05 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:42.153408 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c33b6-4ee8-492b-8252-3cff361d8b05 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:42.158071 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead71533-8bcd-4fd4-8d2a-0f2862df4a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:42.158959 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead71533-8bcd-4fd4-8d2a-0f2862df4a54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:42.159247 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead71533-8bcd-4fd4-8d2a-0f2862df4a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:42.159526 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead71533-8bcd-4fd4-8d2a-0f2862df4a54 admin admin] PATH_INFO: `/v3/projects/2babb25d46f24e64a6e62605d46fb02b/users/d4969b6aac014a359621e46a0efd347c/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:42.161546 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead71533-8bcd-4fd4-8d2a-0f2862df4a54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2babb25d46f24e64a6e62605d46fb02b, user_id=d4969b6aac014a359621e46a0efd347c, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:42.164191 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead71533-8bcd-4fd4-8d2a-0f2862df4a54 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:42.170623 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:18:42.177034 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1293/2574] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:18:42 2022] PUT /identity/v3/projects/2babb25d46f24e64a6e62605d46fb02b/users/d4969b6aac014a359621e46a0efd347c/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:18:42.189132 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12962b25-e299-4fc1-8283-51bcf4af6fc4 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:42.189431 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12962b25-e299-4fc1-8283-51bcf4af6fc4 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:42.189711 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12962b25-e299-4fc1-8283-51bcf4af6fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:42.215345 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-12962b25-e299-4fc1-8283-51bcf4af6fc4 None None] MFA Rules not processed for user `d4969b6aac014a359621e46a0efd347c`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:18:42.216580 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-12962b25-e299-4fc1-8283-51bcf4af6fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:42.284857 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1282/2575] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:18:42 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:18:42.296063 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead71533-8bcd-4fd4-8d2a-0f2862df4a54 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:42.297806 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-ead71533-8bcd-4fd4-8d2a-0f2862df4a54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:42.354898 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead71533-8bcd-4fd4-8d2a-0f2862df4a54 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:42.358812 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98fa9d-5c7e-483f-8a9c-b838e7660273 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:42.359453 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98fa9d-5c7e-483f-8a9c-b838e7660273 service cinder] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:42.359738 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98fa9d-5c7e-483f-8a9c-b838e7660273 service cinder] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:42.360011 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98fa9d-5c7e-483f-8a9c-b838e7660273 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:42.369139 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df98fa9d-5c7e-483f-8a9c-b838e7660273 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:42.370596 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df98fa9d-5c7e-483f-8a9c-b838e7660273 service cinder] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:42.379963 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1294/2576] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:18:42 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:18:42.696433 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12962b25-e299-4fc1-8283-51bcf4af6fc4 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:42.698615 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-12962b25-e299-4fc1-8283-51bcf4af6fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:42.735903 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:18:42.761875 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98fa9d-5c7e-483f-8a9c-b838e7660273 service cinder] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:42.766069 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12962b25-e299-4fc1-8283-51bcf4af6fc4 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:42.769847 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b449f1d-6738-4f35-a1e9-1ed44f9dff31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:42.770535 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b449f1d-6738-4f35-a1e9-1ed44f9dff31 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:42.770819 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b449f1d-6738-4f35-a1e9-1ed44f9dff31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:42.771095 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b449f1d-6738-4f35-a1e9-1ed44f9dff31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:42.772864 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-0b449f1d-6738-4f35-a1e9-1ed44f9dff31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:42.828727 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98fa9d-5c7e-483f-8a9c-b838e7660273 service cinder] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:42.833775 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e979d8da-cd43-46ce-9fba-df958af53c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:42.834650 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e979d8da-cd43-46ce-9fba-df958af53c8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:42.834935 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e979d8da-cd43-46ce-9fba-df958af53c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:42.835207 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e979d8da-cd43-46ce-9fba-df958af53c8a admin admin] PATH_INFO: `/v3/users/fe73921ab9a046fda038fdcc07a6ba5f` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:42.836622 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e979d8da-cd43-46ce-9fba-df958af53c8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe73921ab9a046fda038fdcc07a6ba5f)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:42.838689 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e979d8da-cd43-46ce-9fba-df958af53c8a admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:42.843587 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b449f1d-6738-4f35-a1e9-1ed44f9dff31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:42.845100 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b449f1d-6738-4f35-a1e9-1ed44f9dff31 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:42.863153 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1283/2577] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:18:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:18:42.893243 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-e979d8da-cd43-46ce-9fba-df958af53c8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe73921ab9a046fda038fdcc07a6ba5f'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:42.900586 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-e979d8da-cd43-46ce-9fba-df958af53c8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe73921ab9a046fda038fdcc07a6ba5f'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:42.901453 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-e979d8da-cd43-46ce-9fba-df958af53c8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe73921ab9a046fda038fdcc07a6ba5f'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:42.902159 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-e979d8da-cd43-46ce-9fba-df958af53c8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe73921ab9a046fda038fdcc07a6ba5f'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:42.914783 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-e979d8da-cd43-46ce-9fba-df958af53c8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe73921ab9a046fda038fdcc07a6ba5f'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:42.928007 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1295/2578] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:18:42 2022] DELETE /identity/v3/users/fe73921ab9a046fda038fdcc07a6ba5f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:18:42.933166 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f3a3a-0d95-40ec-ab6e-56aca587ffb2 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:42.933453 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f3a3a-0d95-40ec-ab6e-56aca587ffb2 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:42.933731 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f3a3a-0d95-40ec-ab6e-56aca587ffb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:42.951393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-b43f3a3a-0d95-40ec-ab6e-56aca587ffb2 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:18:42.952639 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b43f3a3a-0d95-40ec-ab6e-56aca587ffb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:43.024009 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1284/2579] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:18:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:18:43.035250 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e979d8da-cd43-46ce-9fba-df958af53c8a admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:43.037285 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-e979d8da-cd43-46ce-9fba-df958af53c8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:43.063096 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:18:43.100584 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e979d8da-cd43-46ce-9fba-df958af53c8a admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:43.104771 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99050b4-b1a1-48d4-8bd0-022fda96126c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:43.105683 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99050b4-b1a1-48d4-8bd0-022fda96126c service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:43.105964 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99050b4-b1a1-48d4-8bd0-022fda96126c service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:43.106240 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99050b4-b1a1-48d4-8bd0-022fda96126c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:43.118443 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99050b4-b1a1-48d4-8bd0-022fda96126c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:43.120550 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99050b4-b1a1-48d4-8bd0-022fda96126c service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:43.130765 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1296/2580] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:18:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 12:18:43.453609 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f3a3a-0d95-40ec-ab6e-56aca587ffb2 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:43.455141 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b43f3a3a-0d95-40ec-ab6e-56aca587ffb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:43.468430 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f3a3a-0d95-40ec-ab6e-56aca587ffb2 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:43.474108 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c73f38a-9a2d-411c-9fa7-f775ffe91de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:43.475244 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c73f38a-9a2d-411c-9fa7-f775ffe91de4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:43.476115 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c73f38a-9a2d-411c-9fa7-f775ffe91de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:43.477548 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c73f38a-9a2d-411c-9fa7-f775ffe91de4 admin admin] PATH_INFO: `/v3/projects/044c34207eb04c8ab5a65229ff5c0757` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:43.481004 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c73f38a-9a2d-411c-9fa7-f775ffe91de4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=044c34207eb04c8ab5a65229ff5c0757)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:43.482880 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c73f38a-9a2d-411c-9fa7-f775ffe91de4 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:43.542447 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-5c73f38a-9a2d-411c-9fa7-f775ffe91de4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '044c34207eb04c8ab5a65229ff5c0757', 'request_id': 'req-5c73f38a-9a2d-411c-9fa7-f775ffe91de4'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:43.552749 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-5c73f38a-9a2d-411c-9fa7-f775ffe91de4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '044c34207eb04c8ab5a65229ff5c0757', 'request_id': 'req-5c73f38a-9a2d-411c-9fa7-f775ffe91de4'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:43.560966 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-5c73f38a-9a2d-411c-9fa7-f775ffe91de4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '044c34207eb04c8ab5a65229ff5c0757', 'request_id': 'req-5c73f38a-9a2d-411c-9fa7-f775ffe91de4'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:43.572456 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-5c73f38a-9a2d-411c-9fa7-f775ffe91de4 admin admin] The token cache is being invalidate because project 044c34207eb04c8ab5a65229ff5c0757 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:18:43.572978 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-5c73f38a-9a2d-411c-9fa7-f775ffe91de4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:43.573781 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-5c73f38a-9a2d-411c-9fa7-f775ffe91de4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:43.575367 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1285/2581] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:18:43 2022] DELETE /identity/v3/projects/044c34207eb04c8ab5a65229ff5c0757 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:18:43.579695 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99050b4-b1a1-48d4-8bd0-022fda96126c service neutron] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:43.593555 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99050b4-b1a1-48d4-8bd0-022fda96126c service neutron] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:43.664871 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d3e9b-31bc-422c-b608-5ca81031167a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:43.666467 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d3e9b-31bc-422c-b608-5ca81031167a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:43.666749 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d3e9b-31bc-422c-b608-5ca81031167a admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:43.667094 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d3e9b-31bc-422c-b608-5ca81031167a admin admin] PATH_INFO: `/v3/users/d4969b6aac014a359621e46a0efd347c` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:43.668516 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d3e9b-31bc-422c-b608-5ca81031167a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4969b6aac014a359621e46a0efd347c)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:43.670509 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d3e9b-31bc-422c-b608-5ca81031167a admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:43.721248 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-327d3e9b-31bc-422c-b608-5ca81031167a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4969b6aac014a359621e46a0efd347c'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:43.732885 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-327d3e9b-31bc-422c-b608-5ca81031167a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4969b6aac014a359621e46a0efd347c'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:43.733824 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-327d3e9b-31bc-422c-b608-5ca81031167a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4969b6aac014a359621e46a0efd347c'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:43.734445 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-327d3e9b-31bc-422c-b608-5ca81031167a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4969b6aac014a359621e46a0efd347c'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:43.749545 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-327d3e9b-31bc-422c-b608-5ca81031167a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4969b6aac014a359621e46a0efd347c'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:43.764926 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1297/2582] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:18:43 2022] DELETE /identity/v3/users/d4969b6aac014a359621e46a0efd347c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:18:44.107902 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c73f38a-9a2d-411c-9fa7-f775ffe91de4 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:44.109636 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-5c73f38a-9a2d-411c-9fa7-f775ffe91de4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:44.136804 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c73f38a-9a2d-411c-9fa7-f775ffe91de4 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:44.143614 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:18:44.201086 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa7473-a9b7-49bf-8f31-a43da49d239f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:44.202001 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa7473-a9b7-49bf-8f31-a43da49d239f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:44.202283 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa7473-a9b7-49bf-8f31-a43da49d239f admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:44.202559 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa7473-a9b7-49bf-8f31-a43da49d239f admin admin] PATH_INFO: `/v3/projects/2babb25d46f24e64a6e62605d46fb02b` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:44.203773 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aa7473-a9b7-49bf-8f31-a43da49d239f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2babb25d46f24e64a6e62605d46fb02b)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:44.205733 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aa7473-a9b7-49bf-8f31-a43da49d239f admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:44.257256 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-04aa7473-a9b7-49bf-8f31-a43da49d239f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2babb25d46f24e64a6e62605d46fb02b', 'request_id': 'req-04aa7473-a9b7-49bf-8f31-a43da49d239f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:44.266800 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-04aa7473-a9b7-49bf-8f31-a43da49d239f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2babb25d46f24e64a6e62605d46fb02b', 'request_id': 'req-04aa7473-a9b7-49bf-8f31-a43da49d239f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:44.272530 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-04aa7473-a9b7-49bf-8f31-a43da49d239f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2babb25d46f24e64a6e62605d46fb02b', 'request_id': 'req-04aa7473-a9b7-49bf-8f31-a43da49d239f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:44.284427 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-04aa7473-a9b7-49bf-8f31-a43da49d239f admin admin] The token cache is being invalidate because project 2babb25d46f24e64a6e62605d46fb02b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:18:44.284841 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-04aa7473-a9b7-49bf-8f31-a43da49d239f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:44.285492 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-04aa7473-a9b7-49bf-8f31-a43da49d239f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:44.287039 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1286/2583] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:18:44 2022] DELETE /identity/v3/projects/2babb25d46f24e64a6e62605d46fb02b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:18:44.292848 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1dd66-e68d-4566-8e38-be0b5cb70c2b None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:44.293139 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1dd66-e68d-4566-8e38-be0b5cb70c2b None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:44.293420 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1dd66-e68d-4566-8e38-be0b5cb70c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:44.311177 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-4ae1dd66-e68d-4566-8e38-be0b5cb70c2b None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:18:44.312425 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-4ae1dd66-e68d-4566-8e38-be0b5cb70c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:44.355875 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:18:44.403662 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1298/2584] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:18:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:18:44.411214 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9c249-12e9-4795-9482-4bfef37de2f3 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:44.411510 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9c249-12e9-4795-9482-4bfef37de2f3 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:44.411792 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9c249-12e9-4795-9482-4bfef37de2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:44.431672 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-99d9c249-12e9-4795-9482-4bfef37de2f3 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:18:44.432938 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-99d9c249-12e9-4795-9482-4bfef37de2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:44.441122 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1287/2585] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:18:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:18:44.445326 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1dd66-e68d-4566-8e38-be0b5cb70c2b None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:44.456001 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1dd66-e68d-4566-8e38-be0b5cb70c2b None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:44.460824 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818ef44-47ee-4ea1-a29d-668422026ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:44.461513 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818ef44-47ee-4ea1-a29d-668422026ec3 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:44.461796 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818ef44-47ee-4ea1-a29d-668422026ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:44.462072 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818ef44-47ee-4ea1-a29d-668422026ec3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:44.463674 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5818ef44-47ee-4ea1-a29d-668422026ec3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:18:44.463988 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5818ef44-47ee-4ea1-a29d-668422026ec3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:44.465690 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5818ef44-47ee-4ea1-a29d-668422026ec3 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:44.480596 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1299/2586] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:18:44.486130 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9c249-12e9-4795-9482-4bfef37de2f3 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:44.499789 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9c249-12e9-4795-9482-4bfef37de2f3 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:44.505129 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43fb0c7-6382-4fc0-9fe7-f4558192b1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:44.505945 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43fb0c7-6382-4fc0-9fe7-f4558192b1fd admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:44.506306 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43fb0c7-6382-4fc0-9fe7-f4558192b1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:44.506656 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43fb0c7-6382-4fc0-9fe7-f4558192b1fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:44.507428 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43fb0c7-6382-4fc0-9fe7-f4558192b1fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:44.510409 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43fb0c7-6382-4fc0-9fe7-f4558192b1fd admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:44.539781 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1288/2587] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:18:44 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:18:44.545611 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818ef44-47ee-4ea1-a29d-668422026ec3 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:44.558776 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818ef44-47ee-4ea1-a29d-668422026ec3 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:44.632928 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5374d8-4310-4562-a432-7f34c2022e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:44.633891 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5374d8-4310-4562-a432-7f34c2022e51 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:44.634740 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5374d8-4310-4562-a432-7f34c2022e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:44.635063 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5374d8-4310-4562-a432-7f34c2022e51 admin admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:44.635970 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5374d8-4310-4562-a432-7f34c2022e51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:44.638016 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5374d8-4310-4562-a432-7f34c2022e51 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:44.669125 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1300/2588] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:18:44 2022] POST /identity/v3/users => generated 289 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 12:18:44.670531 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43fb0c7-6382-4fc0-9fe7-f4558192b1fd admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:44.683724 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43fb0c7-6382-4fc0-9fe7-f4558192b1fd admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:44.689224 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61f9034-1aaa-4d43-bd40-c89b0745629f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:44.689405 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f9034-1aaa-4d43-bd40-c89b0745629f admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:44.689791 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f9034-1aaa-4d43-bd40-c89b0745629f admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:44.690140 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f9034-1aaa-4d43-bd40-c89b0745629f admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:44.690996 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61f9034-1aaa-4d43-bd40-c89b0745629f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:44.692781 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61f9034-1aaa-4d43-bd40-c89b0745629f admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:44.707362 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1289/2589] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:18:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:18:44.713965 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5374d8-4310-4562-a432-7f34c2022e51 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:44.724761 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5374d8-4310-4562-a432-7f34c2022e51 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:44.730391 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b264e90-df09-4b10-a9f0-f62e8e071401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:44.731130 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b264e90-df09-4b10-a9f0-f62e8e071401 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:44.731490 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b264e90-df09-4b10-a9f0-f62e8e071401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:44.731841 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b264e90-df09-4b10-a9f0-f62e8e071401 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:44.732692 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b264e90-df09-4b10-a9f0-f62e8e071401 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:44.734392 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b264e90-df09-4b10-a9f0-f62e8e071401 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:44.746788 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1301/2590] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:18:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:18:44.750715 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61f9034-1aaa-4d43-bd40-c89b0745629f admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:44.761421 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61f9034-1aaa-4d43-bd40-c89b0745629f admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:44.766303 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30345494-ec7c-4c89-9900-df3332e3d298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:44.767292 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30345494-ec7c-4c89-9900-df3332e3d298 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:44.767675 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30345494-ec7c-4c89-9900-df3332e3d298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:44.768050 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30345494-ec7c-4c89-9900-df3332e3d298 admin admin] PATH_INFO: `/v3/projects/d15fbbec736a44949fc006ef4bc96ba0/users/6d4db3ad0cdd49e7bc6eb6cc35e6667a/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:44.786381 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30345494-ec7c-4c89-9900-df3332e3d298 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d15fbbec736a44949fc006ef4bc96ba0, user_id=6d4db3ad0cdd49e7bc6eb6cc35e6667a, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:44.789255 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30345494-ec7c-4c89-9900-df3332e3d298 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:44.803649 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1290/2591] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:18:44 2022] PUT /identity/v3/projects/d15fbbec736a44949fc006ef4bc96ba0/users/6d4db3ad0cdd49e7bc6eb6cc35e6667a/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:18:44.814775 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea831c3c-ba01-4380-b61f-bd8358a04174 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:44.815317 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea831c3c-ba01-4380-b61f-bd8358a04174 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:44.815595 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea831c3c-ba01-4380-b61f-bd8358a04174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:44.845144 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-ea831c3c-ba01-4380-b61f-bd8358a04174 None None] MFA Rules not processed for user `6d4db3ad0cdd49e7bc6eb6cc35e6667a`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:18:44.846374 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-ea831c3c-ba01-4380-b61f-bd8358a04174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:44.924946 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1302/2592] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:18:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:18:44.936090 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30345494-ec7c-4c89-9900-df3332e3d298 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:44.938925 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-30345494-ec7c-4c89-9900-df3332e3d298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:44.990127 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:18:45.020334 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30345494-ec7c-4c89-9900-df3332e3d298 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:45.023997 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653837f4-05f8-47a8-9a3e-841b6cd25860 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:45.024664 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653837f4-05f8-47a8-9a3e-841b6cd25860 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:45.025672 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653837f4-05f8-47a8-9a3e-841b6cd25860 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:45.026418 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653837f4-05f8-47a8-9a3e-841b6cd25860 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:45.035935 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653837f4-05f8-47a8-9a3e-841b6cd25860 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:45.037414 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653837f4-05f8-47a8-9a3e-841b6cd25860 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:45.047219 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1291/2593] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:18:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:18:46.263737 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea831c3c-ba01-4380-b61f-bd8358a04174 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:46.265305 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-ea831c3c-ba01-4380-b61f-bd8358a04174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:46.308244 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:18:46.332774 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea831c3c-ba01-4380-b61f-bd8358a04174 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:46.337292 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745a3ba-519c-498f-8f1a-829149eecb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:46.338190 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745a3ba-519c-498f-8f1a-829149eecb10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:46.338496 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745a3ba-519c-498f-8f1a-829149eecb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:46.338764 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745a3ba-519c-498f-8f1a-829149eecb10 admin admin] PATH_INFO: `/v3/users/38475bbe086b451fb78750ce6606dfa0` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:46.339929 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5745a3ba-519c-498f-8f1a-829149eecb10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38475bbe086b451fb78750ce6606dfa0)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:46.341922 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5745a3ba-519c-498f-8f1a-829149eecb10 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:46.391802 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-5745a3ba-519c-498f-8f1a-829149eecb10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38475bbe086b451fb78750ce6606dfa0'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:46.399173 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-5745a3ba-519c-498f-8f1a-829149eecb10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38475bbe086b451fb78750ce6606dfa0'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:46.400635 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-5745a3ba-519c-498f-8f1a-829149eecb10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38475bbe086b451fb78750ce6606dfa0'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:46.401296 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-5745a3ba-519c-498f-8f1a-829149eecb10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38475bbe086b451fb78750ce6606dfa0'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:46.414839 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-5745a3ba-519c-498f-8f1a-829149eecb10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38475bbe086b451fb78750ce6606dfa0'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:46.427655 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1303/2594] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:18:46 2022] DELETE /identity/v3/users/38475bbe086b451fb78750ce6606dfa0 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:18:46.606795 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653837f4-05f8-47a8-9a3e-841b6cd25860 service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:46.620433 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653837f4-05f8-47a8-9a3e-841b6cd25860 service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:46.679241 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a0d097-7bf7-423f-aca2-28c4fb697042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:46.680193 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0d097-7bf7-423f-aca2-28c4fb697042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:46.680480 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0d097-7bf7-423f-aca2-28c4fb697042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:46.680753 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0d097-7bf7-423f-aca2-28c4fb697042 admin admin] PATH_INFO: `/v3/projects/633d5edd24014c5eab3f0907135d8d4b` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:46.682527 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a0d097-7bf7-423f-aca2-28c4fb697042 admin admin] RBAC: Authorizing `identity:delete_project(project_id=633d5edd24014c5eab3f0907135d8d4b)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:46.684534 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a0d097-7bf7-423f-aca2-28c4fb697042 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:46.730692 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a1a0d097-7bf7-423f-aca2-28c4fb697042 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '633d5edd24014c5eab3f0907135d8d4b', 'request_id': 'req-a1a0d097-7bf7-423f-aca2-28c4fb697042'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:46.737580 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a1a0d097-7bf7-423f-aca2-28c4fb697042 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '633d5edd24014c5eab3f0907135d8d4b', 'request_id': 'req-a1a0d097-7bf7-423f-aca2-28c4fb697042'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:46.743072 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a1a0d097-7bf7-423f-aca2-28c4fb697042 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '633d5edd24014c5eab3f0907135d8d4b', 'request_id': 'req-a1a0d097-7bf7-423f-aca2-28c4fb697042'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:46.754511 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a1a0d097-7bf7-423f-aca2-28c4fb697042 admin admin] The token cache is being invalidate because project 633d5edd24014c5eab3f0907135d8d4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:18:46.754798 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a1a0d097-7bf7-423f-aca2-28c4fb697042 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:46.755421 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a1a0d097-7bf7-423f-aca2-28c4fb697042 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:18:46.757045 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1292/2595] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:18:46 2022] DELETE /identity/v3/projects/633d5edd24014c5eab3f0907135d8d4b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:18:46.762096 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a9a11-172e-40ba-8f89-318f5f92bdb9 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:46.762389 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a9a11-172e-40ba-8f89-318f5f92bdb9 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:46.762667 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a9a11-172e-40ba-8f89-318f5f92bdb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:46.779709 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-4b1a9a11-172e-40ba-8f89-318f5f92bdb9 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:18:46.780998 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-4b1a9a11-172e-40ba-8f89-318f5f92bdb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:46.840319 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1304/2596] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:18:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:18:46.848557 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c484dd-9ff5-4bdd-a3be-4df08e19ff7a None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:46.848844 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c484dd-9ff5-4bdd-a3be-4df08e19ff7a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:46.849121 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c484dd-9ff5-4bdd-a3be-4df08e19ff7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:46.867630 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-92c484dd-9ff5-4bdd-a3be-4df08e19ff7a None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:18:46.869654 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-92c484dd-9ff5-4bdd-a3be-4df08e19ff7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:46.877408 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1293/2597] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:18:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:18:46.881592 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a9a11-172e-40ba-8f89-318f5f92bdb9 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:46.891689 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a9a11-172e-40ba-8f89-318f5f92bdb9 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:46.896406 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c141eb4-f7fa-4f39-893e-f034ad57f330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:46.897096 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c141eb4-f7fa-4f39-893e-f034ad57f330 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:46.897383 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c141eb4-f7fa-4f39-893e-f034ad57f330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:46.897691 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c141eb4-f7fa-4f39-893e-f034ad57f330 admin admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:46.898416 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c141eb4-f7fa-4f39-893e-f034ad57f330 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:18:46.898729 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c141eb4-f7fa-4f39-893e-f034ad57f330 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:46.900979 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c141eb4-f7fa-4f39-893e-f034ad57f330 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:46.912512 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1305/2598] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:18:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:18:46.917076 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c484dd-9ff5-4bdd-a3be-4df08e19ff7a None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:46.926444 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c484dd-9ff5-4bdd-a3be-4df08e19ff7a None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:46.932380 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b17b5-2eaf-464d-b25d-0d7421c1fc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:46.933028 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b17b5-2eaf-464d-b25d-0d7421c1fc56 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:46.933310 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b17b5-2eaf-464d-b25d-0d7421c1fc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:46.933584 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b17b5-2eaf-464d-b25d-0d7421c1fc56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:46.934276 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1b17b5-2eaf-464d-b25d-0d7421c1fc56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:46.936150 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1b17b5-2eaf-464d-b25d-0d7421c1fc56 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:46.961426 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1294/2599] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:18:46 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:18:46.965799 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c141eb4-f7fa-4f39-893e-f034ad57f330 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:46.975529 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c141eb4-f7fa-4f39-893e-f034ad57f330 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:47.017279 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:18:47.032999 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b91938-a589-493b-8a9d-291883bc475f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:47.033613 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b91938-a589-493b-8a9d-291883bc475f admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:47.033898 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b91938-a589-493b-8a9d-291883bc475f admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:47.034173 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b91938-a589-493b-8a9d-291883bc475f admin admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:47.034854 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b91938-a589-493b-8a9d-291883bc475f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:47.036794 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b91938-a589-493b-8a9d-291883bc475f admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:47.055992 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1306/2600] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:18:46 2022] POST /identity/v3/users => generated 286 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:18:47.060990 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b17b5-2eaf-464d-b25d-0d7421c1fc56 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:47.071355 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b17b5-2eaf-464d-b25d-0d7421c1fc56 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:47.077125 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a99f0c-7cbc-4606-ab45-265270c523a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:47.077789 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a99f0c-7cbc-4606-ab45-265270c523a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:47.078123 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a99f0c-7cbc-4606-ab45-265270c523a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:47.078407 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a99f0c-7cbc-4606-ab45-265270c523a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:47.079250 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a99f0c-7cbc-4606-ab45-265270c523a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:47.081009 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a99f0c-7cbc-4606-ab45-265270c523a8 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:47.092431 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1295/2601] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:18:47.097226 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b91938-a589-493b-8a9d-291883bc475f admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:47.108142 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b91938-a589-493b-8a9d-291883bc475f admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:47.112702 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49d91a-3740-4f8b-8d1f-0c0f35f3f730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:47.113362 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49d91a-3740-4f8b-8d1f-0c0f35f3f730 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:47.113649 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49d91a-3740-4f8b-8d1f-0c0f35f3f730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:47.113930 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49d91a-3740-4f8b-8d1f-0c0f35f3f730 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:47.114645 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e49d91a-3740-4f8b-8d1f-0c0f35f3f730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:47.116268 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e49d91a-3740-4f8b-8d1f-0c0f35f3f730 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:47.126190 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1307/2602] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:18:47.130441 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a99f0c-7cbc-4606-ab45-265270c523a8 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:47.140662 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a99f0c-7cbc-4606-ab45-265270c523a8 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:47.145225 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad05c27f-b424-43c6-9341-3cd8fe65dc6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:47.146092 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05c27f-b424-43c6-9341-3cd8fe65dc6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:47.146371 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05c27f-b424-43c6-9341-3cd8fe65dc6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:47.146645 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05c27f-b424-43c6-9341-3cd8fe65dc6e admin admin] PATH_INFO: `/v3/projects/77c06fe5dfbe4bed8bebc3f4ed26a3ba/users/278281ebe7fc4ec5821d595556a3ac77/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:47.161416 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad05c27f-b424-43c6-9341-3cd8fe65dc6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=77c06fe5dfbe4bed8bebc3f4ed26a3ba, user_id=278281ebe7fc4ec5821d595556a3ac77, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:47.164019 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad05c27f-b424-43c6-9341-3cd8fe65dc6e admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:47.176951 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1296/2603] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:18:47 2022] PUT /identity/v3/projects/77c06fe5dfbe4bed8bebc3f4ed26a3ba/users/278281ebe7fc4ec5821d595556a3ac77/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:18:47.187825 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f088397-945c-4ed9-858c-33935384673b None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:47.188123 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f088397-945c-4ed9-858c-33935384673b None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:47.188443 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f088397-945c-4ed9-858c-33935384673b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:47.214856 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-2f088397-945c-4ed9-858c-33935384673b None None] MFA Rules not processed for user `278281ebe7fc4ec5821d595556a3ac77`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:18:47.216046 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-2f088397-945c-4ed9-858c-33935384673b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:47.282516 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1308/2604] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:18:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:18:47.294394 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad05c27f-b424-43c6-9341-3cd8fe65dc6e admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:18:47.296015 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ad05c27f-b424-43c6-9341-3cd8fe65dc6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:18:47.301401 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:18:47.374382 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad05c27f-b424-43c6-9341-3cd8fe65dc6e admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:18:47.380086 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b708e2f0-0aec-475b-a6c5-6ae884268112 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef7edb5e9ce49e6b098f48bf060b228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:18:47.380772 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708e2f0-0aec-475b-a6c5-6ae884268112 service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:18:47.381058 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708e2f0-0aec-475b-a6c5-6ae884268112 service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:18:47.381336 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708e2f0-0aec-475b-a6c5-6ae884268112 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:18:47.389303 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b708e2f0-0aec-475b-a6c5-6ae884268112 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:18:47.390889 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b708e2f0-0aec-475b-a6c5-6ae884268112 service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:18:47.399975 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1297/2605] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:18:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:18:57.279465 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=46,keystone:INSERT=3 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:18:57.395907 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=33 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:19:00.728961 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f088397-945c-4ed9-858c-33935384673b None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:00.837533 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f088397-945c-4ed9-858c-33935384673b None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:00.842358 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ab329-f6d9-4a3c-af01-34c5008c8271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:00.843347 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ab329-f6d9-4a3c-af01-34c5008c8271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:00.843675 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ab329-f6d9-4a3c-af01-34c5008c8271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:00.843983 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ab329-f6d9-4a3c-af01-34c5008c8271 admin admin] PATH_INFO: `/v3/users/278281ebe7fc4ec5821d595556a3ac77` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:00.845276 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9ab329-f6d9-4a3c-af01-34c5008c8271 admin admin] RBAC: Authorizing `identity:delete_user(user_id=278281ebe7fc4ec5821d595556a3ac77)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:00.847354 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9ab329-f6d9-4a3c-af01-34c5008c8271 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:00.897373 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-cd9ab329-f6d9-4a3c-af01-34c5008c8271 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '278281ebe7fc4ec5821d595556a3ac77'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:00.904393 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-cd9ab329-f6d9-4a3c-af01-34c5008c8271 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '278281ebe7fc4ec5821d595556a3ac77'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:00.905086 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-cd9ab329-f6d9-4a3c-af01-34c5008c8271 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '278281ebe7fc4ec5821d595556a3ac77'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:00.905706 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-cd9ab329-f6d9-4a3c-af01-34c5008c8271 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '278281ebe7fc4ec5821d595556a3ac77'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:00.917440 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-cd9ab329-f6d9-4a3c-af01-34c5008c8271 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '278281ebe7fc4ec5821d595556a3ac77'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:00.931249 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1309/2606] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:19:00 2022] DELETE /identity/v3/users/278281ebe7fc4ec5821d595556a3ac77 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:19:00.936920 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f112df-2105-4964-83ee-6d9247867854 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:00.937471 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f112df-2105-4964-83ee-6d9247867854 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:00.937471 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f112df-2105-4964-83ee-6d9247867854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:00.985979 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-14f112df-2105-4964-83ee-6d9247867854 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:19:00.987201 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-14f112df-2105-4964-83ee-6d9247867854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:01.047932 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1298/2607] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:19:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:19:01.058038 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ab329-f6d9-4a3c-af01-34c5008c8271 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:01.060080 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-cd9ab329-f6d9-4a3c-af01-34c5008c8271 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:01.104724 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:19:01.164205 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ab329-f6d9-4a3c-af01-34c5008c8271 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:01.168832 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad81fd41-d252-4b43-8eba-59ff1057f59c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:01.169498 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81fd41-d252-4b43-8eba-59ff1057f59c service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:01.169784 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81fd41-d252-4b43-8eba-59ff1057f59c service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:01.170062 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81fd41-d252-4b43-8eba-59ff1057f59c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:01.180338 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad81fd41-d252-4b43-8eba-59ff1057f59c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:01.182118 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad81fd41-d252-4b43-8eba-59ff1057f59c service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:01.192467 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1310/2608] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:19:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:19:01.497476 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f112df-2105-4964-83ee-6d9247867854 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:01.499415 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-14f112df-2105-4964-83ee-6d9247867854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:01.516774 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f112df-2105-4964-83ee-6d9247867854 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:01.522115 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf4c31-e62c-408d-be15-b7837c72449e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:01.523222 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf4c31-e62c-408d-be15-b7837c72449e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:01.523541 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf4c31-e62c-408d-be15-b7837c72449e admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:01.523803 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf4c31-e62c-408d-be15-b7837c72449e admin admin] PATH_INFO: `/v3/projects/77c06fe5dfbe4bed8bebc3f4ed26a3ba` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:01.525072 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cf4c31-e62c-408d-be15-b7837c72449e admin admin] RBAC: Authorizing `identity:delete_project(project_id=77c06fe5dfbe4bed8bebc3f4ed26a3ba)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:01.527013 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cf4c31-e62c-408d-be15-b7837c72449e admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:01.604509 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b2cf4c31-e62c-408d-be15-b7837c72449e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77c06fe5dfbe4bed8bebc3f4ed26a3ba', 'request_id': 'req-b2cf4c31-e62c-408d-be15-b7837c72449e'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:01.613932 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b2cf4c31-e62c-408d-be15-b7837c72449e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77c06fe5dfbe4bed8bebc3f4ed26a3ba', 'request_id': 'req-b2cf4c31-e62c-408d-be15-b7837c72449e'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:01.624462 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b2cf4c31-e62c-408d-be15-b7837c72449e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77c06fe5dfbe4bed8bebc3f4ed26a3ba', 'request_id': 'req-b2cf4c31-e62c-408d-be15-b7837c72449e'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:01.636366 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b2cf4c31-e62c-408d-be15-b7837c72449e admin admin] The token cache is being invalidate because project 77c06fe5dfbe4bed8bebc3f4ed26a3ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:19:01.637385 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b2cf4c31-e62c-408d-be15-b7837c72449e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:01.638312 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b2cf4c31-e62c-408d-be15-b7837c72449e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:01.639993 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1299/2609] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:19:01 2022] DELETE /identity/v3/projects/77c06fe5dfbe4bed8bebc3f4ed26a3ba => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:19:01.645090 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15520c50-bec7-4906-a9e9-a3e482173ebc None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:01.645499 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15520c50-bec7-4906-a9e9-a3e482173ebc None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:01.645911 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15520c50-bec7-4906-a9e9-a3e482173ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:01.676435 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-15520c50-bec7-4906-a9e9-a3e482173ebc None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:19:01.677744 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-15520c50-bec7-4906-a9e9-a3e482173ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:01.748089 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1311/2610] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:19:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:19:01.755589 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d732bab-1d32-4fc6-a8f9-a9bb65388c4f None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:01.755963 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d732bab-1d32-4fc6-a8f9-a9bb65388c4f None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:01.756291 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d732bab-1d32-4fc6-a8f9-a9bb65388c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:01.776367 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-0d732bab-1d32-4fc6-a8f9-a9bb65388c4f None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:19:01.777969 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-0d732bab-1d32-4fc6-a8f9-a9bb65388c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:01.788316 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1300/2611] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:19:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:19:01.791333 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15520c50-bec7-4906-a9e9-a3e482173ebc None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:01.802280 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15520c50-bec7-4906-a9e9-a3e482173ebc None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:01.809314 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0196bfb-c3d4-413e-a4ac-1f2bd63d0066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:01.810420 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0196bfb-c3d4-413e-a4ac-1f2bd63d0066 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:01.810728 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0196bfb-c3d4-413e-a4ac-1f2bd63d0066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:01.811008 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0196bfb-c3d4-413e-a4ac-1f2bd63d0066 admin admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:01.811817 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0196bfb-c3d4-413e-a4ac-1f2bd63d0066 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:19:01.812131 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0196bfb-c3d4-413e-a4ac-1f2bd63d0066 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:01.814043 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0196bfb-c3d4-413e-a4ac-1f2bd63d0066 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:01.829700 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1312/2612] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:19:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:19:01.831039 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d732bab-1d32-4fc6-a8f9-a9bb65388c4f None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:01.841878 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d732bab-1d32-4fc6-a8f9-a9bb65388c4f None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:01.847052 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e301bee-64dc-450d-bc9c-151b65ffc890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:01.847811 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e301bee-64dc-450d-bc9c-151b65ffc890 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:01.848139 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e301bee-64dc-450d-bc9c-151b65ffc890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:01.848514 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e301bee-64dc-450d-bc9c-151b65ffc890 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:01.849219 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e301bee-64dc-450d-bc9c-151b65ffc890 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:01.851265 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e301bee-64dc-450d-bc9c-151b65ffc890 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:01.884851 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1301/2613] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:19:01 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:19:01.889671 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0196bfb-c3d4-413e-a4ac-1f2bd63d0066 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:01.899451 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0196bfb-c3d4-413e-a4ac-1f2bd63d0066 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:01.959568 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e423f5-63dd-4505-aa3b-51994744b1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:01.960538 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e423f5-63dd-4505-aa3b-51994744b1b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:01.960890 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e423f5-63dd-4505-aa3b-51994744b1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:01.961383 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e423f5-63dd-4505-aa3b-51994744b1b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:01.962367 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e423f5-63dd-4505-aa3b-51994744b1b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:01.964884 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e423f5-63dd-4505-aa3b-51994744b1b8 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:01.987519 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1313/2614] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:19:01 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:19:01.991676 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e301bee-64dc-450d-bc9c-151b65ffc890 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:02.003107 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e301bee-64dc-450d-bc9c-151b65ffc890 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:02.009754 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9dfcb3-bee7-41f4-a52a-c11b779ce1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:02.010428 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9dfcb3-bee7-41f4-a52a-c11b779ce1b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:02.010717 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9dfcb3-bee7-41f4-a52a-c11b779ce1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:02.010998 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9dfcb3-bee7-41f4-a52a-c11b779ce1b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:02.012481 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9dfcb3-bee7-41f4-a52a-c11b779ce1b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:02.014213 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9dfcb3-bee7-41f4-a52a-c11b779ce1b1 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:02.025089 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1302/2615] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:19:02.029583 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e423f5-63dd-4505-aa3b-51994744b1b8 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:02.039944 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e423f5-63dd-4505-aa3b-51994744b1b8 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:02.045346 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80ea21-30c9-4c9b-8e74-ed714d1fe054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:02.046048 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80ea21-30c9-4c9b-8e74-ed714d1fe054 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:02.046336 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80ea21-30c9-4c9b-8e74-ed714d1fe054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:02.046614 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80ea21-30c9-4c9b-8e74-ed714d1fe054 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:02.047339 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80ea21-30c9-4c9b-8e74-ed714d1fe054 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:02.048982 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80ea21-30c9-4c9b-8e74-ed714d1fe054 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:02.060613 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1314/2616] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:19:02.064797 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9dfcb3-bee7-41f4-a52a-c11b779ce1b1 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:02.075902 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9dfcb3-bee7-41f4-a52a-c11b779ce1b1 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:02.080657 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff237bf-7184-4d26-a135-29d70be23791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:02.081565 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff237bf-7184-4d26-a135-29d70be23791 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:02.081850 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff237bf-7184-4d26-a135-29d70be23791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:02.082128 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff237bf-7184-4d26-a135-29d70be23791 admin admin] PATH_INFO: `/v3/projects/0e0bcc72293a4b56826edacd0cf2536c/users/b8ef4aaa11364afc8ead2b7197b7a842/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:02.097534 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff237bf-7184-4d26-a135-29d70be23791 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e0bcc72293a4b56826edacd0cf2536c, user_id=b8ef4aaa11364afc8ead2b7197b7a842, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:02.100739 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff237bf-7184-4d26-a135-29d70be23791 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:02.103428 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:19:02.117340 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1303/2617] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:19:02 2022] PUT /identity/v3/projects/0e0bcc72293a4b56826edacd0cf2536c/users/b8ef4aaa11364afc8ead2b7197b7a842/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:19:02.128414 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eceb517-f6b3-4ebf-a237-b352628da865 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:02.128745 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eceb517-f6b3-4ebf-a237-b352628da865 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:02.129031 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eceb517-f6b3-4ebf-a237-b352628da865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:02.149428 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:19:02.159552 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-4eceb517-f6b3-4ebf-a237-b352628da865 None None] MFA Rules not processed for user `b8ef4aaa11364afc8ead2b7197b7a842`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:19:02.161687 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-4eceb517-f6b3-4ebf-a237-b352628da865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:02.236498 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1315/2618] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:19:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:19:02.241063 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff237bf-7184-4d26-a135-29d70be23791 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:02.304472 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff237bf-7184-4d26-a135-29d70be23791 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:02.310376 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb869a-90c8-4ea8-b9f6-643a6dcd30d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:02.310951 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb869a-90c8-4ea8-b9f6-643a6dcd30d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:02.311237 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb869a-90c8-4ea8-b9f6-643a6dcd30d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:02.311515 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb869a-90c8-4ea8-b9f6-643a6dcd30d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:02.312247 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbb869a-90c8-4ea8-b9f6-643a6dcd30d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:02.314416 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbb869a-90c8-4ea8-b9f6-643a6dcd30d0 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:02.345276 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1304/2619] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:19:02 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:19:02.346319 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eceb517-f6b3-4ebf-a237-b352628da865 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:02.358105 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eceb517-f6b3-4ebf-a237-b352628da865 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:02.416646 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb1c3b6-4c16-4ff0-b638-0e6358245d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:02.417307 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1c3b6-4c16-4ff0-b638-0e6358245d5c admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:02.417307 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1c3b6-4c16-4ff0-b638-0e6358245d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:02.417512 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1c3b6-4c16-4ff0-b638-0e6358245d5c admin admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:02.419374 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb1c3b6-4c16-4ff0-b638-0e6358245d5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:02.422137 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb1c3b6-4c16-4ff0-b638-0e6358245d5c admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:02.451903 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1316/2620] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:19:02 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 12:19:02.453515 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb869a-90c8-4ea8-b9f6-643a6dcd30d0 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:02.464527 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb869a-90c8-4ea8-b9f6-643a6dcd30d0 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:02.470763 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f56fda5-481e-46bb-859c-932a0caddd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:02.470763 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56fda5-481e-46bb-859c-932a0caddd92 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:02.470763 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56fda5-481e-46bb-859c-932a0caddd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:02.471089 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56fda5-481e-46bb-859c-932a0caddd92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:02.471598 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f56fda5-481e-46bb-859c-932a0caddd92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:02.479126 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f56fda5-481e-46bb-859c-932a0caddd92 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:02.503212 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1305/2621] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 12:19:02.507288 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb1c3b6-4c16-4ff0-b638-0e6358245d5c admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:02.520508 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb1c3b6-4c16-4ff0-b638-0e6358245d5c admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:02.526336 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90c562-909f-4a83-b307-2e3b9a03a420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:02.527395 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90c562-909f-4a83-b307-2e3b9a03a420 admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:02.527726 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90c562-909f-4a83-b307-2e3b9a03a420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:02.528023 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90c562-909f-4a83-b307-2e3b9a03a420 admin admin] PATH_INFO: `/v3/projects/2f598ca7458d4721932f21cf051a069b/users/144e664b9ade4133b155bc875e432c78/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:02.550913 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d90c562-909f-4a83-b307-2e3b9a03a420 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f598ca7458d4721932f21cf051a069b, user_id=144e664b9ade4133b155bc875e432c78, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:02.554366 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d90c562-909f-4a83-b307-2e3b9a03a420 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:02.600143 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1317/2622] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:19:02 2022] PUT /identity/v3/projects/2f598ca7458d4721932f21cf051a069b/users/144e664b9ade4133b155bc875e432c78/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:19:02.604563 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f56fda5-481e-46bb-859c-932a0caddd92 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:02.620240 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f56fda5-481e-46bb-859c-932a0caddd92 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:02.701443 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64721f26-9fb0-4698-ab74-eb987cccfa23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:02.702283 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64721f26-9fb0-4698-ab74-eb987cccfa23 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:02.702570 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64721f26-9fb0-4698-ab74-eb987cccfa23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:02.702849 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64721f26-9fb0-4698-ab74-eb987cccfa23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:02.703612 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64721f26-9fb0-4698-ab74-eb987cccfa23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:02.705292 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64721f26-9fb0-4698-ab74-eb987cccfa23 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:02.719011 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1306/2623] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:19:02.726080 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90c562-909f-4a83-b307-2e3b9a03a420 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:02.740077 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90c562-909f-4a83-b307-2e3b9a03a420 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:02.745799 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028027d4-eeae-4ab0-a573-5da24c043c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:02.747484 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028027d4-eeae-4ab0-a573-5da24c043c7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:02.748042 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028027d4-eeae-4ab0-a573-5da24c043c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:02.748042 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028027d4-eeae-4ab0-a573-5da24c043c7b admin admin] PATH_INFO: `/v3/projects/2f598ca7458d4721932f21cf051a069b/users/144e664b9ade4133b155bc875e432c78/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:02.751321 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028027d4-eeae-4ab0-a573-5da24c043c7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f598ca7458d4721932f21cf051a069b, user_id=144e664b9ade4133b155bc875e432c78, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:02.754079 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028027d4-eeae-4ab0-a573-5da24c043c7b admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:02.772207 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1318/2624] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:19:02 2022] PUT /identity/v3/projects/2f598ca7458d4721932f21cf051a069b/users/144e664b9ade4133b155bc875e432c78/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:19:02.779109 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d53ab5-7bd9-453a-a6bb-d50412f979bd None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:02.779406 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d53ab5-7bd9-453a-a6bb-d50412f979bd None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:02.779682 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d53ab5-7bd9-453a-a6bb-d50412f979bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:02.819423 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-e6d53ab5-7bd9-453a-a6bb-d50412f979bd None None] MFA Rules not processed for user `144e664b9ade4133b155bc875e432c78`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:19:02.820867 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-e6d53ab5-7bd9-453a-a6bb-d50412f979bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:02.874746 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:19:02.902144 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1307/2625] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:19:02 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:19:02.911675 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028027d4-eeae-4ab0-a573-5da24c043c7b admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:02.912988 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-028027d4-eeae-4ab0-a573-5da24c043c7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:02.992266 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028027d4-eeae-4ab0-a573-5da24c043c7b admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:02.996217 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1674cc-9e9a-48b2-b034-115cc90cc144 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:02.996883 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1674cc-9e9a-48b2-b034-115cc90cc144 service cinder] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:02.997175 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1674cc-9e9a-48b2-b034-115cc90cc144 service cinder] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:02.997464 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1674cc-9e9a-48b2-b034-115cc90cc144 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:03.004865 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:19:03.007988 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1674cc-9e9a-48b2-b034-115cc90cc144 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:03.009756 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1674cc-9e9a-48b2-b034-115cc90cc144 service cinder] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:03.023038 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1319/2626] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:19:02 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:19:03.109409 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d53ab5-7bd9-453a-a6bb-d50412f979bd None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:03.120233 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d53ab5-7bd9-453a-a6bb-d50412f979bd None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:03.124133 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53375c9f-e374-44da-83ef-5527a9f8e8a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:03.124825 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53375c9f-e374-44da-83ef-5527a9f8e8a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:03.125166 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53375c9f-e374-44da-83ef-5527a9f8e8a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:03.125448 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53375c9f-e374-44da-83ef-5527a9f8e8a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:03.188021 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53375c9f-e374-44da-83ef-5527a9f8e8a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:03.189588 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53375c9f-e374-44da-83ef-5527a9f8e8a8 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:03.199008 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1308/2627] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:19:03 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:19:10.380420 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1674cc-9e9a-48b2-b034-115cc90cc144 service cinder] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:10.381850 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-6f1674cc-9e9a-48b2-b034-115cc90cc144 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:10.393869 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1674cc-9e9a-48b2-b034-115cc90cc144 service cinder] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:10.397632 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5f29e0-3514-4214-8436-5cfbaa87f889 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:10.398273 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f29e0-3514-4214-8436-5cfbaa87f889 service cinder] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:10.398554 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f29e0-3514-4214-8436-5cfbaa87f889 service cinder] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:10.398825 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f29e0-3514-4214-8436-5cfbaa87f889 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:10.400626 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-3c5f29e0-3514-4214-8436-5cfbaa87f889 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:10.493510 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5f29e0-3514-4214-8436-5cfbaa87f889 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:10.495162 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5f29e0-3514-4214-8436-5cfbaa87f889 service cinder] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:10.524523 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1320/2628] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:19:10 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:19:13.194735 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=33 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:19:19.390792 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53375c9f-e374-44da-83ef-5527a9f8e8a8 service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:19.392775 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-53375c9f-e374-44da-83ef-5527a9f8e8a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:19.492345 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53375c9f-e374-44da-83ef-5527a9f8e8a8 service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:19.503615 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768036d8-50a1-456a-a87f-bb717eafe7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:19.504736 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768036d8-50a1-456a-a87f-bb717eafe7b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:19.505122 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768036d8-50a1-456a-a87f-bb717eafe7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:19.505443 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768036d8-50a1-456a-a87f-bb717eafe7b3 admin admin] PATH_INFO: `/v3/users/6d4db3ad0cdd49e7bc6eb6cc35e6667a` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:19.506782 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768036d8-50a1-456a-a87f-bb717eafe7b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d4db3ad0cdd49e7bc6eb6cc35e6667a)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:19.523745 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768036d8-50a1-456a-a87f-bb717eafe7b3 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:19.634863 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-768036d8-50a1-456a-a87f-bb717eafe7b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d4db3ad0cdd49e7bc6eb6cc35e6667a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:19.638874 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-768036d8-50a1-456a-a87f-bb717eafe7b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d4db3ad0cdd49e7bc6eb6cc35e6667a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:19.640157 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-768036d8-50a1-456a-a87f-bb717eafe7b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d4db3ad0cdd49e7bc6eb6cc35e6667a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:19.665505 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-768036d8-50a1-456a-a87f-bb717eafe7b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d4db3ad0cdd49e7bc6eb6cc35e6667a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:19.694705 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-768036d8-50a1-456a-a87f-bb717eafe7b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d4db3ad0cdd49e7bc6eb6cc35e6667a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:19.726167 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1309/2629] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:19:19 2022] DELETE /identity/v3/users/6d4db3ad0cdd49e7bc6eb6cc35e6667a => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:19:19.731217 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11855303-8ee8-4194-87e1-189dd4013291 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:19.732599 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11855303-8ee8-4194-87e1-189dd4013291 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:19.732599 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11855303-8ee8-4194-87e1-189dd4013291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:19.762874 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-11855303-8ee8-4194-87e1-189dd4013291 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:19:19.769351 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-11855303-8ee8-4194-87e1-189dd4013291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:19.891910 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1321/2630] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:19:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:19:19.907762 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768036d8-50a1-456a-a87f-bb717eafe7b3 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:19.912695 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-768036d8-50a1-456a-a87f-bb717eafe7b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:20.023324 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768036d8-50a1-456a-a87f-bb717eafe7b3 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:20.027822 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f3a34f-742a-4406-aa0e-c5e086dfe21b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:20.028632 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3a34f-742a-4406-aa0e-c5e086dfe21b service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:20.029110 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3a34f-742a-4406-aa0e-c5e086dfe21b service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:20.029497 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3a34f-742a-4406-aa0e-c5e086dfe21b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:20.041534 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f3a34f-742a-4406-aa0e-c5e086dfe21b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:20.043026 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f3a34f-742a-4406-aa0e-c5e086dfe21b service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:20.055926 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1310/2631] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:19:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:19:20.345827 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11855303-8ee8-4194-87e1-189dd4013291 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:20.348012 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-11855303-8ee8-4194-87e1-189dd4013291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:20.365407 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11855303-8ee8-4194-87e1-189dd4013291 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:20.373416 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce560e4e-6438-42e9-b958-9a68076c0491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:20.374426 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce560e4e-6438-42e9-b958-9a68076c0491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:20.375517 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce560e4e-6438-42e9-b958-9a68076c0491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:20.376154 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce560e4e-6438-42e9-b958-9a68076c0491 admin admin] PATH_INFO: `/v3/projects/d15fbbec736a44949fc006ef4bc96ba0` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:20.379143 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce560e4e-6438-42e9-b958-9a68076c0491 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d15fbbec736a44949fc006ef4bc96ba0)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:20.384868 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce560e4e-6438-42e9-b958-9a68076c0491 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:20.441336 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-ce560e4e-6438-42e9-b958-9a68076c0491 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd15fbbec736a44949fc006ef4bc96ba0', 'request_id': 'req-ce560e4e-6438-42e9-b958-9a68076c0491'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:20.451994 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-ce560e4e-6438-42e9-b958-9a68076c0491 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd15fbbec736a44949fc006ef4bc96ba0', 'request_id': 'req-ce560e4e-6438-42e9-b958-9a68076c0491'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:20.457812 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:19:20.461823 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-ce560e4e-6438-42e9-b958-9a68076c0491 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd15fbbec736a44949fc006ef4bc96ba0', 'request_id': 'req-ce560e4e-6438-42e9-b958-9a68076c0491'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:20.477523 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-ce560e4e-6438-42e9-b958-9a68076c0491 admin admin] The token cache is being invalidate because project d15fbbec736a44949fc006ef4bc96ba0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:19:20.477903 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-ce560e4e-6438-42e9-b958-9a68076c0491 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:20.478580 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-ce560e4e-6438-42e9-b958-9a68076c0491 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:20.480391 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1322/2632] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:19:20 2022] DELETE /identity/v3/projects/d15fbbec736a44949fc006ef4bc96ba0 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:19:20.486654 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac14c1b-0661-430c-a72e-3839fd085e82 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:20.487814 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac14c1b-0661-430c-a72e-3839fd085e82 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:20.488252 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac14c1b-0661-430c-a72e-3839fd085e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:20.524522 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:19:20.551404 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-0ac14c1b-0661-430c-a72e-3839fd085e82 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:19:20.552705 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-0ac14c1b-0661-430c-a72e-3839fd085e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:20.623792 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1311/2633] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:19:20.631579 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9d969-01bc-47a9-83c5-4b9404d6d8fd None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:20.631879 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9d969-01bc-47a9-83c5-4b9404d6d8fd None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:20.632190 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9d969-01bc-47a9-83c5-4b9404d6d8fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:20.651755 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-f0a9d969-01bc-47a9-83c5-4b9404d6d8fd None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:19:20.653098 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-f0a9d969-01bc-47a9-83c5-4b9404d6d8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:20.661244 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1323/2634] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:19:20.665636 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac14c1b-0661-430c-a72e-3839fd085e82 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:20.677494 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac14c1b-0661-430c-a72e-3839fd085e82 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:20.681581 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b2200-2b2f-44d9-8346-459cf42ecb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:20.682350 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b2200-2b2f-44d9-8346-459cf42ecb16 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:20.682703 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b2200-2b2f-44d9-8346-459cf42ecb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:20.683048 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b2200-2b2f-44d9-8346-459cf42ecb16 admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:20.683805 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451b2200-2b2f-44d9-8346-459cf42ecb16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:19:20.684114 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451b2200-2b2f-44d9-8346-459cf42ecb16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:20.686277 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451b2200-2b2f-44d9-8346-459cf42ecb16 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:20.698202 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1312/2635] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:19:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:19:20.702843 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9d969-01bc-47a9-83c5-4b9404d6d8fd None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:20.713083 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9d969-01bc-47a9-83c5-4b9404d6d8fd None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:20.718529 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dfd735-ea8c-4d1f-b584-73d9e8dc2535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:20.719218 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dfd735-ea8c-4d1f-b584-73d9e8dc2535 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:20.719504 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dfd735-ea8c-4d1f-b584-73d9e8dc2535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:20.719856 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dfd735-ea8c-4d1f-b584-73d9e8dc2535 admin admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:20.720496 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dfd735-ea8c-4d1f-b584-73d9e8dc2535 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:20.722413 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dfd735-ea8c-4d1f-b584-73d9e8dc2535 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:20.750022 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1324/2636] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:19:20 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:19:20.754366 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b2200-2b2f-44d9-8346-459cf42ecb16 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:20.766289 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b2200-2b2f-44d9-8346-459cf42ecb16 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:20.839322 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12cdf0a-3217-4300-993f-d08eaf440c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:20.840029 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12cdf0a-3217-4300-993f-d08eaf440c9f admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:20.840364 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12cdf0a-3217-4300-993f-d08eaf440c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:20.840685 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12cdf0a-3217-4300-993f-d08eaf440c9f admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:20.841555 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12cdf0a-3217-4300-993f-d08eaf440c9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:20.844836 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12cdf0a-3217-4300-993f-d08eaf440c9f admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:20.874847 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1313/2637] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:19:20 2022] POST /identity/v3/users => generated 292 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:19:20.876353 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dfd735-ea8c-4d1f-b584-73d9e8dc2535 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:20.889499 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dfd735-ea8c-4d1f-b584-73d9e8dc2535 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:20.906235 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a83725-d556-45ed-8ae9-4ddf86fa2489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:20.907381 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a83725-d556-45ed-8ae9-4ddf86fa2489 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:20.907774 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a83725-d556-45ed-8ae9-4ddf86fa2489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:20.908330 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a83725-d556-45ed-8ae9-4ddf86fa2489 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:20.909120 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a83725-d556-45ed-8ae9-4ddf86fa2489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:20.913155 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a83725-d556-45ed-8ae9-4ddf86fa2489 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:20.929259 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1325/2638] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:19:20.932980 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12cdf0a-3217-4300-993f-d08eaf440c9f admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:20.944956 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12cdf0a-3217-4300-993f-d08eaf440c9f admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:20.951779 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ccf88-02c7-43b2-96a4-b2f3a3cfd8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:20.953063 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ccf88-02c7-43b2-96a4-b2f3a3cfd8fc admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:20.954004 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ccf88-02c7-43b2-96a4-b2f3a3cfd8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:20.954526 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ccf88-02c7-43b2-96a4-b2f3a3cfd8fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:20.955458 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ccf88-02c7-43b2-96a4-b2f3a3cfd8fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:20.957329 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ccf88-02c7-43b2-96a4-b2f3a3cfd8fc admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:20.985317 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1314/2639] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:19:20.986380 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a83725-d556-45ed-8ae9-4ddf86fa2489 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:20.998355 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a83725-d556-45ed-8ae9-4ddf86fa2489 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:21.004826 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318b5b7f-ba4a-4826-9bf7-21e0178fd290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:21.005737 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b5b7f-ba4a-4826-9bf7-21e0178fd290 admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:21.006198 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b5b7f-ba4a-4826-9bf7-21e0178fd290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:21.006479 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b5b7f-ba4a-4826-9bf7-21e0178fd290 admin admin] PATH_INFO: `/v3/projects/79fbd10feca04daeb99d20c8ce6a6d39/users/fe485d47df02496f96abc3be599760ea/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:21.025883 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318b5b7f-ba4a-4826-9bf7-21e0178fd290 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79fbd10feca04daeb99d20c8ce6a6d39, user_id=fe485d47df02496f96abc3be599760ea, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:21.029678 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318b5b7f-ba4a-4826-9bf7-21e0178fd290 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:21.050079 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1326/2640] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:19:20 2022] PUT /identity/v3/projects/79fbd10feca04daeb99d20c8ce6a6d39/users/fe485d47df02496f96abc3be599760ea/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:19:21.060761 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f260815-1196-48c0-a414-5b4250b89b15 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:21.061052 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f260815-1196-48c0-a414-5b4250b89b15 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:21.061325 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f260815-1196-48c0-a414-5b4250b89b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:21.091158 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-4f260815-1196-48c0-a414-5b4250b89b15 None None] MFA Rules not processed for user `fe485d47df02496f96abc3be599760ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:19:21.092568 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-4f260815-1196-48c0-a414-5b4250b89b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:21.162987 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:19:21.176584 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1315/2641] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:19:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:19:21.180859 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318b5b7f-ba4a-4826-9bf7-21e0178fd290 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:21.246335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318b5b7f-ba4a-4826-9bf7-21e0178fd290 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:21.251659 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5794a-4450-4573-8761-af0fb68fd274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:21.252359 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5794a-4450-4573-8761-af0fb68fd274 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:21.252643 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5794a-4450-4573-8761-af0fb68fd274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:21.252924 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5794a-4450-4573-8761-af0fb68fd274 admin admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:21.253626 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac5794a-4450-4573-8761-af0fb68fd274 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:21.255600 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac5794a-4450-4573-8761-af0fb68fd274 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:21.283226 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1327/2642] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:19:21 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:19:21.286758 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f260815-1196-48c0-a414-5b4250b89b15 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:21.298408 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f260815-1196-48c0-a414-5b4250b89b15 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:21.359394 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae2dacf-5acc-4985-adff-4446cb19bc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:21.360081 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2dacf-5acc-4985-adff-4446cb19bc74 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:21.360403 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2dacf-5acc-4985-adff-4446cb19bc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:21.360684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2dacf-5acc-4985-adff-4446cb19bc74 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:21.361366 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae2dacf-5acc-4985-adff-4446cb19bc74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:21.363705 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae2dacf-5acc-4985-adff-4446cb19bc74 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:21.384895 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1316/2643] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:19:21 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:19:21.389484 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5794a-4450-4573-8761-af0fb68fd274 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:21.399840 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5794a-4450-4573-8761-af0fb68fd274 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:21.405690 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f762da9e-c926-426f-aec2-5138e1990101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:21.406353 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762da9e-c926-426f-aec2-5138e1990101 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:21.406637 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762da9e-c926-426f-aec2-5138e1990101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:21.407022 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762da9e-c926-426f-aec2-5138e1990101 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:21.407748 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f762da9e-c926-426f-aec2-5138e1990101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:21.409389 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f762da9e-c926-426f-aec2-5138e1990101 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:21.420952 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1328/2644] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:19:21.424947 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae2dacf-5acc-4985-adff-4446cb19bc74 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:21.435298 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae2dacf-5acc-4985-adff-4446cb19bc74 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:21.439957 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528666b1-7a68-4423-b387-cb7b3b0a9214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:21.440670 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528666b1-7a68-4423-b387-cb7b3b0a9214 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:21.440955 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528666b1-7a68-4423-b387-cb7b3b0a9214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:21.441235 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528666b1-7a68-4423-b387-cb7b3b0a9214 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:21.442094 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528666b1-7a68-4423-b387-cb7b3b0a9214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:21.443707 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528666b1-7a68-4423-b387-cb7b3b0a9214 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:21.454426 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1317/2645] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:19:21.458741 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f762da9e-c926-426f-aec2-5138e1990101 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:21.470903 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f762da9e-c926-426f-aec2-5138e1990101 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:21.476259 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56759b72-2765-4879-aa2d-dbf1778aea58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:21.477149 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56759b72-2765-4879-aa2d-dbf1778aea58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:21.477430 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56759b72-2765-4879-aa2d-dbf1778aea58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:21.477709 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56759b72-2765-4879-aa2d-dbf1778aea58 admin admin] PATH_INFO: `/v3/projects/50e612b37fab4fa889c9d3f11874b573/users/0649c9630cc143cfa73b021a0d8f90fb/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:21.494214 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56759b72-2765-4879-aa2d-dbf1778aea58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50e612b37fab4fa889c9d3f11874b573, user_id=0649c9630cc143cfa73b021a0d8f90fb, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:21.496884 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56759b72-2765-4879-aa2d-dbf1778aea58 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:21.510551 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1329/2646] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:19:21 2022] PUT /identity/v3/projects/50e612b37fab4fa889c9d3f11874b573/users/0649c9630cc143cfa73b021a0d8f90fb/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:19:21.522451 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c303ab-7e3a-42fb-a7a8-f36767cb4c06 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:21.522964 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c303ab-7e3a-42fb-a7a8-f36767cb4c06 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:21.523098 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c303ab-7e3a-42fb-a7a8-f36767cb4c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:21.551363 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-a1c303ab-7e3a-42fb-a7a8-f36767cb4c06 None None] MFA Rules not processed for user `0649c9630cc143cfa73b021a0d8f90fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:19:21.552643 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a1c303ab-7e3a-42fb-a7a8-f36767cb4c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:21.628202 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1318/2647] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:19:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:19:21.629732 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56759b72-2765-4879-aa2d-dbf1778aea58 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:21.684317 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:19:21.721275 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56759b72-2765-4879-aa2d-dbf1778aea58 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:21.726507 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b91ab9-2a4c-4d96-aa88-7e40a17df5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:21.727212 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b91ab9-2a4c-4d96-aa88-7e40a17df5c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:21.727502 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b91ab9-2a4c-4d96-aa88-7e40a17df5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:21.727784 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b91ab9-2a4c-4d96-aa88-7e40a17df5c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:21.728526 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b91ab9-2a4c-4d96-aa88-7e40a17df5c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:21.730445 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b91ab9-2a4c-4d96-aa88-7e40a17df5c5 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:21.758813 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1330/2648] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:19:21 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:19:21.763104 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c303ab-7e3a-42fb-a7a8-f36767cb4c06 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:21.783830 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c303ab-7e3a-42fb-a7a8-f36767cb4c06 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:21.854344 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3940e5-2fc6-4811-8b2d-ea3305374d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:21.855124 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3940e5-2fc6-4811-8b2d-ea3305374d2d admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:21.855486 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3940e5-2fc6-4811-8b2d-ea3305374d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:21.856695 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3940e5-2fc6-4811-8b2d-ea3305374d2d admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:21.857688 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3940e5-2fc6-4811-8b2d-ea3305374d2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:21.859840 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3940e5-2fc6-4811-8b2d-ea3305374d2d admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:21.868530 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:19:21.885998 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1319/2649] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:19:21 2022] POST /identity/v3/users => generated 299 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 12:19:21.887320 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b91ab9-2a4c-4d96-aa88-7e40a17df5c5 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:21.897873 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b91ab9-2a4c-4d96-aa88-7e40a17df5c5 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:21.906266 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c3746-e4a3-4a14-b5ba-3e9dc9ff91c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:21.906950 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c3746-e4a3-4a14-b5ba-3e9dc9ff91c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:21.907238 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c3746-e4a3-4a14-b5ba-3e9dc9ff91c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:21.908146 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c3746-e4a3-4a14-b5ba-3e9dc9ff91c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:21.908910 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c3746-e4a3-4a14-b5ba-3e9dc9ff91c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:21.910896 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c3746-e4a3-4a14-b5ba-3e9dc9ff91c4 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:21.927223 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1331/2650] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:19:21.931348 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3940e5-2fc6-4811-8b2d-ea3305374d2d admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:21.941941 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3940e5-2fc6-4811-8b2d-ea3305374d2d admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:21.946554 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73578dc3-85db-4558-9e41-ce3cd61d8f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:21.947443 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73578dc3-85db-4558-9e41-ce3cd61d8f69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:21.947735 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73578dc3-85db-4558-9e41-ce3cd61d8f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:21.948007 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73578dc3-85db-4558-9e41-ce3cd61d8f69 admin admin] PATH_INFO: `/v3/projects/a3fede0f1ed44561a06f5e4604ed6264/users/f9e3777ed48241bc9a505c0bfa8904a9/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:21.964184 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73578dc3-85db-4558-9e41-ce3cd61d8f69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3fede0f1ed44561a06f5e4604ed6264, user_id=f9e3777ed48241bc9a505c0bfa8904a9, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:21.967230 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73578dc3-85db-4558-9e41-ce3cd61d8f69 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:21.982636 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1320/2651] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:19:21 2022] PUT /identity/v3/projects/a3fede0f1ed44561a06f5e4604ed6264/users/f9e3777ed48241bc9a505c0bfa8904a9/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:19:21.986835 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c3746-e4a3-4a14-b5ba-3e9dc9ff91c4 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:21.997463 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c3746-e4a3-4a14-b5ba-3e9dc9ff91c4 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:22.058384 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae710773-5045-4c9c-8fce-1ca51c2d0c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:22.059126 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae710773-5045-4c9c-8fce-1ca51c2d0c48 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:22.060139 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae710773-5045-4c9c-8fce-1ca51c2d0c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:22.060139 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae710773-5045-4c9c-8fce-1ca51c2d0c48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:22.061133 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae710773-5045-4c9c-8fce-1ca51c2d0c48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:22.062703 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae710773-5045-4c9c-8fce-1ca51c2d0c48 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:22.077800 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1332/2652] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:19:22.079529 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73578dc3-85db-4558-9e41-ce3cd61d8f69 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:22.092457 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73578dc3-85db-4558-9e41-ce3cd61d8f69 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:22.102591 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677d2e4-829a-4aa8-83fa-0459b945a1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:22.103734 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677d2e4-829a-4aa8-83fa-0459b945a1f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:22.104090 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677d2e4-829a-4aa8-83fa-0459b945a1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:22.104602 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677d2e4-829a-4aa8-83fa-0459b945a1f1 admin admin] PATH_INFO: `/v3/projects/a3fede0f1ed44561a06f5e4604ed6264/users/f9e3777ed48241bc9a505c0bfa8904a9/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:22.108340 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9677d2e4-829a-4aa8-83fa-0459b945a1f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3fede0f1ed44561a06f5e4604ed6264, user_id=f9e3777ed48241bc9a505c0bfa8904a9, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:22.111570 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9677d2e4-829a-4aa8-83fa-0459b945a1f1 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:22.126330 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1321/2653] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:19:22 2022] PUT /identity/v3/projects/a3fede0f1ed44561a06f5e4604ed6264/users/f9e3777ed48241bc9a505c0bfa8904a9/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:19:22.136570 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70ee7e-94ff-4e6f-ad00-2258191d251c None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:22.136885 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70ee7e-94ff-4e6f-ad00-2258191d251c None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:22.137232 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70ee7e-94ff-4e6f-ad00-2258191d251c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:22.174091 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-fb70ee7e-94ff-4e6f-ad00-2258191d251c None None] MFA Rules not processed for user `f9e3777ed48241bc9a505c0bfa8904a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:19:22.175872 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-fb70ee7e-94ff-4e6f-ad00-2258191d251c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:22.260934 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1333/2654] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:19:22 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:19:22.275982 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677d2e4-829a-4aa8-83fa-0459b945a1f1 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:22.278755 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-9677d2e4-829a-4aa8-83fa-0459b945a1f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:22.340182 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677d2e4-829a-4aa8-83fa-0459b945a1f1 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:22.345151 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60589d40-70e5-4319-934e-c2b957565b54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:22.345799 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60589d40-70e5-4319-934e-c2b957565b54 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:22.346079 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60589d40-70e5-4319-934e-c2b957565b54 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:22.346390 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60589d40-70e5-4319-934e-c2b957565b54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:22.412513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60589d40-70e5-4319-934e-c2b957565b54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:22.413948 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60589d40-70e5-4319-934e-c2b957565b54 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:22.423254 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1322/2655] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:19:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:19:23.941579 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70ee7e-94ff-4e6f-ad00-2258191d251c None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:23.943071 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-fb70ee7e-94ff-4e6f-ad00-2258191d251c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:23.955654 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70ee7e-94ff-4e6f-ad00-2258191d251c None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:23.959136 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df9ab3f-b0ef-4315-8034-196af4c3652e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:23.959817 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9ab3f-b0ef-4315-8034-196af4c3652e service cinder] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:23.960138 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9ab3f-b0ef-4315-8034-196af4c3652e service cinder] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:23.960519 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9ab3f-b0ef-4315-8034-196af4c3652e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:23.995599 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:19:24.038934 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df9ab3f-b0ef-4315-8034-196af4c3652e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:24.040637 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df9ab3f-b0ef-4315-8034-196af4c3652e service cinder] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:24.056721 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1334/2656] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:19:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:19:24.075424 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60589d40-70e5-4319-934e-c2b957565b54 service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:24.077432 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-60589d40-70e5-4319-934e-c2b957565b54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:24.138098 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60589d40-70e5-4319-934e-c2b957565b54 service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:24.142046 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af105353-9bc5-43c0-b329-92d339ff296d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:24.142706 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af105353-9bc5-43c0-b329-92d339ff296d service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:24.143121 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af105353-9bc5-43c0-b329-92d339ff296d service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:24.143259 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af105353-9bc5-43c0-b329-92d339ff296d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:24.145315 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-af105353-9bc5-43c0-b329-92d339ff296d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:24.177760 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:19:24.228672 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af105353-9bc5-43c0-b329-92d339ff296d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:24.230133 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af105353-9bc5-43c0-b329-92d339ff296d service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:24.240640 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1323/2657] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:19:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:19:24.636131 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df9ab3f-b0ef-4315-8034-196af4c3652e service cinder] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:24.645605 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df9ab3f-b0ef-4315-8034-196af4c3652e service cinder] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:24.649730 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d0127-62cf-498c-82ba-0837fa7416d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:24.650128 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d0127-62cf-498c-82ba-0837fa7416d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:24.650410 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d0127-62cf-498c-82ba-0837fa7416d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:24.650690 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d0127-62cf-498c-82ba-0837fa7416d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:24.659908 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d0127-62cf-498c-82ba-0837fa7416d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:24.661410 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d0127-62cf-498c-82ba-0837fa7416d4 service cinder] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:24.672466 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1335/2658] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:19:24 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:19:25.049063 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af105353-9bc5-43c0-b329-92d339ff296d service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:25.050462 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-af105353-9bc5-43c0-b329-92d339ff296d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:25.065620 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af105353-9bc5-43c0-b329-92d339ff296d service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:25.070706 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f925eb17-0101-48ab-9fe8-3c4f555a9bba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:25.071425 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925eb17-0101-48ab-9fe8-3c4f555a9bba service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:25.071723 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925eb17-0101-48ab-9fe8-3c4f555a9bba service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:25.071989 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925eb17-0101-48ab-9fe8-3c4f555a9bba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:25.074094 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f925eb17-0101-48ab-9fe8-3c4f555a9bba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:25.151156 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f925eb17-0101-48ab-9fe8-3c4f555a9bba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:25.152654 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f925eb17-0101-48ab-9fe8-3c4f555a9bba service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:25.163230 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1324/2659] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:19:25 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:19:28.409913 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d0127-62cf-498c-82ba-0837fa7416d4 service cinder] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:28.412239 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-048d0127-62cf-498c-82ba-0837fa7416d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:28.430971 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d0127-62cf-498c-82ba-0837fa7416d4 service cinder] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:28.437471 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd97c82-cbef-48f0-b0cb-cfa60922210c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:28.438361 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd97c82-cbef-48f0-b0cb-cfa60922210c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:28.438639 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd97c82-cbef-48f0-b0cb-cfa60922210c admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:28.438913 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd97c82-cbef-48f0-b0cb-cfa60922210c admin admin] PATH_INFO: `/v3/users/8c9b1729824c4d2793b8af88a1184ad0` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:28.440090 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd97c82-cbef-48f0-b0cb-cfa60922210c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c9b1729824c4d2793b8af88a1184ad0)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:28.442543 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd97c82-cbef-48f0-b0cb-cfa60922210c admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:28.497863 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-3cd97c82-cbef-48f0-b0cb-cfa60922210c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c9b1729824c4d2793b8af88a1184ad0'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:28.505368 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-3cd97c82-cbef-48f0-b0cb-cfa60922210c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c9b1729824c4d2793b8af88a1184ad0'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:28.506134 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-3cd97c82-cbef-48f0-b0cb-cfa60922210c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c9b1729824c4d2793b8af88a1184ad0'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:28.506925 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-3cd97c82-cbef-48f0-b0cb-cfa60922210c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c9b1729824c4d2793b8af88a1184ad0'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:28.520036 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-3cd97c82-cbef-48f0-b0cb-cfa60922210c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c9b1729824c4d2793b8af88a1184ad0'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:28.534802 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1336/2660] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:19:28 2022] DELETE /identity/v3/users/8c9b1729824c4d2793b8af88a1184ad0 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:19:28.702313 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f925eb17-0101-48ab-9fe8-3c4f555a9bba service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:28.713658 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f925eb17-0101-48ab-9fe8-3c4f555a9bba service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:28.734743 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd97c82-cbef-48f0-b0cb-cfa60922210c admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:28.738592 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-3cd97c82-cbef-48f0-b0cb-cfa60922210c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:28.794211 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a67b3-8d35-4475-b8a3-e9dc8929d7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:28.795086 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a67b3-8d35-4475-b8a3-e9dc8929d7f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:28.795362 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a67b3-8d35-4475-b8a3-e9dc8929d7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:28.795635 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a67b3-8d35-4475-b8a3-e9dc8929d7f7 admin admin] PATH_INFO: `/v3/users/fe485d47df02496f96abc3be599760ea` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:28.796827 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74a67b3-8d35-4475-b8a3-e9dc8929d7f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe485d47df02496f96abc3be599760ea)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:28.798781 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74a67b3-8d35-4475-b8a3-e9dc8929d7f7 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:28.814714 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd97c82-cbef-48f0-b0cb-cfa60922210c admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:28.819364 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6f729-bfb8-4294-b0a2-79796545e748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:28.820264 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6f729-bfb8-4294-b0a2-79796545e748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:28.820555 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6f729-bfb8-4294-b0a2-79796545e748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:28.820839 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6f729-bfb8-4294-b0a2-79796545e748 admin admin] PATH_INFO: `/v3/projects/dec778bcd9444d4ba49cee429a2f687c` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:28.822061 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec6f729-bfb8-4294-b0a2-79796545e748 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dec778bcd9444d4ba49cee429a2f687c)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:28.824551 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec6f729-bfb8-4294-b0a2-79796545e748 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:28.857509 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b74a67b3-8d35-4475-b8a3-e9dc8929d7f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe485d47df02496f96abc3be599760ea'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:28.858136 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b74a67b3-8d35-4475-b8a3-e9dc8929d7f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe485d47df02496f96abc3be599760ea'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:28.858750 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b74a67b3-8d35-4475-b8a3-e9dc8929d7f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe485d47df02496f96abc3be599760ea'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:28.864644 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:19:28.866802 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b74a67b3-8d35-4475-b8a3-e9dc8929d7f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe485d47df02496f96abc3be599760ea'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:28.878312 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:19:28.882346 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b74a67b3-8d35-4475-b8a3-e9dc8929d7f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe485d47df02496f96abc3be599760ea'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:28.894725 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-aec6f729-bfb8-4294-b0a2-79796545e748 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dec778bcd9444d4ba49cee429a2f687c', 'request_id': 'req-aec6f729-bfb8-4294-b0a2-79796545e748'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:28.896093 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1325/2661] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:19:28 2022] DELETE /identity/v3/users/fe485d47df02496f96abc3be599760ea => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:19:28.900771 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642790b2-c728-4e77-a0fb-8be43dc8f875 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:28.901390 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642790b2-c728-4e77-a0fb-8be43dc8f875 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:28.901664 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642790b2-c728-4e77-a0fb-8be43dc8f875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:28.905730 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-aec6f729-bfb8-4294-b0a2-79796545e748 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dec778bcd9444d4ba49cee429a2f687c', 'request_id': 'req-aec6f729-bfb8-4294-b0a2-79796545e748'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:28.911676 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-aec6f729-bfb8-4294-b0a2-79796545e748 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dec778bcd9444d4ba49cee429a2f687c', 'request_id': 'req-aec6f729-bfb8-4294-b0a2-79796545e748'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:28.919991 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-642790b2-c728-4e77-a0fb-8be43dc8f875 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:19:28.921441 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-642790b2-c728-4e77-a0fb-8be43dc8f875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:28.923346 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-aec6f729-bfb8-4294-b0a2-79796545e748 admin admin] The token cache is being invalidate because project dec778bcd9444d4ba49cee429a2f687c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:19:28.923638 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-aec6f729-bfb8-4294-b0a2-79796545e748 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:28.924301 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-aec6f729-bfb8-4294-b0a2-79796545e748 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:28.925856 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1337/2662] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:19:28 2022] DELETE /identity/v3/projects/dec778bcd9444d4ba49cee429a2f687c => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:19:28.930640 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d09441-4577-4ea1-ac2f-e9ea09680be5 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:28.930933 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d09441-4577-4ea1-ac2f-e9ea09680be5 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:28.931221 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d09441-4577-4ea1-ac2f-e9ea09680be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:28.949516 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-01d09441-4577-4ea1-ac2f-e9ea09680be5 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:19:28.950941 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-01d09441-4577-4ea1-ac2f-e9ea09680be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:28.997042 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1326/2663] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:19:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:19:29.007487 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642790b2-c728-4e77-a0fb-8be43dc8f875 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:29.009252 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-642790b2-c728-4e77-a0fb-8be43dc8f875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:29.016058 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1338/2664] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:19:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:19:29.023662 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e4e40-2834-4302-b33d-9c5c71743fa7 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:29.024340 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e4e40-2834-4302-b33d-9c5c71743fa7 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:29.024340 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e4e40-2834-4302-b33d-9c5c71743fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:29.044248 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-152e4e40-2834-4302-b33d-9c5c71743fa7 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:19:29.046556 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-152e4e40-2834-4302-b33d-9c5c71743fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:29.060823 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1339/2665] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:19:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:19:29.061736 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e4e40-2834-4302-b33d-9c5c71743fa7 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:29.071834 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e4e40-2834-4302-b33d-9c5c71743fa7 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:29.077722 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4119352-1212-403a-a77f-7a83063908a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:29.078447 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4119352-1212-403a-a77f-7a83063908a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:29.078801 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4119352-1212-403a-a77f-7a83063908a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:29.079081 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4119352-1212-403a-a77f-7a83063908a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:29.079809 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4119352-1212-403a-a77f-7a83063908a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:19:29.080248 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4119352-1212-403a-a77f-7a83063908a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:29.081875 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642790b2-c728-4e77-a0fb-8be43dc8f875 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:29.082008 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4119352-1212-403a-a77f-7a83063908a9 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:29.085607 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc3712-1750-4a63-8b3c-6a47d9c30eb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:29.086300 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc3712-1750-4a63-8b3c-6a47d9c30eb5 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:29.086549 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc3712-1750-4a63-8b3c-6a47d9c30eb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:29.086832 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc3712-1750-4a63-8b3c-6a47d9c30eb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:29.096604 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1340/2666] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:19:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:19:29.100603 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdc3712-1750-4a63-8b3c-6a47d9c30eb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:29.101170 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4119352-1212-403a-a77f-7a83063908a9 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:29.102229 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdc3712-1750-4a63-8b3c-6a47d9c30eb5 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:29.113087 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4119352-1212-403a-a77f-7a83063908a9 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:29.114240 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1327/2667] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:19:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:19:29.118018 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f274ff-0dc1-439e-8c6b-a42f5ff20d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:29.118669 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f274ff-0dc1-439e-8c6b-a42f5ff20d59 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:29.118954 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f274ff-0dc1-439e-8c6b-a42f5ff20d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:29.119228 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f274ff-0dc1-439e-8c6b-a42f5ff20d59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:29.119906 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f274ff-0dc1-439e-8c6b-a42f5ff20d59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:29.121889 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f274ff-0dc1-439e-8c6b-a42f5ff20d59 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:29.148450 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1341/2668] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:19:29 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 12:19:29.153350 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc3712-1750-4a63-8b3c-6a47d9c30eb5 service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:29.164435 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc3712-1750-4a63-8b3c-6a47d9c30eb5 service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:29.227773 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7979e-04e2-4a37-8981-0e7fd89a4243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:29.228482 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7979e-04e2-4a37-8981-0e7fd89a4243 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:29.228772 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7979e-04e2-4a37-8981-0e7fd89a4243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:29.229049 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7979e-04e2-4a37-8981-0e7fd89a4243 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:29.229752 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b7979e-04e2-4a37-8981-0e7fd89a4243 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:29.232134 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b7979e-04e2-4a37-8981-0e7fd89a4243 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:29.252316 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1328/2669] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:19:29 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:19:29.256433 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f274ff-0dc1-439e-8c6b-a42f5ff20d59 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:29.268473 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f274ff-0dc1-439e-8c6b-a42f5ff20d59 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:29.274253 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0bea5-cb15-4b28-925e-c41ee196a0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:29.275009 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0bea5-cb15-4b28-925e-c41ee196a0b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:29.275364 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0bea5-cb15-4b28-925e-c41ee196a0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:29.275709 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0bea5-cb15-4b28-925e-c41ee196a0b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:29.276665 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c0bea5-cb15-4b28-925e-c41ee196a0b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:29.279742 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c0bea5-cb15-4b28-925e-c41ee196a0b4 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:29.290591 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1342/2670] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:19:29.295244 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7979e-04e2-4a37-8981-0e7fd89a4243 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:29.301870 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:19:29.306293 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7979e-04e2-4a37-8981-0e7fd89a4243 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:29.313074 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ebc1c2-b25d-458a-8f60-7e54c7d503d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:29.313754 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ebc1c2-b25d-458a-8f60-7e54c7d503d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:29.314111 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ebc1c2-b25d-458a-8f60-7e54c7d503d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:29.315206 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ebc1c2-b25d-458a-8f60-7e54c7d503d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:29.315927 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ebc1c2-b25d-458a-8f60-7e54c7d503d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:29.317626 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ebc1c2-b25d-458a-8f60-7e54c7d503d2 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:29.332398 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1329/2671] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:19:29.334051 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0bea5-cb15-4b28-925e-c41ee196a0b4 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:29.345148 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0bea5-cb15-4b28-925e-c41ee196a0b4 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:29.349727 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8567aba5-8e29-408e-a9fe-56b0c146083a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:29.350639 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567aba5-8e29-408e-a9fe-56b0c146083a admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:29.350924 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567aba5-8e29-408e-a9fe-56b0c146083a admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:29.351199 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567aba5-8e29-408e-a9fe-56b0c146083a admin admin] PATH_INFO: `/v3/projects/8993a902264f4fed89510e0334f320c3/users/a3aab04569fb4dd7addf9bba8c3a5094/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:29.367721 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8567aba5-8e29-408e-a9fe-56b0c146083a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8993a902264f4fed89510e0334f320c3, user_id=a3aab04569fb4dd7addf9bba8c3a5094, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:29.370389 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8567aba5-8e29-408e-a9fe-56b0c146083a admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:29.387904 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1343/2672] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:19:29 2022] PUT /identity/v3/projects/8993a902264f4fed89510e0334f320c3/users/a3aab04569fb4dd7addf9bba8c3a5094/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:19:29.399094 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce57aae-5806-47d3-bfa0-c8ed07344dc8 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:29.399425 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce57aae-5806-47d3-bfa0-c8ed07344dc8 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:29.399775 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce57aae-5806-47d3-bfa0-c8ed07344dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:29.417186 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8567aba5-8e29-408e-a9fe-56b0c146083a admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:29.420950 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-8567aba5-8e29-408e-a9fe-56b0c146083a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:29.430430 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-3ce57aae-5806-47d3-bfa0-c8ed07344dc8 None None] MFA Rules not processed for user `a3aab04569fb4dd7addf9bba8c3a5094`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:19:29.432296 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-3ce57aae-5806-47d3-bfa0-c8ed07344dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:29.491398 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:19:29.515430 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8567aba5-8e29-408e-a9fe-56b0c146083a admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:29.520032 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8abb382-ac5d-440b-babf-aad3c1efd885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:29.520978 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abb382-ac5d-440b-babf-aad3c1efd885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:29.521262 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abb382-ac5d-440b-babf-aad3c1efd885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:29.521723 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1330/2673] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:19:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:19:29.521861 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abb382-ac5d-440b-babf-aad3c1efd885 admin admin] PATH_INFO: `/v3/projects/79fbd10feca04daeb99d20c8ce6a6d39` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:29.522692 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8abb382-ac5d-440b-babf-aad3c1efd885 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79fbd10feca04daeb99d20c8ce6a6d39)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:29.524856 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8abb382-ac5d-440b-babf-aad3c1efd885 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:29.532869 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce57aae-5806-47d3-bfa0-c8ed07344dc8 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:29.534240 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-3ce57aae-5806-47d3-bfa0-c8ed07344dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:29.576374 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-a8abb382-ac5d-440b-babf-aad3c1efd885 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79fbd10feca04daeb99d20c8ce6a6d39', 'request_id': 'req-a8abb382-ac5d-440b-babf-aad3c1efd885'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:29.589814 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-a8abb382-ac5d-440b-babf-aad3c1efd885 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79fbd10feca04daeb99d20c8ce6a6d39', 'request_id': 'req-a8abb382-ac5d-440b-babf-aad3c1efd885'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:29.596724 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-a8abb382-ac5d-440b-babf-aad3c1efd885 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79fbd10feca04daeb99d20c8ce6a6d39', 'request_id': 'req-a8abb382-ac5d-440b-babf-aad3c1efd885'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:29.608388 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-a8abb382-ac5d-440b-babf-aad3c1efd885 admin admin] The token cache is being invalidate because project 79fbd10feca04daeb99d20c8ce6a6d39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:19:29.608762 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-a8abb382-ac5d-440b-babf-aad3c1efd885 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:29.609541 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-a8abb382-ac5d-440b-babf-aad3c1efd885 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:29.611177 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1344/2674] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:19:29 2022] DELETE /identity/v3/projects/79fbd10feca04daeb99d20c8ce6a6d39 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:19:29.615159 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8abb382-ac5d-440b-babf-aad3c1efd885 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:29.616665 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-a8abb382-ac5d-440b-babf-aad3c1efd885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:29.617668 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce57aae-5806-47d3-bfa0-c8ed07344dc8 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:29.682312 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8abb382-ac5d-440b-babf-aad3c1efd885 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:29.683258 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f27d6d5-4299-4b7d-bf9c-6d98bbca053e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef7edb5e9ce49e6b098f48bf060b228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:29.684592 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27d6d5-4299-4b7d-bf9c-6d98bbca053e service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:29.684876 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27d6d5-4299-4b7d-bf9c-6d98bbca053e service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:29.685210 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27d6d5-4299-4b7d-bf9c-6d98bbca053e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:29.686931 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-8f27d6d5-4299-4b7d-bf9c-6d98bbca053e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:29.687912 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b99375-dd59-4b49-9ed0-f9abea76116a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:29.688851 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b99375-dd59-4b49-9ed0-f9abea76116a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:29.689137 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b99375-dd59-4b49-9ed0-f9abea76116a admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:29.689415 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b99375-dd59-4b49-9ed0-f9abea76116a admin admin] PATH_INFO: `/v3/users/0649c9630cc143cfa73b021a0d8f90fb` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:29.690591 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b99375-dd59-4b49-9ed0-f9abea76116a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0649c9630cc143cfa73b021a0d8f90fb)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:29.692619 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b99375-dd59-4b49-9ed0-f9abea76116a admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:29.705523 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:19:29.742063 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-b5b99375-dd59-4b49-9ed0-f9abea76116a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0649c9630cc143cfa73b021a0d8f90fb'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:29.749547 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-b5b99375-dd59-4b49-9ed0-f9abea76116a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0649c9630cc143cfa73b021a0d8f90fb'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:29.750312 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-b5b99375-dd59-4b49-9ed0-f9abea76116a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0649c9630cc143cfa73b021a0d8f90fb'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:29.750817 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f27d6d5-4299-4b7d-bf9c-6d98bbca053e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:29.751006 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-b5b99375-dd59-4b49-9ed0-f9abea76116a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0649c9630cc143cfa73b021a0d8f90fb'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:29.752504 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f27d6d5-4299-4b7d-bf9c-6d98bbca053e service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:29.761535 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1331/2675] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:19:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 12:19:29.764064 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-b5b99375-dd59-4b49-9ed0-f9abea76116a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0649c9630cc143cfa73b021a0d8f90fb'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:29.765749 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:19:29.779210 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1345/2676] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:19:29 2022] DELETE /identity/v3/users/0649c9630cc143cfa73b021a0d8f90fb => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:19:30.069156 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f27d6d5-4299-4b7d-bf9c-6d98bbca053e service nova] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:30.082658 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f27d6d5-4299-4b7d-bf9c-6d98bbca053e service nova] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:30.195890 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1921c32-e43d-4d3a-a0ba-33616fc1935c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:30.197027 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1921c32-e43d-4d3a-a0ba-33616fc1935c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:30.197467 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1921c32-e43d-4d3a-a0ba-33616fc1935c admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:30.197895 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1921c32-e43d-4d3a-a0ba-33616fc1935c admin admin] PATH_INFO: `/v3/projects/50e612b37fab4fa889c9d3f11874b573` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:30.199413 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1921c32-e43d-4d3a-a0ba-33616fc1935c admin admin] RBAC: Authorizing `identity:delete_project(project_id=50e612b37fab4fa889c9d3f11874b573)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:30.202000 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1921c32-e43d-4d3a-a0ba-33616fc1935c admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:30.252842 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-e1921c32-e43d-4d3a-a0ba-33616fc1935c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50e612b37fab4fa889c9d3f11874b573', 'request_id': 'req-e1921c32-e43d-4d3a-a0ba-33616fc1935c'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:30.260867 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-e1921c32-e43d-4d3a-a0ba-33616fc1935c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50e612b37fab4fa889c9d3f11874b573', 'request_id': 'req-e1921c32-e43d-4d3a-a0ba-33616fc1935c'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:30.267321 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-e1921c32-e43d-4d3a-a0ba-33616fc1935c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50e612b37fab4fa889c9d3f11874b573', 'request_id': 'req-e1921c32-e43d-4d3a-a0ba-33616fc1935c'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:30.279134 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-e1921c32-e43d-4d3a-a0ba-33616fc1935c admin admin] The token cache is being invalidate because project 50e612b37fab4fa889c9d3f11874b573 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:19:30.279425 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-e1921c32-e43d-4d3a-a0ba-33616fc1935c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:30.280066 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-e1921c32-e43d-4d3a-a0ba-33616fc1935c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:30.281633 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1332/2677] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:19:30 2022] DELETE /identity/v3/projects/50e612b37fab4fa889c9d3f11874b573 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:19:30.285745 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b99375-dd59-4b49-9ed0-f9abea76116a admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:30.287176 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-b5b99375-dd59-4b49-9ed0-f9abea76116a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:30.300221 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b99375-dd59-4b49-9ed0-f9abea76116a admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:30.359200 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a97c0-2dc3-4f8c-bf5e-fe47ec5d86c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:30.360081 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a97c0-2dc3-4f8c-bf5e-fe47ec5d86c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:30.360400 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a97c0-2dc3-4f8c-bf5e-fe47ec5d86c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:30.360682 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a97c0-2dc3-4f8c-bf5e-fe47ec5d86c5 admin admin] PATH_INFO: `/v3/users/f9e3777ed48241bc9a505c0bfa8904a9` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:30.361867 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68a97c0-2dc3-4f8c-bf5e-fe47ec5d86c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9e3777ed48241bc9a505c0bfa8904a9)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:30.363780 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68a97c0-2dc3-4f8c-bf5e-fe47ec5d86c5 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:30.409436 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-e68a97c0-2dc3-4f8c-bf5e-fe47ec5d86c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9e3777ed48241bc9a505c0bfa8904a9'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:30.416131 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-e68a97c0-2dc3-4f8c-bf5e-fe47ec5d86c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9e3777ed48241bc9a505c0bfa8904a9'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:30.416787 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-e68a97c0-2dc3-4f8c-bf5e-fe47ec5d86c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9e3777ed48241bc9a505c0bfa8904a9'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:30.417406 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-e68a97c0-2dc3-4f8c-bf5e-fe47ec5d86c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9e3777ed48241bc9a505c0bfa8904a9'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:30.429353 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-e68a97c0-2dc3-4f8c-bf5e-fe47ec5d86c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9e3777ed48241bc9a505c0bfa8904a9'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:30.442512 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1346/2678] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:19:30 2022] DELETE /identity/v3/users/f9e3777ed48241bc9a505c0bfa8904a9 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:19:30.720663 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1921c32-e43d-4d3a-a0ba-33616fc1935c admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:30.722170 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-e1921c32-e43d-4d3a-a0ba-33616fc1935c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:30.735932 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1921c32-e43d-4d3a-a0ba-33616fc1935c admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:30.783459 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:19:30.797081 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b5e606-6ef4-4d79-86a4-9ba98b492c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:30.797950 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5e606-6ef4-4d79-86a4-9ba98b492c16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:30.798233 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5e606-6ef4-4d79-86a4-9ba98b492c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:30.798510 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5e606-6ef4-4d79-86a4-9ba98b492c16 admin admin] PATH_INFO: `/v3/projects/a3fede0f1ed44561a06f5e4604ed6264` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:30.799683 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b5e606-6ef4-4d79-86a4-9ba98b492c16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3fede0f1ed44561a06f5e4604ed6264)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:30.801638 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b5e606-6ef4-4d79-86a4-9ba98b492c16 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:30.849117 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b9b5e606-6ef4-4d79-86a4-9ba98b492c16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3fede0f1ed44561a06f5e4604ed6264', 'request_id': 'req-b9b5e606-6ef4-4d79-86a4-9ba98b492c16'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:30.858033 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b9b5e606-6ef4-4d79-86a4-9ba98b492c16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3fede0f1ed44561a06f5e4604ed6264', 'request_id': 'req-b9b5e606-6ef4-4d79-86a4-9ba98b492c16'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:30.863519 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b9b5e606-6ef4-4d79-86a4-9ba98b492c16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3fede0f1ed44561a06f5e4604ed6264', 'request_id': 'req-b9b5e606-6ef4-4d79-86a4-9ba98b492c16'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:30.875830 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b9b5e606-6ef4-4d79-86a4-9ba98b492c16 admin admin] The token cache is being invalidate because project a3fede0f1ed44561a06f5e4604ed6264 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:19:30.876122 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b9b5e606-6ef4-4d79-86a4-9ba98b492c16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:30.876788 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b9b5e606-6ef4-4d79-86a4-9ba98b492c16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:30.878316 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1333/2679] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:19:30 2022] DELETE /identity/v3/projects/a3fede0f1ed44561a06f5e4604ed6264 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:19:40.438809 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=55 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:19:40.871713 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=29,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:19:47.634908 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a97c0-2dc3-4f8c-bf5e-fe47ec5d86c5 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:47.634908 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-e68a97c0-2dc3-4f8c-bf5e-fe47ec5d86c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:47.648493 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a97c0-2dc3-4f8c-bf5e-fe47ec5d86c5 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:47.706715 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26daa65a-a0da-4d6f-be59-0eba47e4e1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:47.707602 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26daa65a-a0da-4d6f-be59-0eba47e4e1a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:47.707885 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26daa65a-a0da-4d6f-be59-0eba47e4e1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:47.708161 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26daa65a-a0da-4d6f-be59-0eba47e4e1a6 admin admin] PATH_INFO: `/v3/users/a3aab04569fb4dd7addf9bba8c3a5094` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:47.709377 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26daa65a-a0da-4d6f-be59-0eba47e4e1a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3aab04569fb4dd7addf9bba8c3a5094)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:47.711293 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26daa65a-a0da-4d6f-be59-0eba47e4e1a6 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:47.757501 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-26daa65a-a0da-4d6f-be59-0eba47e4e1a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3aab04569fb4dd7addf9bba8c3a5094'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:47.764979 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-26daa65a-a0da-4d6f-be59-0eba47e4e1a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3aab04569fb4dd7addf9bba8c3a5094'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:47.765631 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-26daa65a-a0da-4d6f-be59-0eba47e4e1a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3aab04569fb4dd7addf9bba8c3a5094'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:47.766237 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-26daa65a-a0da-4d6f-be59-0eba47e4e1a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3aab04569fb4dd7addf9bba8c3a5094'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:47.778766 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-26daa65a-a0da-4d6f-be59-0eba47e4e1a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3aab04569fb4dd7addf9bba8c3a5094'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:47.791682 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1347/2680] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:19:47 2022] DELETE /identity/v3/users/a3aab04569fb4dd7addf9bba8c3a5094 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:19:47.796873 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e62ea-0c35-4ced-9f08-7e58d2d99f33 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:47.797373 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e62ea-0c35-4ced-9f08-7e58d2d99f33 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:47.797491 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e62ea-0c35-4ced-9f08-7e58d2d99f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:47.815078 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-157e62ea-0c35-4ced-9f08-7e58d2d99f33 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:19:47.816322 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-157e62ea-0c35-4ced-9f08-7e58d2d99f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:47.874812 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1334/2681] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:19:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:19:47.884519 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26daa65a-a0da-4d6f-be59-0eba47e4e1a6 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:47.886002 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-26daa65a-a0da-4d6f-be59-0eba47e4e1a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:47.942531 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26daa65a-a0da-4d6f-be59-0eba47e4e1a6 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:47.946146 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126811ad-e5d4-4072-88a9-b2daaee7d65f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:47.946790 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126811ad-e5d4-4072-88a9-b2daaee7d65f service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:47.947075 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126811ad-e5d4-4072-88a9-b2daaee7d65f service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:47.947352 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126811ad-e5d4-4072-88a9-b2daaee7d65f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:47.956686 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126811ad-e5d4-4072-88a9-b2daaee7d65f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:47.958119 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126811ad-e5d4-4072-88a9-b2daaee7d65f service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:47.967589 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1348/2682] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:19:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:19:48.235480 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e62ea-0c35-4ced-9f08-7e58d2d99f33 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:48.237005 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-157e62ea-0c35-4ced-9f08-7e58d2d99f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:48.250312 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e62ea-0c35-4ced-9f08-7e58d2d99f33 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:48.255210 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506ff55-b51e-421d-9d82-6f5a5329ab8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:48.256148 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506ff55-b51e-421d-9d82-6f5a5329ab8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:48.256536 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506ff55-b51e-421d-9d82-6f5a5329ab8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:48.256915 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506ff55-b51e-421d-9d82-6f5a5329ab8a admin admin] PATH_INFO: `/v3/projects/8993a902264f4fed89510e0334f320c3` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:48.258308 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7506ff55-b51e-421d-9d82-6f5a5329ab8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8993a902264f4fed89510e0334f320c3)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:48.260641 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7506ff55-b51e-421d-9d82-6f5a5329ab8a admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:48.328943 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-7506ff55-b51e-421d-9d82-6f5a5329ab8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8993a902264f4fed89510e0334f320c3', 'request_id': 'req-7506ff55-b51e-421d-9d82-6f5a5329ab8a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:48.336302 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126811ad-e5d4-4072-88a9-b2daaee7d65f service neutron] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:48.337148 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-7506ff55-b51e-421d-9d82-6f5a5329ab8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8993a902264f4fed89510e0334f320c3', 'request_id': 'req-7506ff55-b51e-421d-9d82-6f5a5329ab8a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:48.337748 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-126811ad-e5d4-4072-88a9-b2daaee7d65f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:48.349307 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-7506ff55-b51e-421d-9d82-6f5a5329ab8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8993a902264f4fed89510e0334f320c3', 'request_id': 'req-7506ff55-b51e-421d-9d82-6f5a5329ab8a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:48.367548 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-7506ff55-b51e-421d-9d82-6f5a5329ab8a admin admin] The token cache is being invalidate because project 8993a902264f4fed89510e0334f320c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:19:48.368263 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-7506ff55-b51e-421d-9d82-6f5a5329ab8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:48.378583 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:19:48.380185 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-7506ff55-b51e-421d-9d82-6f5a5329ab8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:48.383247 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1335/2683] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:19:48 2022] DELETE /identity/v3/projects/8993a902264f4fed89510e0334f320c3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:19:48.389737 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e11e08-8e25-4db1-b71c-1f70018e851f None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:48.393981 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e11e08-8e25-4db1-b71c-1f70018e851f None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:48.393981 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e11e08-8e25-4db1-b71c-1f70018e851f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:48.417777 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-56e11e08-8e25-4db1-b71c-1f70018e851f None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:19:48.420553 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-56e11e08-8e25-4db1-b71c-1f70018e851f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:48.461985 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126811ad-e5d4-4072-88a9-b2daaee7d65f service neutron] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:48.494257 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1336/2684] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:19:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:19:48.502947 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c540e-5a7f-49c3-a38a-4ec5e52839ef None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:48.503239 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c540e-5a7f-49c3-a38a-4ec5e52839ef None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:48.503520 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c540e-5a7f-49c3-a38a-4ec5e52839ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:48.523182 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-8f6c540e-5a7f-49c3-a38a-4ec5e52839ef None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:19:48.524426 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-8f6c540e-5a7f-49c3-a38a-4ec5e52839ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:48.532132 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c9d99-9d64-4db3-92f0-2f01ca52f7a6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9009560a846414b849d42efa8625ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:48.532851 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c9d99-9d64-4db3-92f0-2f01ca52f7a6 service placement] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:48.533146 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c9d99-9d64-4db3-92f0-2f01ca52f7a6 service placement] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:48.533424 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c9d99-9d64-4db3-92f0-2f01ca52f7a6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:48.536283 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1337/2685] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:19:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:19:48.537256 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-535c9d99-9d64-4db3-92f0-2f01ca52f7a6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:48.538553 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c540e-5a7f-49c3-a38a-4ec5e52839ef None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:48.549897 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c540e-5a7f-49c3-a38a-4ec5e52839ef None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:48.550149 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c9d99-9d64-4db3-92f0-2f01ca52f7a6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:48.551764 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c9d99-9d64-4db3-92f0-2f01ca52f7a6 service placement] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:48.554741 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680d87d-2c0d-4079-8b24-3ae814f794c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:48.555408 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680d87d-2c0d-4079-8b24-3ae814f794c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:48.555690 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680d87d-2c0d-4079-8b24-3ae814f794c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:48.555962 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680d87d-2c0d-4079-8b24-3ae814f794c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:48.556742 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1680d87d-2c0d-4079-8b24-3ae814f794c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:19:48.557045 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1680d87d-2c0d-4079-8b24-3ae814f794c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:48.559328 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1680d87d-2c0d-4079-8b24-3ae814f794c2 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:48.564193 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1349/2686] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:19:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:19:48.573947 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1338/2687] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:19:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:19:48.579872 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c9d99-9d64-4db3-92f0-2f01ca52f7a6 service placement] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:48.598905 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c9d99-9d64-4db3-92f0-2f01ca52f7a6 service placement] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:48.603708 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84545d8-fefb-42d6-84ae-e5b6e563eb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:48.604412 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84545d8-fefb-42d6-84ae-e5b6e563eb5e admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:48.604703 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84545d8-fefb-42d6-84ae-e5b6e563eb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:48.604981 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84545d8-fefb-42d6-84ae-e5b6e563eb5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:48.605873 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84545d8-fefb-42d6-84ae-e5b6e563eb5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:48.608028 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84545d8-fefb-42d6-84ae-e5b6e563eb5e admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:48.639992 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1350/2688] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:19:48 2022] POST /identity/v3/projects => generated 405 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 12:19:48.644031 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680d87d-2c0d-4079-8b24-3ae814f794c2 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:48.650381 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:19:48.658213 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680d87d-2c0d-4079-8b24-3ae814f794c2 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:48.720220 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a5f838-892e-476f-85ed-fc46cd6accb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:48.720928 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5f838-892e-476f-85ed-fc46cd6accb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:48.721319 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5f838-892e-476f-85ed-fc46cd6accb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:48.721604 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5f838-892e-476f-85ed-fc46cd6accb8 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:48.722300 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a5f838-892e-476f-85ed-fc46cd6accb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:48.724239 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a5f838-892e-476f-85ed-fc46cd6accb8 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:48.748215 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1339/2689] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:19:48 2022] POST /identity/v3/users => generated 303 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:19:48.752419 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84545d8-fefb-42d6-84ae-e5b6e563eb5e admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:48.763399 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84545d8-fefb-42d6-84ae-e5b6e563eb5e admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:48.768055 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68b20ed-ee37-40ff-9e4b-341e60e23906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:48.768750 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b20ed-ee37-40ff-9e4b-341e60e23906 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:48.769040 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b20ed-ee37-40ff-9e4b-341e60e23906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:48.769322 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b20ed-ee37-40ff-9e4b-341e60e23906 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:48.770047 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68b20ed-ee37-40ff-9e4b-341e60e23906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:48.771665 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68b20ed-ee37-40ff-9e4b-341e60e23906 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:48.786233 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1351/2690] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:19:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:19:48.787610 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a5f838-892e-476f-85ed-fc46cd6accb8 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:48.797793 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a5f838-892e-476f-85ed-fc46cd6accb8 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:48.802340 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb5211-27dc-40d5-a4b0-82be667d1b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:48.802998 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb5211-27dc-40d5-a4b0-82be667d1b50 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:48.803278 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb5211-27dc-40d5-a4b0-82be667d1b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:48.803552 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb5211-27dc-40d5-a4b0-82be667d1b50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:48.804298 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb5211-27dc-40d5-a4b0-82be667d1b50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:48.805886 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb5211-27dc-40d5-a4b0-82be667d1b50 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:48.815986 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1340/2691] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:19:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:19:48.820286 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68b20ed-ee37-40ff-9e4b-341e60e23906 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:48.830804 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68b20ed-ee37-40ff-9e4b-341e60e23906 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:48.835436 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063bb45a-7373-4375-8a5b-12aaf7a4c978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:48.836333 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063bb45a-7373-4375-8a5b-12aaf7a4c978 admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:48.836619 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063bb45a-7373-4375-8a5b-12aaf7a4c978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:48.836895 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063bb45a-7373-4375-8a5b-12aaf7a4c978 admin admin] PATH_INFO: `/v3/projects/8f3f8acd98594ba0924b2a0a6aaf5655/users/8c708120a75c484ca13bb82a194dd67d/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:48.853030 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063bb45a-7373-4375-8a5b-12aaf7a4c978 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f3f8acd98594ba0924b2a0a6aaf5655, user_id=8c708120a75c484ca13bb82a194dd67d, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:48.856392 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063bb45a-7373-4375-8a5b-12aaf7a4c978 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:48.869591 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1352/2692] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:19:48 2022] PUT /identity/v3/projects/8f3f8acd98594ba0924b2a0a6aaf5655/users/8c708120a75c484ca13bb82a194dd67d/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:19:48.875295 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b0dbe-082d-4711-927e-65b907b182f1 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:48.875594 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b0dbe-082d-4711-927e-65b907b182f1 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:48.875879 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b0dbe-082d-4711-927e-65b907b182f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:48.896378 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-966b0dbe-082d-4711-927e-65b907b182f1 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:19:48.897953 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-966b0dbe-082d-4711-927e-65b907b182f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:48.957704 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1341/2693] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:19:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:19:48.968765 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063bb45a-7373-4375-8a5b-12aaf7a4c978 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:48.970476 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-063bb45a-7373-4375-8a5b-12aaf7a4c978 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:49.016827 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:19:49.034667 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063bb45a-7373-4375-8a5b-12aaf7a4c978 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:49.038276 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f05a7f-2430-444f-ad6f-e395e010e699 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:49.038921 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f05a7f-2430-444f-ad6f-e395e010e699 service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:49.039201 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f05a7f-2430-444f-ad6f-e395e010e699 service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:49.039476 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f05a7f-2430-444f-ad6f-e395e010e699 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:49.048769 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f05a7f-2430-444f-ad6f-e395e010e699 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:49.050194 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f05a7f-2430-444f-ad6f-e395e010e699 service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:49.060349 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1353/2694] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:19:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:19:49.708156 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7982d-2cac-4296-b397-b29de349d3cb None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:49.708156 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7982d-2cac-4296-b397-b29de349d3cb None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:49.708156 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7982d-2cac-4296-b397-b29de349d3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:49.746385 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-47e7982d-2cac-4296-b397-b29de349d3cb None None] MFA Rules not processed for user `8c708120a75c484ca13bb82a194dd67d`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:19:49.747611 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-47e7982d-2cac-4296-b397-b29de349d3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:49.838284 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1342/2695] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:19:49 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:19:49.843157 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f05a7f-2430-444f-ad6f-e395e010e699 service neutron] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:49.857885 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f05a7f-2430-444f-ad6f-e395e010e699 service neutron] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:49.863928 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee97c8c0-aca3-49fc-8a68-e5b1fd2fb296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:49.864903 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee97c8c0-aca3-49fc-8a68-e5b1fd2fb296 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:49.865042 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee97c8c0-aca3-49fc-8a68-e5b1fd2fb296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:49.865266 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee97c8c0-aca3-49fc-8a68-e5b1fd2fb296 admin admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:49.865968 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee97c8c0-aca3-49fc-8a68-e5b1fd2fb296 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:49.868346 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee97c8c0-aca3-49fc-8a68-e5b1fd2fb296 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:49.904862 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1354/2696] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:19:49 2022] POST /identity/v3/projects => generated 405 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 12:19:49.908945 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e7982d-2cac-4296-b397-b29de349d3cb None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:49.920370 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e7982d-2cac-4296-b397-b29de349d3cb None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:49.929705 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:19:49.981031 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d8ce2-12f0-4156-8222-1608679ae54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:49.982136 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d8ce2-12f0-4156-8222-1608679ae54a admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:49.982417 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d8ce2-12f0-4156-8222-1608679ae54a admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:49.982688 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d8ce2-12f0-4156-8222-1608679ae54a admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:49.983379 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d8ce2-12f0-4156-8222-1608679ae54a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:49.985333 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d8ce2-12f0-4156-8222-1608679ae54a admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:50.007774 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1343/2697] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:19:49 2022] POST /identity/v3/users => generated 309 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:19:50.008932 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee97c8c0-aca3-49fc-8a68-e5b1fd2fb296 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:50.019443 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee97c8c0-aca3-49fc-8a68-e5b1fd2fb296 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:50.024103 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368644e8-2458-4ecf-9915-9c711a880f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:50.024838 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368644e8-2458-4ecf-9915-9c711a880f9f admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:50.025142 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368644e8-2458-4ecf-9915-9c711a880f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:50.025142 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368644e8-2458-4ecf-9915-9c711a880f9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:50.026137 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368644e8-2458-4ecf-9915-9c711a880f9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:50.028346 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368644e8-2458-4ecf-9915-9c711a880f9f admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:50.044446 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1355/2698] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:19:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 12:19:50.046280 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d8ce2-12f0-4156-8222-1608679ae54a admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:50.056587 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d8ce2-12f0-4156-8222-1608679ae54a admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:50.065690 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa61ec-f2db-4aa3-acf5-79a4e4e17d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:50.066601 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa61ec-f2db-4aa3-acf5-79a4e4e17d98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:50.066902 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa61ec-f2db-4aa3-acf5-79a4e4e17d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:50.067177 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa61ec-f2db-4aa3-acf5-79a4e4e17d98 admin admin] PATH_INFO: `/v3/projects/4a55ebe0c70144818e2203a6f85a407e/users/448344cfc0584e9a890b3061e0b4da0d/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:50.089126 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aa61ec-f2db-4aa3-acf5-79a4e4e17d98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a55ebe0c70144818e2203a6f85a407e, user_id=448344cfc0584e9a890b3061e0b4da0d, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:50.092419 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aa61ec-f2db-4aa3-acf5-79a4e4e17d98 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:50.107470 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1344/2699] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:19:50 2022] PUT /identity/v3/projects/4a55ebe0c70144818e2203a6f85a407e/users/448344cfc0584e9a890b3061e0b4da0d/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:19:50.111526 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368644e8-2458-4ecf-9915-9c711a880f9f admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:50.122011 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368644e8-2458-4ecf-9915-9c711a880f9f admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:50.187817 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b6c82-c06f-4e5f-a4ae-39ac129782c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:50.188728 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b6c82-c06f-4e5f-a4ae-39ac129782c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:50.189052 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b6c82-c06f-4e5f-a4ae-39ac129782c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:50.189396 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b6c82-c06f-4e5f-a4ae-39ac129782c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:50.190199 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02b6c82-c06f-4e5f-a4ae-39ac129782c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:50.191989 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02b6c82-c06f-4e5f-a4ae-39ac129782c1 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:50.206540 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1356/2700] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:19:50 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:19:50.207907 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa61ec-f2db-4aa3-acf5-79a4e4e17d98 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:50.220067 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa61ec-f2db-4aa3-acf5-79a4e4e17d98 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:50.224954 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7127cb5a-dff2-45ee-ab40-87dd1faac08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:50.225888 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127cb5a-dff2-45ee-ab40-87dd1faac08e admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:50.226173 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127cb5a-dff2-45ee-ab40-87dd1faac08e admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:50.226451 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127cb5a-dff2-45ee-ab40-87dd1faac08e admin admin] PATH_INFO: `/v3/projects/4a55ebe0c70144818e2203a6f85a407e/users/448344cfc0584e9a890b3061e0b4da0d/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:50.229197 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7127cb5a-dff2-45ee-ab40-87dd1faac08e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a55ebe0c70144818e2203a6f85a407e, user_id=448344cfc0584e9a890b3061e0b4da0d, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:50.232219 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7127cb5a-dff2-45ee-ab40-87dd1faac08e admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:50.244150 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1345/2701] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:19:50 2022] PUT /identity/v3/projects/4a55ebe0c70144818e2203a6f85a407e/users/448344cfc0584e9a890b3061e0b4da0d/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:19:50.925431 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be8dfb-20a8-48b3-9a5a-08f0fc3c02a8 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:50.925978 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be8dfb-20a8-48b3-9a5a-08f0fc3c02a8 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:50.926240 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be8dfb-20a8-48b3-9a5a-08f0fc3c02a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:50.955375 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-b1be8dfb-20a8-48b3-9a5a-08f0fc3c02a8 None None] MFA Rules not processed for user `448344cfc0584e9a890b3061e0b4da0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:19:50.958949 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-b1be8dfb-20a8-48b3-9a5a-08f0fc3c02a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:51.052059 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1357/2702] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:19:50 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:19:52.150988 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7127cb5a-dff2-45ee-ab40-87dd1faac08e admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:52.215919 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7127cb5a-dff2-45ee-ab40-87dd1faac08e admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:52.220525 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975aff7-f2a0-4eab-9e1e-15b061b161bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:52.221412 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975aff7-f2a0-4eab-9e1e-15b061b161bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:52.221691 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975aff7-f2a0-4eab-9e1e-15b061b161bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:52.221962 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975aff7-f2a0-4eab-9e1e-15b061b161bb admin admin] PATH_INFO: `/v3/users/8c708120a75c484ca13bb82a194dd67d` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:52.223148 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9975aff7-f2a0-4eab-9e1e-15b061b161bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c708120a75c484ca13bb82a194dd67d)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:52.225185 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9975aff7-f2a0-4eab-9e1e-15b061b161bb admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:52.274355 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9975aff7-f2a0-4eab-9e1e-15b061b161bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c708120a75c484ca13bb82a194dd67d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:52.275007 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9975aff7-f2a0-4eab-9e1e-15b061b161bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c708120a75c484ca13bb82a194dd67d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:52.275617 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9975aff7-f2a0-4eab-9e1e-15b061b161bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c708120a75c484ca13bb82a194dd67d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:52.283017 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9975aff7-f2a0-4eab-9e1e-15b061b161bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c708120a75c484ca13bb82a194dd67d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:52.290649 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:19:52.298090 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9975aff7-f2a0-4eab-9e1e-15b061b161bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c708120a75c484ca13bb82a194dd67d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:52.312278 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1346/2703] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:19:52 2022] DELETE /identity/v3/users/8c708120a75c484ca13bb82a194dd67d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:19:52.517164 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be8dfb-20a8-48b3-9a5a-08f0fc3c02a8 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:52.529048 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be8dfb-20a8-48b3-9a5a-08f0fc3c02a8 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:52.567860 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:19:52.606052 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ccee0-8710-488f-9ece-87a5f8b3d1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:52.607923 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ccee0-8710-488f-9ece-87a5f8b3d1ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:52.608061 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ccee0-8710-488f-9ece-87a5f8b3d1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:52.608341 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ccee0-8710-488f-9ece-87a5f8b3d1ec admin admin] PATH_INFO: `/v3/projects/8f3f8acd98594ba0924b2a0a6aaf5655` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:52.609576 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723ccee0-8710-488f-9ece-87a5f8b3d1ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f3f8acd98594ba0924b2a0a6aaf5655)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:52.611760 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723ccee0-8710-488f-9ece-87a5f8b3d1ec admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:52.677441 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-723ccee0-8710-488f-9ece-87a5f8b3d1ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f3f8acd98594ba0924b2a0a6aaf5655', 'request_id': 'req-723ccee0-8710-488f-9ece-87a5f8b3d1ec'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:52.689594 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-723ccee0-8710-488f-9ece-87a5f8b3d1ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f3f8acd98594ba0924b2a0a6aaf5655', 'request_id': 'req-723ccee0-8710-488f-9ece-87a5f8b3d1ec'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:52.701239 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-723ccee0-8710-488f-9ece-87a5f8b3d1ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f3f8acd98594ba0924b2a0a6aaf5655', 'request_id': 'req-723ccee0-8710-488f-9ece-87a5f8b3d1ec'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:52.717003 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-723ccee0-8710-488f-9ece-87a5f8b3d1ec admin admin] The token cache is being invalidate because project 8f3f8acd98594ba0924b2a0a6aaf5655 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:19:52.717297 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-723ccee0-8710-488f-9ece-87a5f8b3d1ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:52.717957 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-723ccee0-8710-488f-9ece-87a5f8b3d1ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:52.719528 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1358/2704] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:19:52 2022] DELETE /identity/v3/projects/8f3f8acd98594ba0924b2a0a6aaf5655 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:19:52.723543 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975aff7-f2a0-4eab-9e1e-15b061b161bb admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:52.724886 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-9975aff7-f2a0-4eab-9e1e-15b061b161bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:52.739336 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975aff7-f2a0-4eab-9e1e-15b061b161bb admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:52.797232 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c96c15-c655-426b-ac0c-bfb5328604e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:52.798123 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c96c15-c655-426b-ac0c-bfb5328604e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:52.798405 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c96c15-c655-426b-ac0c-bfb5328604e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:52.798678 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c96c15-c655-426b-ac0c-bfb5328604e2 admin admin] PATH_INFO: `/v3/users/448344cfc0584e9a890b3061e0b4da0d` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:52.799890 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c96c15-c655-426b-ac0c-bfb5328604e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=448344cfc0584e9a890b3061e0b4da0d)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:52.801911 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c96c15-c655-426b-ac0c-bfb5328604e2 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:52.847453 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-18c96c15-c655-426b-ac0c-bfb5328604e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '448344cfc0584e9a890b3061e0b4da0d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:52.848106 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-18c96c15-c655-426b-ac0c-bfb5328604e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '448344cfc0584e9a890b3061e0b4da0d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:52.848742 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-18c96c15-c655-426b-ac0c-bfb5328604e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '448344cfc0584e9a890b3061e0b4da0d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:52.856579 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-18c96c15-c655-426b-ac0c-bfb5328604e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '448344cfc0584e9a890b3061e0b4da0d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:52.868441 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-18c96c15-c655-426b-ac0c-bfb5328604e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '448344cfc0584e9a890b3061e0b4da0d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:52.881289 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1347/2705] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:19:52 2022] DELETE /identity/v3/users/448344cfc0584e9a890b3061e0b4da0d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:19:53.059808 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ccee0-8710-488f-9ece-87a5f8b3d1ec admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:53.061466 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-723ccee0-8710-488f-9ece-87a5f8b3d1ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:53.074544 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ccee0-8710-488f-9ece-87a5f8b3d1ec admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:53.138850 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae1bd1f-63b4-43cf-bd42-9912fc346a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:53.139753 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1bd1f-63b4-43cf-bd42-9912fc346a60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:53.140063 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1bd1f-63b4-43cf-bd42-9912fc346a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:53.140373 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1bd1f-63b4-43cf-bd42-9912fc346a60 admin admin] PATH_INFO: `/v3/projects/4a55ebe0c70144818e2203a6f85a407e` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:53.141578 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae1bd1f-63b4-43cf-bd42-9912fc346a60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a55ebe0c70144818e2203a6f85a407e)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:53.143602 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae1bd1f-63b4-43cf-bd42-9912fc346a60 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:53.189852 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-5ae1bd1f-63b4-43cf-bd42-9912fc346a60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a55ebe0c70144818e2203a6f85a407e', 'request_id': 'req-5ae1bd1f-63b4-43cf-bd42-9912fc346a60'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:53.196817 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-5ae1bd1f-63b4-43cf-bd42-9912fc346a60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a55ebe0c70144818e2203a6f85a407e', 'request_id': 'req-5ae1bd1f-63b4-43cf-bd42-9912fc346a60'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:53.201890 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:19:53.204640 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-5ae1bd1f-63b4-43cf-bd42-9912fc346a60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a55ebe0c70144818e2203a6f85a407e', 'request_id': 'req-5ae1bd1f-63b4-43cf-bd42-9912fc346a60'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:53.217808 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-5ae1bd1f-63b4-43cf-bd42-9912fc346a60 admin admin] The token cache is being invalidate because project 4a55ebe0c70144818e2203a6f85a407e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:19:53.218112 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-5ae1bd1f-63b4-43cf-bd42-9912fc346a60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:53.218739 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-5ae1bd1f-63b4-43cf-bd42-9912fc346a60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:53.220311 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1359/2706] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:19:53 2022] DELETE /identity/v3/projects/4a55ebe0c70144818e2203a6f85a407e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:19:53.225192 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5eff3-250e-4089-bb7f-fa589cbf1a36 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:53.225703 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5eff3-250e-4089-bb7f-fa589cbf1a36 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:53.225800 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5eff3-250e-4089-bb7f-fa589cbf1a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:53.245285 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-e7d5eff3-250e-4089-bb7f-fa589cbf1a36 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:19:53.246740 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-e7d5eff3-250e-4089-bb7f-fa589cbf1a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:53.309359 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1348/2707] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:19:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:19:53.317149 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2bb9b-ff35-4d90-b101-c8de2545f2a9 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:53.317444 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2bb9b-ff35-4d90-b101-c8de2545f2a9 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:53.317726 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2bb9b-ff35-4d90-b101-c8de2545f2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:53.336810 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-dfb2bb9b-ff35-4d90-b101-c8de2545f2a9 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:19:53.338030 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-dfb2bb9b-ff35-4d90-b101-c8de2545f2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:53.346683 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1360/2708] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:19:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:19:53.350958 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d5eff3-250e-4089-bb7f-fa589cbf1a36 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:53.357494 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:19:53.361339 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d5eff3-250e-4089-bb7f-fa589cbf1a36 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:53.368197 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68057f3c-87e0-46c4-a3b9-617d88d1e039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:53.369808 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68057f3c-87e0-46c4-a3b9-617d88d1e039 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:53.370382 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68057f3c-87e0-46c4-a3b9-617d88d1e039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:53.371110 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68057f3c-87e0-46c4-a3b9-617d88d1e039 admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:53.372252 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68057f3c-87e0-46c4-a3b9-617d88d1e039 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:19:53.372690 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68057f3c-87e0-46c4-a3b9-617d88d1e039 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:53.374400 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68057f3c-87e0-46c4-a3b9-617d88d1e039 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:53.388414 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1349/2709] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:19:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:19:53.392924 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb2bb9b-ff35-4d90-b101-c8de2545f2a9 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:53.404649 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb2bb9b-ff35-4d90-b101-c8de2545f2a9 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:53.409530 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585b06a-1a86-486d-a3bf-8aeb440d0700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:53.410199 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585b06a-1a86-486d-a3bf-8aeb440d0700 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:53.410484 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585b06a-1a86-486d-a3bf-8aeb440d0700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:53.410761 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585b06a-1a86-486d-a3bf-8aeb440d0700 admin admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:53.411468 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9585b06a-1a86-486d-a3bf-8aeb440d0700 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:53.413409 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9585b06a-1a86-486d-a3bf-8aeb440d0700 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:53.442567 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1361/2710] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:19:53 2022] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:19:53.443707 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68057f3c-87e0-46c4-a3b9-617d88d1e039 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:53.454594 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68057f3c-87e0-46c4-a3b9-617d88d1e039 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:53.513652 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9497f43-1e88-4ad6-80d0-6c8d3deb07f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:53.514254 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9497f43-1e88-4ad6-80d0-6c8d3deb07f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:53.514542 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9497f43-1e88-4ad6-80d0-6c8d3deb07f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:53.514822 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9497f43-1e88-4ad6-80d0-6c8d3deb07f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:53.515528 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9497f43-1e88-4ad6-80d0-6c8d3deb07f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:53.517473 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9497f43-1e88-4ad6-80d0-6c8d3deb07f1 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:53.538141 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1350/2711] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:19:53 2022] POST /identity/v3/users => generated 284 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:19:53.542348 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585b06a-1a86-486d-a3bf-8aeb440d0700 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:53.552652 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585b06a-1a86-486d-a3bf-8aeb440d0700 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:53.557492 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01145c24-59d3-49f1-9d88-20aa0f43792b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:53.558157 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01145c24-59d3-49f1-9d88-20aa0f43792b admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:53.559039 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01145c24-59d3-49f1-9d88-20aa0f43792b admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:53.559331 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01145c24-59d3-49f1-9d88-20aa0f43792b admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:53.560055 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01145c24-59d3-49f1-9d88-20aa0f43792b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:53.561693 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01145c24-59d3-49f1-9d88-20aa0f43792b admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:53.572574 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1362/2712] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:19:53.578278 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9497f43-1e88-4ad6-80d0-6c8d3deb07f1 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:53.588803 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9497f43-1e88-4ad6-80d0-6c8d3deb07f1 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:53.594074 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c9c7b-c0be-4681-8ef9-d05bd701c500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:53.594751 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c9c7b-c0be-4681-8ef9-d05bd701c500 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:53.595040 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c9c7b-c0be-4681-8ef9-d05bd701c500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:53.595510 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c9c7b-c0be-4681-8ef9-d05bd701c500 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:53.596199 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42c9c7b-c0be-4681-8ef9-d05bd701c500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:53.597816 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42c9c7b-c0be-4681-8ef9-d05bd701c500 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:53.608896 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1351/2713] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:19:53.613066 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01145c24-59d3-49f1-9d88-20aa0f43792b admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:53.623960 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01145c24-59d3-49f1-9d88-20aa0f43792b admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:53.629057 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf964a-4729-4d36-85cb-b5cd0685dc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:53.629992 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf964a-4729-4d36-85cb-b5cd0685dc0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:53.630277 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf964a-4729-4d36-85cb-b5cd0685dc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:53.630555 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf964a-4729-4d36-85cb-b5cd0685dc0b admin admin] PATH_INFO: `/v3/projects/8f9ae7eff69a434dbe318ef0c7ed2b83/users/555195c127b1498c85ead2d43f2fc7a5/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:53.646824 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdf964a-4729-4d36-85cb-b5cd0685dc0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f9ae7eff69a434dbe318ef0c7ed2b83, user_id=555195c127b1498c85ead2d43f2fc7a5, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:53.649566 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdf964a-4729-4d36-85cb-b5cd0685dc0b admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:53.663284 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1363/2714] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:19:53 2022] PUT /identity/v3/projects/8f9ae7eff69a434dbe318ef0c7ed2b83/users/555195c127b1498c85ead2d43f2fc7a5/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:19:53.673941 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f6ada-86df-4bd2-9924-7275f8b77d98 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:53.674234 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f6ada-86df-4bd2-9924-7275f8b77d98 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:53.674513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f6ada-86df-4bd2-9924-7275f8b77d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:53.702907 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-5e6f6ada-86df-4bd2-9924-7275f8b77d98 None None] MFA Rules not processed for user `555195c127b1498c85ead2d43f2fc7a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:19:53.704122 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-5e6f6ada-86df-4bd2-9924-7275f8b77d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:53.772393 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1352/2715] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:19:53 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:19:53.777051 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf964a-4729-4d36-85cb-b5cd0685dc0b admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:53.847318 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf964a-4729-4d36-85cb-b5cd0685dc0b admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:53.852090 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4a025-03e1-4dcb-9010-90819942b790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:53.852779 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4a025-03e1-4dcb-9010-90819942b790 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:53.853062 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4a025-03e1-4dcb-9010-90819942b790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:53.853339 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4a025-03e1-4dcb-9010-90819942b790 admin admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:53.854035 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4a025-03e1-4dcb-9010-90819942b790 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:53.856564 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4a025-03e1-4dcb-9010-90819942b790 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:53.884931 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1364/2716] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:19:53 2022] POST /identity/v3/projects => generated 369 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:19:53.890021 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f6ada-86df-4bd2-9924-7275f8b77d98 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:53.900967 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f6ada-86df-4bd2-9924-7275f8b77d98 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:53.965163 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05bbd68-ea01-4bcf-a245-a0f2c462dcb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:53.965851 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05bbd68-ea01-4bcf-a245-a0f2c462dcb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:53.966136 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05bbd68-ea01-4bcf-a245-a0f2c462dcb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:53.966419 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05bbd68-ea01-4bcf-a245-a0f2c462dcb4 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:53.967126 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05bbd68-ea01-4bcf-a245-a0f2c462dcb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:53.969088 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05bbd68-ea01-4bcf-a245-a0f2c462dcb4 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:53.975956 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:19:53.996672 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1353/2717] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:19:53 2022] POST /identity/v3/users => generated 291 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 12:19:53.998604 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4a025-03e1-4dcb-9010-90819942b790 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:54.010154 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4a025-03e1-4dcb-9010-90819942b790 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:54.015604 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289bbbb8-9c60-46de-9bb3-7fc4c48145d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:54.016302 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289bbbb8-9c60-46de-9bb3-7fc4c48145d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:54.016590 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289bbbb8-9c60-46de-9bb3-7fc4c48145d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:54.016873 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289bbbb8-9c60-46de-9bb3-7fc4c48145d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:54.017661 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289bbbb8-9c60-46de-9bb3-7fc4c48145d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:54.019214 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289bbbb8-9c60-46de-9bb3-7fc4c48145d1 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:54.034280 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1365/2718] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:19:54.038512 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05bbd68-ea01-4bcf-a245-a0f2c462dcb4 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:54.049910 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05bbd68-ea01-4bcf-a245-a0f2c462dcb4 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:54.054739 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc82f10-13eb-4996-9e93-3164106412b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:54.055700 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc82f10-13eb-4996-9e93-3164106412b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:54.056007 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc82f10-13eb-4996-9e93-3164106412b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:54.056305 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc82f10-13eb-4996-9e93-3164106412b5 admin admin] PATH_INFO: `/v3/projects/5b66bfd3261a407e8a0026c8bae022e3/users/b9adab43e13f46d28f27fdb067853786/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:54.071968 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc82f10-13eb-4996-9e93-3164106412b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b66bfd3261a407e8a0026c8bae022e3, user_id=b9adab43e13f46d28f27fdb067853786, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:54.075237 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc82f10-13eb-4996-9e93-3164106412b5 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:54.088551 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1354/2719] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:19:54 2022] PUT /identity/v3/projects/5b66bfd3261a407e8a0026c8bae022e3/users/b9adab43e13f46d28f27fdb067853786/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:19:54.093532 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289bbbb8-9c60-46de-9bb3-7fc4c48145d1 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:54.103866 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289bbbb8-9c60-46de-9bb3-7fc4c48145d1 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:54.171354 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf2ea6-771e-4998-8e42-e13864e256b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:54.172042 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf2ea6-771e-4998-8e42-e13864e256b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:54.172368 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf2ea6-771e-4998-8e42-e13864e256b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:54.172653 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf2ea6-771e-4998-8e42-e13864e256b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:54.173384 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acf2ea6-771e-4998-8e42-e13864e256b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:54.174996 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acf2ea6-771e-4998-8e42-e13864e256b2 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:54.176612 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:19:54.187714 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1366/2720] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:19:54 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:19:54.192081 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc82f10-13eb-4996-9e93-3164106412b5 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:54.204963 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc82f10-13eb-4996-9e93-3164106412b5 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:54.209751 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8b548-8d78-4377-b696-75a7d3486c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:54.210650 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8b548-8d78-4377-b696-75a7d3486c0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:54.210935 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8b548-8d78-4377-b696-75a7d3486c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:54.211217 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8b548-8d78-4377-b696-75a7d3486c0c admin admin] PATH_INFO: `/v3/projects/5b66bfd3261a407e8a0026c8bae022e3/users/b9adab43e13f46d28f27fdb067853786/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:54.213289 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda8b548-8d78-4377-b696-75a7d3486c0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b66bfd3261a407e8a0026c8bae022e3, user_id=b9adab43e13f46d28f27fdb067853786, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:54.216724 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda8b548-8d78-4377-b696-75a7d3486c0c admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:54.228149 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1355/2721] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:19:54 2022] PUT /identity/v3/projects/5b66bfd3261a407e8a0026c8bae022e3/users/b9adab43e13f46d28f27fdb067853786/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:19:54.240749 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94165ae2-1d91-4a9c-9c4a-12bfb66f7a7f None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:54.241046 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94165ae2-1d91-4a9c-9c4a-12bfb66f7a7f None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:54.241379 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94165ae2-1d91-4a9c-9c4a-12bfb66f7a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:54.269072 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-94165ae2-1d91-4a9c-9c4a-12bfb66f7a7f None None] MFA Rules not processed for user `b9adab43e13f46d28f27fdb067853786`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:19:54.270216 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-94165ae2-1d91-4a9c-9c4a-12bfb66f7a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:54.345260 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1367/2722] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:19:54 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:19:54.361215 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8b548-8d78-4377-b696-75a7d3486c0c admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:54.362936 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-dda8b548-8d78-4377-b696-75a7d3486c0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:54.442583 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8b548-8d78-4377-b696-75a7d3486c0c admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:54.446252 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3116c4e7-0ec1-4799-8619-72ab985fc85d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:54.446901 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116c4e7-0ec1-4799-8619-72ab985fc85d service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:54.447188 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116c4e7-0ec1-4799-8619-72ab985fc85d service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:54.447466 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116c4e7-0ec1-4799-8619-72ab985fc85d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:54.457276 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3116c4e7-0ec1-4799-8619-72ab985fc85d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:54.458713 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3116c4e7-0ec1-4799-8619-72ab985fc85d service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:54.468371 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1356/2723] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:19:54 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:19:55.835147 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94165ae2-1d91-4a9c-9c4a-12bfb66f7a7f None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:55.897631 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94165ae2-1d91-4a9c-9c4a-12bfb66f7a7f None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:55.902019 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11932bd7-4d9b-4fd6-9869-1c31b4ec9318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:55.903881 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11932bd7-4d9b-4fd6-9869-1c31b4ec9318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:55.904158 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11932bd7-4d9b-4fd6-9869-1c31b4ec9318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:55.904553 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11932bd7-4d9b-4fd6-9869-1c31b4ec9318 admin admin] PATH_INFO: `/v3/users/555195c127b1498c85ead2d43f2fc7a5` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:55.905842 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11932bd7-4d9b-4fd6-9869-1c31b4ec9318 admin admin] RBAC: Authorizing `identity:delete_user(user_id=555195c127b1498c85ead2d43f2fc7a5)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:55.907744 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11932bd7-4d9b-4fd6-9869-1c31b4ec9318 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:55.959005 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-11932bd7-4d9b-4fd6-9869-1c31b4ec9318 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '555195c127b1498c85ead2d43f2fc7a5'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:55.966940 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-11932bd7-4d9b-4fd6-9869-1c31b4ec9318 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '555195c127b1498c85ead2d43f2fc7a5'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:55.967869 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-11932bd7-4d9b-4fd6-9869-1c31b4ec9318 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '555195c127b1498c85ead2d43f2fc7a5'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:55.968494 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-11932bd7-4d9b-4fd6-9869-1c31b4ec9318 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '555195c127b1498c85ead2d43f2fc7a5'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:55.984312 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-11932bd7-4d9b-4fd6-9869-1c31b4ec9318 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '555195c127b1498c85ead2d43f2fc7a5'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:55.993400 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:19:55.998728 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1368/2724] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:19:55 2022] DELETE /identity/v3/users/555195c127b1498c85ead2d43f2fc7a5 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:19:56.003386 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e403cca-54cf-4234-9f7a-184c1054d7b3 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:56.003866 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e403cca-54cf-4234-9f7a-184c1054d7b3 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:56.004128 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e403cca-54cf-4234-9f7a-184c1054d7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:56.022243 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-1e403cca-54cf-4234-9f7a-184c1054d7b3 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:19:56.023469 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-1e403cca-54cf-4234-9f7a-184c1054d7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:56.087808 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1357/2725] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:19:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:19:56.098302 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11932bd7-4d9b-4fd6-9869-1c31b4ec9318 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:56.099738 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-11932bd7-4d9b-4fd6-9869-1c31b4ec9318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:56.158686 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11932bd7-4d9b-4fd6-9869-1c31b4ec9318 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:56.162303 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf41d5f-ae0e-442a-8f83-2b66b2d0962f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:56.162965 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf41d5f-ae0e-442a-8f83-2b66b2d0962f service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:56.163252 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf41d5f-ae0e-442a-8f83-2b66b2d0962f service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:56.163525 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf41d5f-ae0e-442a-8f83-2b66b2d0962f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:56.173995 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf41d5f-ae0e-442a-8f83-2b66b2d0962f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:56.175434 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf41d5f-ae0e-442a-8f83-2b66b2d0962f service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:56.184796 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1369/2726] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:19:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:19:56.476931 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e403cca-54cf-4234-9f7a-184c1054d7b3 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:56.478383 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-1e403cca-54cf-4234-9f7a-184c1054d7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:56.492096 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e403cca-54cf-4234-9f7a-184c1054d7b3 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:56.497442 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a37c4-c7c4-4659-a7d1-39455f64ed66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:56.498473 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a37c4-c7c4-4659-a7d1-39455f64ed66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:56.498759 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a37c4-c7c4-4659-a7d1-39455f64ed66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:56.499037 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a37c4-c7c4-4659-a7d1-39455f64ed66 admin admin] PATH_INFO: `/v3/projects/8f9ae7eff69a434dbe318ef0c7ed2b83` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:56.500836 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a37c4-c7c4-4659-a7d1-39455f64ed66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f9ae7eff69a434dbe318ef0c7ed2b83)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:56.502185 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a37c4-c7c4-4659-a7d1-39455f64ed66 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:56.537767 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:INSERT=5,keystone:SELECT=93,keystone:DELETE=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:19:56.552189 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ce5a37c4-c7c4-4659-a7d1-39455f64ed66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f9ae7eff69a434dbe318ef0c7ed2b83', 'request_id': 'req-ce5a37c4-c7c4-4659-a7d1-39455f64ed66'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:56.559883 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ce5a37c4-c7c4-4659-a7d1-39455f64ed66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f9ae7eff69a434dbe318ef0c7ed2b83', 'request_id': 'req-ce5a37c4-c7c4-4659-a7d1-39455f64ed66'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:56.565564 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ce5a37c4-c7c4-4659-a7d1-39455f64ed66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f9ae7eff69a434dbe318ef0c7ed2b83', 'request_id': 'req-ce5a37c4-c7c4-4659-a7d1-39455f64ed66'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:56.577838 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ce5a37c4-c7c4-4659-a7d1-39455f64ed66 admin admin] The token cache is being invalidate because project 8f9ae7eff69a434dbe318ef0c7ed2b83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:19:56.578128 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ce5a37c4-c7c4-4659-a7d1-39455f64ed66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:56.578773 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-ce5a37c4-c7c4-4659-a7d1-39455f64ed66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:56.580380 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1358/2727] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:19:56 2022] DELETE /identity/v3/projects/8f9ae7eff69a434dbe318ef0c7ed2b83 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:19:56.584436 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf41d5f-ae0e-442a-8f83-2b66b2d0962f service neutron] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:56.594213 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf41d5f-ae0e-442a-8f83-2b66b2d0962f service neutron] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:56.651113 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a853a-af5b-4076-b953-19029ff7c378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:56.652131 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a853a-af5b-4076-b953-19029ff7c378 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:56.652765 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a853a-af5b-4076-b953-19029ff7c378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:56.653082 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a853a-af5b-4076-b953-19029ff7c378 admin admin] PATH_INFO: `/v3/users/b9adab43e13f46d28f27fdb067853786` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:56.654281 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11a853a-af5b-4076-b953-19029ff7c378 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9adab43e13f46d28f27fdb067853786)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:56.656223 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11a853a-af5b-4076-b953-19029ff7c378 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:56.707992 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-a11a853a-af5b-4076-b953-19029ff7c378 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9adab43e13f46d28f27fdb067853786'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:56.715429 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-a11a853a-af5b-4076-b953-19029ff7c378 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9adab43e13f46d28f27fdb067853786'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:56.716131 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-a11a853a-af5b-4076-b953-19029ff7c378 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9adab43e13f46d28f27fdb067853786'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:56.716780 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-a11a853a-af5b-4076-b953-19029ff7c378 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9adab43e13f46d28f27fdb067853786'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:56.728402 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-a11a853a-af5b-4076-b953-19029ff7c378 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9adab43e13f46d28f27fdb067853786'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:56.742122 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1370/2728] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:19:56 2022] DELETE /identity/v3/users/b9adab43e13f46d28f27fdb067853786 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:19:57.022083 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a37c4-c7c4-4659-a7d1-39455f64ed66 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:57.024697 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ce5a37c4-c7c4-4659-a7d1-39455f64ed66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:57.037938 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a37c4-c7c4-4659-a7d1-39455f64ed66 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:57.098351 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9c0c9-b53e-41c9-b332-bcfa00ac0bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:57.099229 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9c0c9-b53e-41c9-b332-bcfa00ac0bf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:57.099514 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9c0c9-b53e-41c9-b332-bcfa00ac0bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:57.099793 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9c0c9-b53e-41c9-b332-bcfa00ac0bf7 admin admin] PATH_INFO: `/v3/projects/5b66bfd3261a407e8a0026c8bae022e3` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:57.101002 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb9c0c9-b53e-41c9-b332-bcfa00ac0bf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b66bfd3261a407e8a0026c8bae022e3)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:57.102978 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb9c0c9-b53e-41c9-b332-bcfa00ac0bf7 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:57.149152 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-fbb9c0c9-b53e-41c9-b332-bcfa00ac0bf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b66bfd3261a407e8a0026c8bae022e3', 'request_id': 'req-fbb9c0c9-b53e-41c9-b332-bcfa00ac0bf7'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:57.158338 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-fbb9c0c9-b53e-41c9-b332-bcfa00ac0bf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b66bfd3261a407e8a0026c8bae022e3', 'request_id': 'req-fbb9c0c9-b53e-41c9-b332-bcfa00ac0bf7'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:57.163976 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-fbb9c0c9-b53e-41c9-b332-bcfa00ac0bf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b66bfd3261a407e8a0026c8bae022e3', 'request_id': 'req-fbb9c0c9-b53e-41c9-b332-bcfa00ac0bf7'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:57.175078 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-fbb9c0c9-b53e-41c9-b332-bcfa00ac0bf7 admin admin] The token cache is being invalidate because project 5b66bfd3261a407e8a0026c8bae022e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:19:57.175366 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-fbb9c0c9-b53e-41c9-b332-bcfa00ac0bf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:57.176004 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-fbb9c0c9-b53e-41c9-b332-bcfa00ac0bf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:19:57.177570 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1359/2729] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:19:57 2022] DELETE /identity/v3/projects/5b66bfd3261a407e8a0026c8bae022e3 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:19:57.182511 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da351fd-1ae0-45c4-9f57-c1bd1750312b None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:57.182982 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da351fd-1ae0-45c4-9f57-c1bd1750312b None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:57.183089 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da351fd-1ae0-45c4-9f57-c1bd1750312b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:57.201530 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-3da351fd-1ae0-45c4-9f57-c1bd1750312b None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:19:57.202737 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-3da351fd-1ae0-45c4-9f57-c1bd1750312b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:57.221144 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:19:57.264549 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1371/2730] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:19:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:19:57.272278 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5239d9d-a03f-4394-a406-f832856f0628 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:57.272643 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5239d9d-a03f-4394-a406-f832856f0628 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:57.272988 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5239d9d-a03f-4394-a406-f832856f0628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:57.292799 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-a5239d9d-a03f-4394-a406-f832856f0628 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:19:57.294001 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a5239d9d-a03f-4394-a406-f832856f0628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:57.301892 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1360/2731] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:19:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:19:57.306079 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da351fd-1ae0-45c4-9f57-c1bd1750312b None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:57.316591 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da351fd-1ae0-45c4-9f57-c1bd1750312b None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:57.321242 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f39c935-9687-44f3-bd84-d8129eefb009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:57.321904 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39c935-9687-44f3-bd84-d8129eefb009 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:57.322190 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39c935-9687-44f3-bd84-d8129eefb009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:57.322468 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39c935-9687-44f3-bd84-d8129eefb009 admin admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:57.323198 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f39c935-9687-44f3-bd84-d8129eefb009 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:19:57.323520 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f39c935-9687-44f3-bd84-d8129eefb009 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:57.325892 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f39c935-9687-44f3-bd84-d8129eefb009 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:57.337414 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1372/2732] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:19:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:19:57.341759 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5239d9d-a03f-4394-a406-f832856f0628 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:57.350953 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5239d9d-a03f-4394-a406-f832856f0628 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:57.355587 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daf6166-4c00-445c-9958-0414d09fd11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:57.356790 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf6166-4c00-445c-9958-0414d09fd11b admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:57.357076 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf6166-4c00-445c-9958-0414d09fd11b admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:57.357348 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf6166-4c00-445c-9958-0414d09fd11b admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:57.358038 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daf6166-4c00-445c-9958-0414d09fd11b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:57.359906 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daf6166-4c00-445c-9958-0414d09fd11b admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:57.387153 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1361/2733] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:19:57 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:19:57.391402 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f39c935-9687-44f3-bd84-d8129eefb009 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:57.401377 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f39c935-9687-44f3-bd84-d8129eefb009 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:57.457675 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1216ec4-3ec8-4740-b8f9-00b41c833136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:57.458371 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1216ec4-3ec8-4740-b8f9-00b41c833136 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:57.458658 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1216ec4-3ec8-4740-b8f9-00b41c833136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:57.458939 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1216ec4-3ec8-4740-b8f9-00b41c833136 admin admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:57.459635 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1216ec4-3ec8-4740-b8f9-00b41c833136 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:57.461596 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1216ec4-3ec8-4740-b8f9-00b41c833136 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:57.481610 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1373/2734] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:19:57 2022] POST /identity/v3/users => generated 286 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:19:57.485868 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daf6166-4c00-445c-9958-0414d09fd11b admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:57.496773 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daf6166-4c00-445c-9958-0414d09fd11b admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:57.501443 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e21d4e-c931-4f41-b9eb-e6e10208a440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:57.502104 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e21d4e-c931-4f41-b9eb-e6e10208a440 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:57.502389 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e21d4e-c931-4f41-b9eb-e6e10208a440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:57.502666 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e21d4e-c931-4f41-b9eb-e6e10208a440 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:57.503410 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e21d4e-c931-4f41-b9eb-e6e10208a440 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:57.505049 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e21d4e-c931-4f41-b9eb-e6e10208a440 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:57.516445 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1362/2735] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:19:57.520392 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1216ec4-3ec8-4740-b8f9-00b41c833136 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:57.530367 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1216ec4-3ec8-4740-b8f9-00b41c833136 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:57.534946 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86566888-658e-4c2f-a4e2-d5d6f0d5ca9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:57.535609 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86566888-658e-4c2f-a4e2-d5d6f0d5ca9b admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:57.535891 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86566888-658e-4c2f-a4e2-d5d6f0d5ca9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:57.536197 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86566888-658e-4c2f-a4e2-d5d6f0d5ca9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:57.536940 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86566888-658e-4c2f-a4e2-d5d6f0d5ca9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:57.538543 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86566888-658e-4c2f-a4e2-d5d6f0d5ca9b admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:57.548770 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1374/2736] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:19:57.552808 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e21d4e-c931-4f41-b9eb-e6e10208a440 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:57.563541 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e21d4e-c931-4f41-b9eb-e6e10208a440 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:57.568131 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b49aa3-86ea-4dd2-a3b9-2e78f49ab987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:57.569049 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b49aa3-86ea-4dd2-a3b9-2e78f49ab987 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:57.569333 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b49aa3-86ea-4dd2-a3b9-2e78f49ab987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:57.569610 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b49aa3-86ea-4dd2-a3b9-2e78f49ab987 admin admin] PATH_INFO: `/v3/projects/24300d12f9ae40a38234620ea102b77e/users/ae8147f69a024a70a74b9488e62a1081/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:57.572715 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:19:57.587498 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b49aa3-86ea-4dd2-a3b9-2e78f49ab987 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24300d12f9ae40a38234620ea102b77e, user_id=ae8147f69a024a70a74b9488e62a1081, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:57.590395 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b49aa3-86ea-4dd2-a3b9-2e78f49ab987 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:57.603706 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1363/2737] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:19:57 2022] PUT /identity/v3/projects/24300d12f9ae40a38234620ea102b77e/users/ae8147f69a024a70a74b9488e62a1081/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:19:57.609074 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86fd75a-d8e2-42b1-94dc-ba488f8bdcc0 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:57.609372 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86fd75a-d8e2-42b1-94dc-ba488f8bdcc0 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:57.609655 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86fd75a-d8e2-42b1-94dc-ba488f8bdcc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:57.628880 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-d86fd75a-d8e2-42b1-94dc-ba488f8bdcc0 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:19:57.630092 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-d86fd75a-d8e2-42b1-94dc-ba488f8bdcc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:57.688918 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1375/2738] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:19:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:19:57.700900 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b49aa3-86ea-4dd2-a3b9-2e78f49ab987 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:57.702674 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-91b49aa3-86ea-4dd2-a3b9-2e78f49ab987 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:57.769121 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b49aa3-86ea-4dd2-a3b9-2e78f49ab987 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:57.772748 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c81a364-ed48-43fa-8483-4afa08087372 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:57.773412 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81a364-ed48-43fa-8483-4afa08087372 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:57.773698 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81a364-ed48-43fa-8483-4afa08087372 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:57.773978 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81a364-ed48-43fa-8483-4afa08087372 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:57.785201 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c81a364-ed48-43fa-8483-4afa08087372 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:57.786650 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c81a364-ed48-43fa-8483-4afa08087372 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:57.796951 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1364/2739] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:19:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:19:58.449407 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7bfa53-cd0e-4e01-ab82-70816225ac0b None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:58.449969 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7bfa53-cd0e-4e01-ab82-70816225ac0b None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:58.449969 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7bfa53-cd0e-4e01-ab82-70816225ac0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:58.475961 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-ee7bfa53-cd0e-4e01-ab82-70816225ac0b None None] MFA Rules not processed for user `ae8147f69a024a70a74b9488e62a1081`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:19:58.477203 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-ee7bfa53-cd0e-4e01-ab82-70816225ac0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:58.494673 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:19:58.544123 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1376/2740] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:19:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:19:58.548734 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c81a364-ed48-43fa-8483-4afa08087372 service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:58.559730 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c81a364-ed48-43fa-8483-4afa08087372 service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:58.564975 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea2487-b282-44f7-9472-2e57bcbcbaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:58.565654 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea2487-b282-44f7-9472-2e57bcbcbaf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:58.565940 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea2487-b282-44f7-9472-2e57bcbcbaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:58.566216 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea2487-b282-44f7-9472-2e57bcbcbaf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:58.566922 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea2487-b282-44f7-9472-2e57bcbcbaf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:58.568856 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea2487-b282-44f7-9472-2e57bcbcbaf4 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:58.598834 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1365/2741] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:19:58 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 12:19:58.601069 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7bfa53-cd0e-4e01-ab82-70816225ac0b None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:58.613471 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7bfa53-cd0e-4e01-ab82-70816225ac0b None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:58.674841 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1769802-545c-4e15-8ee5-0e65eda2e669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:58.675578 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1769802-545c-4e15-8ee5-0e65eda2e669 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:58.675867 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1769802-545c-4e15-8ee5-0e65eda2e669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:58.676141 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1769802-545c-4e15-8ee5-0e65eda2e669 admin admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:58.676849 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1769802-545c-4e15-8ee5-0e65eda2e669 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:58.678745 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1769802-545c-4e15-8ee5-0e65eda2e669 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:58.698414 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1377/2742] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:19:58 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:19:58.702622 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea2487-b282-44f7-9472-2e57bcbcbaf4 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:58.713080 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea2487-b282-44f7-9472-2e57bcbcbaf4 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:58.717905 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ce5aa-79a2-46fe-99f6-bbec30691155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:58.718563 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ce5aa-79a2-46fe-99f6-bbec30691155 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:58.718842 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ce5aa-79a2-46fe-99f6-bbec30691155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:58.719117 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ce5aa-79a2-46fe-99f6-bbec30691155 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:58.719838 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ce5aa-79a2-46fe-99f6-bbec30691155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:58.721439 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ce5aa-79a2-46fe-99f6-bbec30691155 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:58.736600 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1366/2743] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 12:19:58.738364 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1769802-545c-4e15-8ee5-0e65eda2e669 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:58.749709 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1769802-545c-4e15-8ee5-0e65eda2e669 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:58.754326 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaba1ad-927f-4cb2-b8e4-9e9ed295e72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:58.755217 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaba1ad-927f-4cb2-b8e4-9e9ed295e72b admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:58.755525 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaba1ad-927f-4cb2-b8e4-9e9ed295e72b admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:58.755808 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaba1ad-927f-4cb2-b8e4-9e9ed295e72b admin admin] PATH_INFO: `/v3/projects/766fb5f5e9cf4cb998ba8fabc6bc26f3/users/2719ffb1c72a4127a5d05fe240fb2879/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:58.770742 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaba1ad-927f-4cb2-b8e4-9e9ed295e72b admin admin] RBAC: Authorizing `identity:create_grant(project_id=766fb5f5e9cf4cb998ba8fabc6bc26f3, user_id=2719ffb1c72a4127a5d05fe240fb2879, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:58.773433 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaba1ad-927f-4cb2-b8e4-9e9ed295e72b admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:58.786102 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1378/2744] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:19:58 2022] PUT /identity/v3/projects/766fb5f5e9cf4cb998ba8fabc6bc26f3/users/2719ffb1c72a4127a5d05fe240fb2879/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:19:58.790077 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ce5aa-79a2-46fe-99f6-bbec30691155 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:58.800946 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ce5aa-79a2-46fe-99f6-bbec30691155 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:58.857658 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87fac31-b929-4eb3-94a7-9fffde864452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:58.858325 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87fac31-b929-4eb3-94a7-9fffde864452 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:58.858610 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87fac31-b929-4eb3-94a7-9fffde864452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:58.858886 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87fac31-b929-4eb3-94a7-9fffde864452 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:58.859601 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87fac31-b929-4eb3-94a7-9fffde864452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:58.861234 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87fac31-b929-4eb3-94a7-9fffde864452 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:58.870989 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1367/2745] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:19:58.875107 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaba1ad-927f-4cb2-b8e4-9e9ed295e72b admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:58.885423 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaba1ad-927f-4cb2-b8e4-9e9ed295e72b admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:58.890402 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db03250-6cc2-4fa8-9996-16fd39a15a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:58.891286 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db03250-6cc2-4fa8-9996-16fd39a15a17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:58.891574 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db03250-6cc2-4fa8-9996-16fd39a15a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:58.891855 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db03250-6cc2-4fa8-9996-16fd39a15a17 admin admin] PATH_INFO: `/v3/projects/766fb5f5e9cf4cb998ba8fabc6bc26f3/users/2719ffb1c72a4127a5d05fe240fb2879/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:58.893858 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db03250-6cc2-4fa8-9996-16fd39a15a17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=766fb5f5e9cf4cb998ba8fabc6bc26f3, user_id=2719ffb1c72a4127a5d05fe240fb2879, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:58.896512 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db03250-6cc2-4fa8-9996-16fd39a15a17 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:58.907700 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1379/2746] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:19:58 2022] PUT /identity/v3/projects/766fb5f5e9cf4cb998ba8fabc6bc26f3/users/2719ffb1c72a4127a5d05fe240fb2879/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:19:59.521459 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b86f0e-78f9-4eab-9d91-ee08259f96b3 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:59.521778 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b86f0e-78f9-4eab-9d91-ee08259f96b3 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:59.522055 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b86f0e-78f9-4eab-9d91-ee08259f96b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:59.549441 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-34b86f0e-78f9-4eab-9d91-ee08259f96b3 None None] MFA Rules not processed for user `2719ffb1c72a4127a5d05fe240fb2879`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:19:59.550669 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-34b86f0e-78f9-4eab-9d91-ee08259f96b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:59.607678 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:19:59.639758 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1368/2747] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:19:59 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:19:59.651705 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db03250-6cc2-4fa8-9996-16fd39a15a17 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:19:59.654575 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-4db03250-6cc2-4fa8-9996-16fd39a15a17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:19:59.714279 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db03250-6cc2-4fa8-9996-16fd39a15a17 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:19:59.718682 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b0d63f-659a-4f16-9381-0cf5e55ec5fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:19:59.719339 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b0d63f-659a-4f16-9381-0cf5e55ec5fe service cinder] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:19:59.719631 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b0d63f-659a-4f16-9381-0cf5e55ec5fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:19:59.719900 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b0d63f-659a-4f16-9381-0cf5e55ec5fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:19:59.746524 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:19:59.782562 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b0d63f-659a-4f16-9381-0cf5e55ec5fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:19:59.784022 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b0d63f-659a-4f16-9381-0cf5e55ec5fe service cinder] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:19:59.794614 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1380/2748] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:19:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:20:01.139835 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b86f0e-78f9-4eab-9d91-ee08259f96b3 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:01.149477 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b86f0e-78f9-4eab-9d91-ee08259f96b3 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:01.153650 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b33ae2-53b5-4781-a1a7-538ba5684dbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:01.154290 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b33ae2-53b5-4781-a1a7-538ba5684dbd service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:01.154572 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b33ae2-53b5-4781-a1a7-538ba5684dbd service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:01.154842 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b33ae2-53b5-4781-a1a7-538ba5684dbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:01.163803 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b33ae2-53b5-4781-a1a7-538ba5684dbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:01.165259 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b33ae2-53b5-4781-a1a7-538ba5684dbd service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:01.175324 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1369/2749] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:20:01 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:20:03.175628 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b0d63f-659a-4f16-9381-0cf5e55ec5fe service cinder] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:03.177147 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-23b0d63f-659a-4f16-9381-0cf5e55ec5fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:03.243447 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b0d63f-659a-4f16-9381-0cf5e55ec5fe service cinder] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:03.247977 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9477e-d7e3-471a-8cab-7dc80eb71aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:03.249342 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9477e-d7e3-471a-8cab-7dc80eb71aa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:03.249626 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9477e-d7e3-471a-8cab-7dc80eb71aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:03.249910 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9477e-d7e3-471a-8cab-7dc80eb71aa7 admin admin] PATH_INFO: `/v3/users/b8ef4aaa11364afc8ead2b7197b7a842` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:03.251086 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e9477e-d7e3-471a-8cab-7dc80eb71aa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8ef4aaa11364afc8ead2b7197b7a842)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:03.253045 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e9477e-d7e3-471a-8cab-7dc80eb71aa7 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:03.299795 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-b2e9477e-d7e3-471a-8cab-7dc80eb71aa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8ef4aaa11364afc8ead2b7197b7a842'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:03.306581 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-b2e9477e-d7e3-471a-8cab-7dc80eb71aa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8ef4aaa11364afc8ead2b7197b7a842'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:03.307273 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-b2e9477e-d7e3-471a-8cab-7dc80eb71aa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8ef4aaa11364afc8ead2b7197b7a842'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:03.307877 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-b2e9477e-d7e3-471a-8cab-7dc80eb71aa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8ef4aaa11364afc8ead2b7197b7a842'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:03.320924 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-b2e9477e-d7e3-471a-8cab-7dc80eb71aa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8ef4aaa11364afc8ead2b7197b7a842'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:03.334345 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1381/2750] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:20:03 2022] DELETE /identity/v3/users/b8ef4aaa11364afc8ead2b7197b7a842 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:20:03.338879 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a27796-e7bf-4584-8af0-4c08eef527a7 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:03.339394 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a27796-e7bf-4584-8af0-4c08eef527a7 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:03.339605 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a27796-e7bf-4584-8af0-4c08eef527a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:03.357481 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-a4a27796-e7bf-4584-8af0-4c08eef527a7 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:20:03.358695 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a4a27796-e7bf-4584-8af0-4c08eef527a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:03.419132 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1370/2751] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:20:03.429199 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9477e-d7e3-471a-8cab-7dc80eb71aa7 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:03.430624 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-b2e9477e-d7e3-471a-8cab-7dc80eb71aa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:03.478973 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:20:03.492670 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9477e-d7e3-471a-8cab-7dc80eb71aa7 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:03.497804 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb8e3a-77f2-4e40-b1db-48a4d18b4b25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:03.498497 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb8e3a-77f2-4e40-b1db-48a4d18b4b25 service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:03.498813 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb8e3a-77f2-4e40-b1db-48a4d18b4b25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:03.499093 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb8e3a-77f2-4e40-b1db-48a4d18b4b25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:03.508550 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cb8e3a-77f2-4e40-b1db-48a4d18b4b25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:03.509991 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cb8e3a-77f2-4e40-b1db-48a4d18b4b25 service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:03.520935 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1382/2752] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:20:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:20:03.805951 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a27796-e7bf-4584-8af0-4c08eef527a7 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:03.807876 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a4a27796-e7bf-4584-8af0-4c08eef527a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:03.822462 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a27796-e7bf-4584-8af0-4c08eef527a7 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:03.828312 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5699a939-96ff-4319-94f5-9c7fbc971f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:03.829301 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699a939-96ff-4319-94f5-9c7fbc971f85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:03.829656 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699a939-96ff-4319-94f5-9c7fbc971f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:03.830007 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699a939-96ff-4319-94f5-9c7fbc971f85 admin admin] PATH_INFO: `/v3/projects/0e0bcc72293a4b56826edacd0cf2536c` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:03.831428 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5699a939-96ff-4319-94f5-9c7fbc971f85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e0bcc72293a4b56826edacd0cf2536c)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:03.833635 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5699a939-96ff-4319-94f5-9c7fbc971f85 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:03.891296 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-5699a939-96ff-4319-94f5-9c7fbc971f85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e0bcc72293a4b56826edacd0cf2536c', 'request_id': 'req-5699a939-96ff-4319-94f5-9c7fbc971f85'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:03.901306 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-5699a939-96ff-4319-94f5-9c7fbc971f85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e0bcc72293a4b56826edacd0cf2536c', 'request_id': 'req-5699a939-96ff-4319-94f5-9c7fbc971f85'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:03.909694 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-5699a939-96ff-4319-94f5-9c7fbc971f85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e0bcc72293a4b56826edacd0cf2536c', 'request_id': 'req-5699a939-96ff-4319-94f5-9c7fbc971f85'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:03.923600 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-5699a939-96ff-4319-94f5-9c7fbc971f85 admin admin] The token cache is being invalidate because project 0e0bcc72293a4b56826edacd0cf2536c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:20:03.923838 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-5699a939-96ff-4319-94f5-9c7fbc971f85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:03.924495 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-5699a939-96ff-4319-94f5-9c7fbc971f85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:03.926227 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1371/2753] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:20:03 2022] DELETE /identity/v3/projects/0e0bcc72293a4b56826edacd0cf2536c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:20:03.930403 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb8e3a-77f2-4e40-b1db-48a4d18b4b25 service neutron] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:03.941469 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb8e3a-77f2-4e40-b1db-48a4d18b4b25 service neutron] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:04.005959 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74d5c0-1753-4633-b4f7-1e34f2a2d2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:04.006847 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74d5c0-1753-4633-b4f7-1e34f2a2d2de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:04.007132 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74d5c0-1753-4633-b4f7-1e34f2a2d2de admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:04.007411 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74d5c0-1753-4633-b4f7-1e34f2a2d2de admin admin] PATH_INFO: `/v3/users/144e664b9ade4133b155bc875e432c78` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:04.008643 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f74d5c0-1753-4633-b4f7-1e34f2a2d2de admin admin] RBAC: Authorizing `identity:delete_user(user_id=144e664b9ade4133b155bc875e432c78)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:04.010574 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f74d5c0-1753-4633-b4f7-1e34f2a2d2de admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:04.065370 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-7f74d5c0-1753-4633-b4f7-1e34f2a2d2de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '144e664b9ade4133b155bc875e432c78'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:04.073441 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-7f74d5c0-1753-4633-b4f7-1e34f2a2d2de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '144e664b9ade4133b155bc875e432c78'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:04.075017 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-7f74d5c0-1753-4633-b4f7-1e34f2a2d2de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '144e664b9ade4133b155bc875e432c78'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:04.075717 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-7f74d5c0-1753-4633-b4f7-1e34f2a2d2de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '144e664b9ade4133b155bc875e432c78'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:04.088919 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-7f74d5c0-1753-4633-b4f7-1e34f2a2d2de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '144e664b9ade4133b155bc875e432c78'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:04.102420 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1383/2754] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:20:03 2022] DELETE /identity/v3/users/144e664b9ade4133b155bc875e432c78 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:20:04.397830 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5699a939-96ff-4319-94f5-9c7fbc971f85 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:04.399545 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-5699a939-96ff-4319-94f5-9c7fbc971f85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:04.414030 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5699a939-96ff-4319-94f5-9c7fbc971f85 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:04.461640 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:20:04.476346 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9961ea-de4f-49f2-a8c0-10b02b532873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:04.477248 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9961ea-de4f-49f2-a8c0-10b02b532873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:04.477533 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9961ea-de4f-49f2-a8c0-10b02b532873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:04.477805 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9961ea-de4f-49f2-a8c0-10b02b532873 admin admin] PATH_INFO: `/v3/projects/2f598ca7458d4721932f21cf051a069b` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:04.478997 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9961ea-de4f-49f2-a8c0-10b02b532873 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f598ca7458d4721932f21cf051a069b)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:04.481802 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9961ea-de4f-49f2-a8c0-10b02b532873 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:04.533671 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3d9961ea-de4f-49f2-a8c0-10b02b532873 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f598ca7458d4721932f21cf051a069b', 'request_id': 'req-3d9961ea-de4f-49f2-a8c0-10b02b532873'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:04.541330 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3d9961ea-de4f-49f2-a8c0-10b02b532873 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f598ca7458d4721932f21cf051a069b', 'request_id': 'req-3d9961ea-de4f-49f2-a8c0-10b02b532873'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:04.548260 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3d9961ea-de4f-49f2-a8c0-10b02b532873 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f598ca7458d4721932f21cf051a069b', 'request_id': 'req-3d9961ea-de4f-49f2-a8c0-10b02b532873'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:04.560015 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3d9961ea-de4f-49f2-a8c0-10b02b532873 admin admin] The token cache is being invalidate because project 2f598ca7458d4721932f21cf051a069b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:20:04.560338 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3d9961ea-de4f-49f2-a8c0-10b02b532873 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:04.561021 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3d9961ea-de4f-49f2-a8c0-10b02b532873 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:04.562642 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1372/2755] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:20:04 2022] DELETE /identity/v3/projects/2f598ca7458d4721932f21cf051a069b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:20:04.567602 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15c3ad-56c8-4e41-ba9f-b07cd8c83993 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:04.568141 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15c3ad-56c8-4e41-ba9f-b07cd8c83993 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:04.568290 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15c3ad-56c8-4e41-ba9f-b07cd8c83993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:04.586507 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-5d15c3ad-56c8-4e41-ba9f-b07cd8c83993 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:20:04.587711 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-5d15c3ad-56c8-4e41-ba9f-b07cd8c83993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:04.647934 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1384/2756] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:20:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:20:04.656595 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167def3f-2f4e-4d6b-9df3-5180f3b968fd None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:04.656886 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167def3f-2f4e-4d6b-9df3-5180f3b968fd None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:04.657168 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167def3f-2f4e-4d6b-9df3-5180f3b968fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:04.676921 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-167def3f-2f4e-4d6b-9df3-5180f3b968fd None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:20:04.678183 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-167def3f-2f4e-4d6b-9df3-5180f3b968fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:04.687014 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1373/2757] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:20:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:20:04.691504 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d15c3ad-56c8-4e41-ba9f-b07cd8c83993 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:04.702328 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d15c3ad-56c8-4e41-ba9f-b07cd8c83993 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:04.707049 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108860c6-6024-4b57-8a74-d49d8404232b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:04.707729 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108860c6-6024-4b57-8a74-d49d8404232b admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:04.708048 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108860c6-6024-4b57-8a74-d49d8404232b admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:04.708432 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108860c6-6024-4b57-8a74-d49d8404232b admin admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:04.709181 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108860c6-6024-4b57-8a74-d49d8404232b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:20:04.709491 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108860c6-6024-4b57-8a74-d49d8404232b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:04.711164 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108860c6-6024-4b57-8a74-d49d8404232b admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:04.712986 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:20:04.725884 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1385/2758] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:20:04.730876 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167def3f-2f4e-4d6b-9df3-5180f3b968fd None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:04.740766 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167def3f-2f4e-4d6b-9df3-5180f3b968fd None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:04.745428 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3630d9e-8d4f-4bdf-a90d-911bd130de50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:04.746791 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3630d9e-8d4f-4bdf-a90d-911bd130de50 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:04.747128 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3630d9e-8d4f-4bdf-a90d-911bd130de50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:04.747437 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3630d9e-8d4f-4bdf-a90d-911bd130de50 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:04.748126 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3630d9e-8d4f-4bdf-a90d-911bd130de50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:04.750059 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3630d9e-8d4f-4bdf-a90d-911bd130de50 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:04.778778 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1374/2759] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:20:04 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:20:04.780190 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108860c6-6024-4b57-8a74-d49d8404232b admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:04.790462 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108860c6-6024-4b57-8a74-d49d8404232b admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:04.847590 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384818c4-62b8-4b35-b699-b36fe7683e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:04.848300 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384818c4-62b8-4b35-b699-b36fe7683e8b admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:04.848591 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384818c4-62b8-4b35-b699-b36fe7683e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:04.848870 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384818c4-62b8-4b35-b699-b36fe7683e8b admin admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:04.849579 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384818c4-62b8-4b35-b699-b36fe7683e8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:04.851502 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384818c4-62b8-4b35-b699-b36fe7683e8b admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:04.874445 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1386/2760] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:20:04 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:20:04.878799 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3630d9e-8d4f-4bdf-a90d-911bd130de50 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:04.889259 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3630d9e-8d4f-4bdf-a90d-911bd130de50 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:04.893846 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804c999-e51e-4974-b559-bf1c8150f68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:04.894510 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804c999-e51e-4974-b559-bf1c8150f68c admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:04.894790 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804c999-e51e-4974-b559-bf1c8150f68c admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:04.895060 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804c999-e51e-4974-b559-bf1c8150f68c admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:04.895781 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b804c999-e51e-4974-b559-bf1c8150f68c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:04.897417 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b804c999-e51e-4974-b559-bf1c8150f68c admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:04.908731 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1375/2761] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:20:04.913031 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384818c4-62b8-4b35-b699-b36fe7683e8b admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:04.924240 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384818c4-62b8-4b35-b699-b36fe7683e8b admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:04.929220 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9aa0d-f930-4438-9c5f-40919d04c6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:04.929901 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9aa0d-f930-4438-9c5f-40919d04c6b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:04.930203 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9aa0d-f930-4438-9c5f-40919d04c6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:04.930487 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9aa0d-f930-4438-9c5f-40919d04c6b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:04.931213 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb9aa0d-f930-4438-9c5f-40919d04c6b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:04.932878 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb9aa0d-f930-4438-9c5f-40919d04c6b4 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:04.943926 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1387/2762] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:20:04.947913 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804c999-e51e-4974-b559-bf1c8150f68c admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:04.958530 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804c999-e51e-4974-b559-bf1c8150f68c admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:04.963319 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b539a8-c135-4c5e-a594-52c555c2878a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:04.964158 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b539a8-c135-4c5e-a594-52c555c2878a admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:04.964994 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b539a8-c135-4c5e-a594-52c555c2878a admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:04.965278 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b539a8-c135-4c5e-a594-52c555c2878a admin admin] PATH_INFO: `/v3/projects/a8fda23c46074e98a26e15f6dda02339/users/53394ccc71b4455abb5694a707430fbf/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:04.982148 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b539a8-c135-4c5e-a594-52c555c2878a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8fda23c46074e98a26e15f6dda02339, user_id=53394ccc71b4455abb5694a707430fbf, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:04.985096 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b539a8-c135-4c5e-a594-52c555c2878a admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:04.999360 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1376/2763] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:20:04 2022] PUT /identity/v3/projects/a8fda23c46074e98a26e15f6dda02339/users/53394ccc71b4455abb5694a707430fbf/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:20:05.010467 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e46bf-2b4d-4781-8fd4-6bb124360261 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:05.010467 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e46bf-2b4d-4781-8fd4-6bb124360261 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:05.010694 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e46bf-2b4d-4781-8fd4-6bb124360261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:05.040085 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-8a6e46bf-2b4d-4781-8fd4-6bb124360261 None None] MFA Rules not processed for user `53394ccc71b4455abb5694a707430fbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:20:05.041366 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-8a6e46bf-2b4d-4781-8fd4-6bb124360261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:05.108818 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1388/2764] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:20:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:20:05.113617 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b539a8-c135-4c5e-a594-52c555c2878a admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:05.187022 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b539a8-c135-4c5e-a594-52c555c2878a admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:05.192488 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43595a-9ed4-42e4-8dd2-00bb4bd3c321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:05.193163 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43595a-9ed4-42e4-8dd2-00bb4bd3c321 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:05.193447 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43595a-9ed4-42e4-8dd2-00bb4bd3c321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:05.193720 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43595a-9ed4-42e4-8dd2-00bb4bd3c321 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:05.194411 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e43595a-9ed4-42e4-8dd2-00bb4bd3c321 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:05.196349 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e43595a-9ed4-42e4-8dd2-00bb4bd3c321 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:05.224111 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:20:05.236840 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1377/2765] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:20:05 2022] POST /identity/v3/projects => generated 379 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:20:05.244695 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e46bf-2b4d-4781-8fd4-6bb124360261 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:05.260444 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e46bf-2b4d-4781-8fd4-6bb124360261 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:05.323250 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c96b3-18d0-47ec-9e4f-6ca5be6d0742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:05.324559 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c96b3-18d0-47ec-9e4f-6ca5be6d0742 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:05.324854 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c96b3-18d0-47ec-9e4f-6ca5be6d0742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:05.325138 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c96b3-18d0-47ec-9e4f-6ca5be6d0742 admin admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:05.325852 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c96b3-18d0-47ec-9e4f-6ca5be6d0742 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:05.327789 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c96b3-18d0-47ec-9e4f-6ca5be6d0742 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:05.336831 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:20:05.354532 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1389/2766] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:20:05 2022] POST /identity/v3/users => generated 296 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:20:05.356077 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43595a-9ed4-42e4-8dd2-00bb4bd3c321 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:05.367280 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43595a-9ed4-42e4-8dd2-00bb4bd3c321 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:05.372340 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1646f7ac-bf06-4c0f-8f42-42e7d01e9913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:05.373049 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1646f7ac-bf06-4c0f-8f42-42e7d01e9913 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:05.373321 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1646f7ac-bf06-4c0f-8f42-42e7d01e9913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:05.373616 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1646f7ac-bf06-4c0f-8f42-42e7d01e9913 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:05.374351 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1646f7ac-bf06-4c0f-8f42-42e7d01e9913 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:05.375979 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1646f7ac-bf06-4c0f-8f42-42e7d01e9913 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:05.388589 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1378/2767] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 12:20:05.392926 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c96b3-18d0-47ec-9e4f-6ca5be6d0742 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:05.404318 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c96b3-18d0-47ec-9e4f-6ca5be6d0742 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:05.409057 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd7860-2556-415c-b6b3-66a429e33b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:05.409950 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd7860-2556-415c-b6b3-66a429e33b3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:05.410235 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd7860-2556-415c-b6b3-66a429e33b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:05.410511 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd7860-2556-415c-b6b3-66a429e33b3a admin admin] PATH_INFO: `/v3/projects/ee60baa5a9994eb0b12bb954073ee51a/users/8dc776b16121492b99990712f1681689/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:05.425811 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbd7860-2556-415c-b6b3-66a429e33b3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee60baa5a9994eb0b12bb954073ee51a, user_id=8dc776b16121492b99990712f1681689, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:05.428492 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbd7860-2556-415c-b6b3-66a429e33b3a admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:05.441054 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1390/2768] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:20:05 2022] PUT /identity/v3/projects/ee60baa5a9994eb0b12bb954073ee51a/users/8dc776b16121492b99990712f1681689/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:20:05.445190 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1646f7ac-bf06-4c0f-8f42-42e7d01e9913 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:05.456429 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1646f7ac-bf06-4c0f-8f42-42e7d01e9913 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:05.515187 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af31fa7b-c9ff-4882-996a-9d2e5b54fef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:05.515775 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31fa7b-c9ff-4882-996a-9d2e5b54fef9 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:05.516055 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31fa7b-c9ff-4882-996a-9d2e5b54fef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:05.516363 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31fa7b-c9ff-4882-996a-9d2e5b54fef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:05.517109 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af31fa7b-c9ff-4882-996a-9d2e5b54fef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:05.518773 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af31fa7b-c9ff-4882-996a-9d2e5b54fef9 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:05.536448 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1379/2769] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:20:05.540493 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd7860-2556-415c-b6b3-66a429e33b3a admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:05.551176 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd7860-2556-415c-b6b3-66a429e33b3a admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:05.555954 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7900ee98-ea06-4697-b99b-33cc06459618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:05.556872 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900ee98-ea06-4697-b99b-33cc06459618 admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:05.557160 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900ee98-ea06-4697-b99b-33cc06459618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:05.557519 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900ee98-ea06-4697-b99b-33cc06459618 admin admin] PATH_INFO: `/v3/projects/ee60baa5a9994eb0b12bb954073ee51a/users/8dc776b16121492b99990712f1681689/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:05.560122 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7900ee98-ea06-4697-b99b-33cc06459618 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee60baa5a9994eb0b12bb954073ee51a, user_id=8dc776b16121492b99990712f1681689, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:05.562784 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7900ee98-ea06-4697-b99b-33cc06459618 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:05.573364 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1391/2770] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:20:05 2022] PUT /identity/v3/projects/ee60baa5a9994eb0b12bb954073ee51a/users/8dc776b16121492b99990712f1681689/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:20:05.584251 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f477f64-8187-4001-ae3e-260f22be1e95 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:05.584547 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f477f64-8187-4001-ae3e-260f22be1e95 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:05.584829 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f477f64-8187-4001-ae3e-260f22be1e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:05.612638 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-2f477f64-8187-4001-ae3e-260f22be1e95 None None] MFA Rules not processed for user `8dc776b16121492b99990712f1681689`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:20:05.613882 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-2f477f64-8187-4001-ae3e-260f22be1e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:05.686112 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1380/2771] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:20:05 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:20:05.697664 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7900ee98-ea06-4697-b99b-33cc06459618 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:05.700018 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-7900ee98-ea06-4697-b99b-33cc06459618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:05.759027 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7900ee98-ea06-4697-b99b-33cc06459618 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:05.763420 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b02f7a-9143-4191-8678-f41532430d9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:05.764074 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b02f7a-9143-4191-8678-f41532430d9e service cinder] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:05.764459 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b02f7a-9143-4191-8678-f41532430d9e service cinder] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:05.764743 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b02f7a-9143-4191-8678-f41532430d9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:05.773974 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b02f7a-9143-4191-8678-f41532430d9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:05.775342 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b02f7a-9143-4191-8678-f41532430d9e service cinder] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:05.784878 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1392/2772] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:20:05 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:20:05.859345 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f477f64-8187-4001-ae3e-260f22be1e95 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:05.869165 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f477f64-8187-4001-ae3e-260f22be1e95 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:05.873390 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505aca4c-424e-49d5-97c9-7f86e02a8caa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:05.874040 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505aca4c-424e-49d5-97c9-7f86e02a8caa service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:05.874322 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505aca4c-424e-49d5-97c9-7f86e02a8caa service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:05.874595 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505aca4c-424e-49d5-97c9-7f86e02a8caa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:05.930953 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505aca4c-424e-49d5-97c9-7f86e02a8caa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:05.932440 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505aca4c-424e-49d5-97c9-7f86e02a8caa service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:05.942322 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1381/2773] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:20:05 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:20:15.780608 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:INSERT=4,keystone:SELECT=43 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:20:15.938157 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:20:16.826236 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b02f7a-9143-4191-8678-f41532430d9e service cinder] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:16.889996 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b02f7a-9143-4191-8678-f41532430d9e service cinder] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:16.894509 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a18df1-9f5d-4585-a9df-52d894ae93ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:16.895375 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a18df1-9f5d-4585-a9df-52d894ae93ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:16.895659 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a18df1-9f5d-4585-a9df-52d894ae93ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:16.895940 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a18df1-9f5d-4585-a9df-52d894ae93ba admin admin] PATH_INFO: `/v3/users/53394ccc71b4455abb5694a707430fbf` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:16.897130 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a18df1-9f5d-4585-a9df-52d894ae93ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=53394ccc71b4455abb5694a707430fbf)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:16.899054 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a18df1-9f5d-4585-a9df-52d894ae93ba admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:16.946874 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-e9a18df1-9f5d-4585-a9df-52d894ae93ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53394ccc71b4455abb5694a707430fbf'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:16.953962 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-e9a18df1-9f5d-4585-a9df-52d894ae93ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53394ccc71b4455abb5694a707430fbf'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:16.954623 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-e9a18df1-9f5d-4585-a9df-52d894ae93ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53394ccc71b4455abb5694a707430fbf'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:16.955235 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-e9a18df1-9f5d-4585-a9df-52d894ae93ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53394ccc71b4455abb5694a707430fbf'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:16.968230 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-e9a18df1-9f5d-4585-a9df-52d894ae93ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53394ccc71b4455abb5694a707430fbf'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:16.982237 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1393/2774] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:20:16 2022] DELETE /identity/v3/users/53394ccc71b4455abb5694a707430fbf => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:20:16.986640 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95ae2b-8b57-4e09-88f4-04a310f8544b None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:16.987112 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95ae2b-8b57-4e09-88f4-04a310f8544b None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:16.987211 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95ae2b-8b57-4e09-88f4-04a310f8544b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:17.004399 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-bb95ae2b-8b57-4e09-88f4-04a310f8544b None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:20:17.005581 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-bb95ae2b-8b57-4e09-88f4-04a310f8544b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:17.063372 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1382/2775] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:20:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:20:17.072987 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a18df1-9f5d-4585-a9df-52d894ae93ba admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:17.074473 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-e9a18df1-9f5d-4585-a9df-52d894ae93ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:17.131800 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a18df1-9f5d-4585-a9df-52d894ae93ba admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:17.135439 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949f03c-b1d7-4fc1-9b9c-5399ab7ab453 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:17.136092 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949f03c-b1d7-4fc1-9b9c-5399ab7ab453 service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:17.136471 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949f03c-b1d7-4fc1-9b9c-5399ab7ab453 service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:17.136750 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949f03c-b1d7-4fc1-9b9c-5399ab7ab453 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:17.146144 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8949f03c-b1d7-4fc1-9b9c-5399ab7ab453 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:17.147641 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8949f03c-b1d7-4fc1-9b9c-5399ab7ab453 service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:17.157816 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1394/2776] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:20:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:20:17.431710 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95ae2b-8b57-4e09-88f4-04a310f8544b None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:17.433722 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-bb95ae2b-8b57-4e09-88f4-04a310f8544b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:17.448347 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95ae2b-8b57-4e09-88f4-04a310f8544b None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:17.454431 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759baf65-6e31-4494-8851-4853e1d85dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:17.455346 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759baf65-6e31-4494-8851-4853e1d85dd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:17.462622 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759baf65-6e31-4494-8851-4853e1d85dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:17.462930 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759baf65-6e31-4494-8851-4853e1d85dd4 admin admin] PATH_INFO: `/v3/projects/a8fda23c46074e98a26e15f6dda02339` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:17.464936 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759baf65-6e31-4494-8851-4853e1d85dd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8fda23c46074e98a26e15f6dda02339)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:17.466875 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759baf65-6e31-4494-8851-4853e1d85dd4 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:17.518585 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-759baf65-6e31-4494-8851-4853e1d85dd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8fda23c46074e98a26e15f6dda02339', 'request_id': 'req-759baf65-6e31-4494-8851-4853e1d85dd4'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:17.527406 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-759baf65-6e31-4494-8851-4853e1d85dd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8fda23c46074e98a26e15f6dda02339', 'request_id': 'req-759baf65-6e31-4494-8851-4853e1d85dd4'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:17.533372 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-759baf65-6e31-4494-8851-4853e1d85dd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8fda23c46074e98a26e15f6dda02339', 'request_id': 'req-759baf65-6e31-4494-8851-4853e1d85dd4'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:17.545145 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-759baf65-6e31-4494-8851-4853e1d85dd4 admin admin] The token cache is being invalidate because project a8fda23c46074e98a26e15f6dda02339 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:20:17.545437 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-759baf65-6e31-4494-8851-4853e1d85dd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:17.546118 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-759baf65-6e31-4494-8851-4853e1d85dd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:17.547691 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1383/2777] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:20:17 2022] DELETE /identity/v3/projects/a8fda23c46074e98a26e15f6dda02339 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:20:17.551662 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949f03c-b1d7-4fc1-9b9c-5399ab7ab453 service neutron] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:17.561990 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949f03c-b1d7-4fc1-9b9c-5399ab7ab453 service neutron] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:17.583800 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:20:17.628941 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f62b3-0a5e-4ed4-a0e6-4bf3e1c9961c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:17.629817 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f62b3-0a5e-4ed4-a0e6-4bf3e1c9961c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:17.630093 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f62b3-0a5e-4ed4-a0e6-4bf3e1c9961c admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:17.630366 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f62b3-0a5e-4ed4-a0e6-4bf3e1c9961c admin admin] PATH_INFO: `/v3/users/8dc776b16121492b99990712f1681689` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:17.631553 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6f62b3-0a5e-4ed4-a0e6-4bf3e1c9961c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dc776b16121492b99990712f1681689)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:17.633509 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6f62b3-0a5e-4ed4-a0e6-4bf3e1c9961c admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:17.683981 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-ec6f62b3-0a5e-4ed4-a0e6-4bf3e1c9961c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dc776b16121492b99990712f1681689'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:17.691306 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-ec6f62b3-0a5e-4ed4-a0e6-4bf3e1c9961c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dc776b16121492b99990712f1681689'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:17.692024 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-ec6f62b3-0a5e-4ed4-a0e6-4bf3e1c9961c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dc776b16121492b99990712f1681689'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:17.692700 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-ec6f62b3-0a5e-4ed4-a0e6-4bf3e1c9961c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dc776b16121492b99990712f1681689'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:17.705053 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-ec6f62b3-0a5e-4ed4-a0e6-4bf3e1c9961c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dc776b16121492b99990712f1681689'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:17.718483 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1395/2778] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:20:17 2022] DELETE /identity/v3/users/8dc776b16121492b99990712f1681689 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:20:18.041513 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759baf65-6e31-4494-8851-4853e1d85dd4 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:18.043933 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-759baf65-6e31-4494-8851-4853e1d85dd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:18.066669 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759baf65-6e31-4494-8851-4853e1d85dd4 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:18.126937 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f073d8-d7e4-489b-9470-1ab3cb4cdf39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:18.127830 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f073d8-d7e4-489b-9470-1ab3cb4cdf39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:18.130138 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f073d8-d7e4-489b-9470-1ab3cb4cdf39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:18.130527 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f073d8-d7e4-489b-9470-1ab3cb4cdf39 admin admin] PATH_INFO: `/v3/projects/ee60baa5a9994eb0b12bb954073ee51a` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:18.132224 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f073d8-d7e4-489b-9470-1ab3cb4cdf39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee60baa5a9994eb0b12bb954073ee51a)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:18.134703 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f073d8-d7e4-489b-9470-1ab3cb4cdf39 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:18.173143 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:20:18.192124 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a5f073d8-d7e4-489b-9470-1ab3cb4cdf39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee60baa5a9994eb0b12bb954073ee51a', 'request_id': 'req-a5f073d8-d7e4-489b-9470-1ab3cb4cdf39'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:18.200462 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a5f073d8-d7e4-489b-9470-1ab3cb4cdf39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee60baa5a9994eb0b12bb954073ee51a', 'request_id': 'req-a5f073d8-d7e4-489b-9470-1ab3cb4cdf39'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:18.206340 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a5f073d8-d7e4-489b-9470-1ab3cb4cdf39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee60baa5a9994eb0b12bb954073ee51a', 'request_id': 'req-a5f073d8-d7e4-489b-9470-1ab3cb4cdf39'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:18.218194 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a5f073d8-d7e4-489b-9470-1ab3cb4cdf39 admin admin] The token cache is being invalidate because project ee60baa5a9994eb0b12bb954073ee51a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:20:18.218861 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a5f073d8-d7e4-489b-9470-1ab3cb4cdf39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:18.219251 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a5f073d8-d7e4-489b-9470-1ab3cb4cdf39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:18.221002 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1384/2779] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:20:18 2022] DELETE /identity/v3/projects/ee60baa5a9994eb0b12bb954073ee51a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:20:18.227828 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715cefa7-05b6-4696-a15d-897046116a38 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:18.228708 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715cefa7-05b6-4696-a15d-897046116a38 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:18.228978 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715cefa7-05b6-4696-a15d-897046116a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:18.248962 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-715cefa7-05b6-4696-a15d-897046116a38 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:20:18.250245 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-715cefa7-05b6-4696-a15d-897046116a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:18.312865 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1396/2780] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:20:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:20:18.320883 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd32fd2-676c-41b6-82a6-615dfaae170f None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:18.321323 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd32fd2-676c-41b6-82a6-615dfaae170f None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:18.321702 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd32fd2-676c-41b6-82a6-615dfaae170f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:18.342942 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-4cd32fd2-676c-41b6-82a6-615dfaae170f None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:20:18.344387 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-4cd32fd2-676c-41b6-82a6-615dfaae170f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:18.354296 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1385/2781] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:20:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:20:18.360379 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715cefa7-05b6-4696-a15d-897046116a38 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:18.372475 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715cefa7-05b6-4696-a15d-897046116a38 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:18.377505 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49247dd-a3d9-4e08-b391-2439b76fd820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:18.378203 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49247dd-a3d9-4e08-b391-2439b76fd820 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:18.378483 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49247dd-a3d9-4e08-b391-2439b76fd820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:18.378755 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49247dd-a3d9-4e08-b391-2439b76fd820 admin admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:18.379480 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49247dd-a3d9-4e08-b391-2439b76fd820 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:20:18.379785 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49247dd-a3d9-4e08-b391-2439b76fd820 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:18.381414 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49247dd-a3d9-4e08-b391-2439b76fd820 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:18.395302 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1397/2782] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:20:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:20:18.399641 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd32fd2-676c-41b6-82a6-615dfaae170f None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:18.410207 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd32fd2-676c-41b6-82a6-615dfaae170f None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:18.415269 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df23c3-bca9-4bda-ac7b-bdb2aee76cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:18.415980 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df23c3-bca9-4bda-ac7b-bdb2aee76cc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:18.416302 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df23c3-bca9-4bda-ac7b-bdb2aee76cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:18.416580 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df23c3-bca9-4bda-ac7b-bdb2aee76cc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:18.417388 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6df23c3-bca9-4bda-ac7b-bdb2aee76cc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:18.419974 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6df23c3-bca9-4bda-ac7b-bdb2aee76cc5 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:18.452147 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1386/2783] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:20:18 2022] POST /identity/v3/projects => generated 401 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:20:18.453296 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49247dd-a3d9-4e08-b391-2439b76fd820 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:18.464150 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49247dd-a3d9-4e08-b391-2439b76fd820 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:18.490473 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df23c3-bca9-4bda-ac7b-bdb2aee76cc5 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:18.492959 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f6df23c3-bca9-4bda-ac7b-bdb2aee76cc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:18.502331 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:20:18.539513 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86129fd-6a95-415c-a1ef-4d494e3d3948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:18.540719 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86129fd-6a95-415c-a1ef-4d494e3d3948 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:18.541032 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86129fd-6a95-415c-a1ef-4d494e3d3948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:18.541315 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86129fd-6a95-415c-a1ef-4d494e3d3948 admin admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:18.542094 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86129fd-6a95-415c-a1ef-4d494e3d3948 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:18.544581 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86129fd-6a95-415c-a1ef-4d494e3d3948 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:18.565911 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df23c3-bca9-4bda-ac7b-bdb2aee76cc5 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:18.569365 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1398/2784] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:20:18 2022] POST /identity/v3/users => generated 301 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 12:20:18.570603 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86129fd-6a95-415c-a1ef-4d494e3d3948 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:18.570833 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa828ab-2d08-41a0-85fd-2d790f6850d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:18.571751 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa828ab-2d08-41a0-85fd-2d790f6850d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:18.572041 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa828ab-2d08-41a0-85fd-2d790f6850d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:18.572355 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa828ab-2d08-41a0-85fd-2d790f6850d5 admin admin] PATH_INFO: `/v3/users/ae8147f69a024a70a74b9488e62a1081` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:18.574291 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa828ab-2d08-41a0-85fd-2d790f6850d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae8147f69a024a70a74b9488e62a1081)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:18.576415 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa828ab-2d08-41a0-85fd-2d790f6850d5 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:18.581323 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86129fd-6a95-415c-a1ef-4d494e3d3948 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:18.586390 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666cf40-394f-4aca-ab45-52ca29137fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:18.587068 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666cf40-394f-4aca-ab45-52ca29137fbb admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:18.587353 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666cf40-394f-4aca-ab45-52ca29137fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:18.587636 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666cf40-394f-4aca-ab45-52ca29137fbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:18.588530 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9666cf40-394f-4aca-ab45-52ca29137fbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:18.590191 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9666cf40-394f-4aca-ab45-52ca29137fbb admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:18.609736 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1399/2785] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 12:20:18.613845 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666cf40-394f-4aca-ab45-52ca29137fbb admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:18.626395 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666cf40-394f-4aca-ab45-52ca29137fbb admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:18.631289 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772d26bb-a533-4e7b-b2e4-e8c8eefc2207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:18.631963 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d26bb-a533-4e7b-b2e4-e8c8eefc2207 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:18.632311 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d26bb-a533-4e7b-b2e4-e8c8eefc2207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:18.632555 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d26bb-a533-4e7b-b2e4-e8c8eefc2207 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:18.633338 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772d26bb-a533-4e7b-b2e4-e8c8eefc2207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:18.635014 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772d26bb-a533-4e7b-b2e4-e8c8eefc2207 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:18.639982 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9aa828ab-2d08-41a0-85fd-2d790f6850d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae8147f69a024a70a74b9488e62a1081'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:18.640713 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9aa828ab-2d08-41a0-85fd-2d790f6850d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae8147f69a024a70a74b9488e62a1081'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:18.641337 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9aa828ab-2d08-41a0-85fd-2d790f6850d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae8147f69a024a70a74b9488e62a1081'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:18.647945 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1400/2786] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:20:18.648548 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9aa828ab-2d08-41a0-85fd-2d790f6850d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae8147f69a024a70a74b9488e62a1081'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:18.652122 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772d26bb-a533-4e7b-b2e4-e8c8eefc2207 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:18.654353 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-772d26bb-a533-4e7b-b2e4-e8c8eefc2207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:18.660715 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9aa828ab-2d08-41a0-85fd-2d790f6850d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae8147f69a024a70a74b9488e62a1081'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:18.666918 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772d26bb-a533-4e7b-b2e4-e8c8eefc2207 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:18.672295 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0a901-5a7c-4e43-8f37-3876ea1c1138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:18.673185 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0a901-5a7c-4e43-8f37-3876ea1c1138 admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:18.673468 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0a901-5a7c-4e43-8f37-3876ea1c1138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:18.673741 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0a901-5a7c-4e43-8f37-3876ea1c1138 admin admin] PATH_INFO: `/v3/projects/1de12d00f4974e9096beca2ff4fbb922/users/4232bd4bbda341cf847c8dc627ea3992/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:18.674400 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1387/2787] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:20:18 2022] DELETE /identity/v3/users/ae8147f69a024a70a74b9488e62a1081 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:20:18.689644 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec0a901-5a7c-4e43-8f37-3876ea1c1138 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1de12d00f4974e9096beca2ff4fbb922, user_id=4232bd4bbda341cf847c8dc627ea3992, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:18.692385 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec0a901-5a7c-4e43-8f37-3876ea1c1138 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:18.708265 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1401/2788] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:20:18 2022] PUT /identity/v3/projects/1de12d00f4974e9096beca2ff4fbb922/users/4232bd4bbda341cf847c8dc627ea3992/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:20:18.718877 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caffc50-1870-4bd0-95bf-bea48035e00c None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:18.719162 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caffc50-1870-4bd0-95bf-bea48035e00c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:18.719437 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caffc50-1870-4bd0-95bf-bea48035e00c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:18.726739 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:DELETE=16,keystone:SELECT=81,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:20:18.752969 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-4caffc50-1870-4bd0-95bf-bea48035e00c None None] MFA Rules not processed for user `4232bd4bbda341cf847c8dc627ea3992`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:20:18.754211 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-4caffc50-1870-4bd0-95bf-bea48035e00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:18.819120 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1388/2789] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:20:18 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:20:18.823866 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0a901-5a7c-4e43-8f37-3876ea1c1138 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:18.859560 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caffc50-1870-4bd0-95bf-bea48035e00c None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:18.861061 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-4caffc50-1870-4bd0-95bf-bea48035e00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:18.896366 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0a901-5a7c-4e43-8f37-3876ea1c1138 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:18.901206 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f548279-9c68-4a71-a96f-642560743ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:18.902040 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f548279-9c68-4a71-a96f-642560743ae1 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:18.902331 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f548279-9c68-4a71-a96f-642560743ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:18.902646 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f548279-9c68-4a71-a96f-642560743ae1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:18.903354 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f548279-9c68-4a71-a96f-642560743ae1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:18.905350 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f548279-9c68-4a71-a96f-642560743ae1 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:18.932517 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1402/2790] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:20:18 2022] POST /identity/v3/projects => generated 399 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:20:18.936816 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caffc50-1870-4bd0-95bf-bea48035e00c None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:18.937011 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f548279-9c68-4a71-a96f-642560743ae1 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:18.995288 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4915f2-e012-4ad1-9be1-766bdf60686c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:18.996246 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4915f2-e012-4ad1-9be1-766bdf60686c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:18.996471 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:20:18.996592 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4915f2-e012-4ad1-9be1-766bdf60686c admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:18.996799 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4915f2-e012-4ad1-9be1-766bdf60686c admin admin] PATH_INFO: `/v3/projects/24300d12f9ae40a38234620ea102b77e` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:18.998205 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4915f2-e012-4ad1-9be1-766bdf60686c admin admin] RBAC: Authorizing `identity:delete_project(project_id=24300d12f9ae40a38234620ea102b77e)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:19.000194 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4915f2-e012-4ad1-9be1-766bdf60686c admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:19.000588 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f548279-9c68-4a71-a96f-642560743ae1 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:19.006724 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95c911-6d88-490c-a001-3d91b47032cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:19.007410 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95c911-6d88-490c-a001-3d91b47032cd admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:19.007693 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95c911-6d88-490c-a001-3d91b47032cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:19.007969 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95c911-6d88-490c-a001-3d91b47032cd admin admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:19.008722 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec95c911-6d88-490c-a001-3d91b47032cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:19.010719 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec95c911-6d88-490c-a001-3d91b47032cd admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:19.036109 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1403/2791] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:20:18 2022] POST /identity/v3/users => generated 306 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 12:20:19.037423 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95c911-6d88-490c-a001-3d91b47032cd admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:19.044760 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:20:19.048276 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95c911-6d88-490c-a001-3d91b47032cd admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:19.048414 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3c4915f2-e012-4ad1-9be1-766bdf60686c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24300d12f9ae40a38234620ea102b77e', 'request_id': 'req-3c4915f2-e012-4ad1-9be1-766bdf60686c'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:19.056104 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3c4915f2-e012-4ad1-9be1-766bdf60686c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24300d12f9ae40a38234620ea102b77e', 'request_id': 'req-3c4915f2-e012-4ad1-9be1-766bdf60686c'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:19.062681 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3c4915f2-e012-4ad1-9be1-766bdf60686c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24300d12f9ae40a38234620ea102b77e', 'request_id': 'req-3c4915f2-e012-4ad1-9be1-766bdf60686c'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:19.073993 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3c4915f2-e012-4ad1-9be1-766bdf60686c admin admin] The token cache is being invalidate because project 24300d12f9ae40a38234620ea102b77e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:20:19.074220 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3c4915f2-e012-4ad1-9be1-766bdf60686c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:19.074841 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3c4915f2-e012-4ad1-9be1-766bdf60686c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:19.076465 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1389/2792] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:20:18 2022] DELETE /identity/v3/projects/24300d12f9ae40a38234620ea102b77e => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:20:19.080217 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4915f2-e012-4ad1-9be1-766bdf60686c admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:19.081521 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-3c4915f2-e012-4ad1-9be1-766bdf60686c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:19.108065 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba3cd02-37c1-424e-9d47-e23bd35a219a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:19.108873 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3cd02-37c1-424e-9d47-e23bd35a219a admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:19.109164 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3cd02-37c1-424e-9d47-e23bd35a219a admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:19.109446 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3cd02-37c1-424e-9d47-e23bd35a219a admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:19.110179 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba3cd02-37c1-424e-9d47-e23bd35a219a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:19.111794 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba3cd02-37c1-424e-9d47-e23bd35a219a admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:19.122798 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1404/2793] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 12:20:19.126250 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba3cd02-37c1-424e-9d47-e23bd35a219a admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:19.127972 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-6ba3cd02-37c1-424e-9d47-e23bd35a219a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:19.140860 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba3cd02-37c1-424e-9d47-e23bd35a219a admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:19.146228 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f784bbb8-1c27-46f3-9a5c-1afcb65efbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:19.147105 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784bbb8-1c27-46f3-9a5c-1afcb65efbfe admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:19.147399 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784bbb8-1c27-46f3-9a5c-1afcb65efbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:19.147678 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784bbb8-1c27-46f3-9a5c-1afcb65efbfe admin admin] PATH_INFO: `/v3/projects/c2696c41eb9641b5949397eadb97b552/users/3ed61ac25ff14611b260bbde5ebe648c/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:19.149299 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4915f2-e012-4ad1-9be1-766bdf60686c admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:19.155092 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719a1ee-8691-4a5d-ad61-ab91ebde40ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:19.155954 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719a1ee-8691-4a5d-ad61-ab91ebde40ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:19.156268 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719a1ee-8691-4a5d-ad61-ab91ebde40ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:19.156545 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719a1ee-8691-4a5d-ad61-ab91ebde40ce admin admin] PATH_INFO: `/v3/users/2719ffb1c72a4127a5d05fe240fb2879` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:19.157737 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f719a1ee-8691-4a5d-ad61-ab91ebde40ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=2719ffb1c72a4127a5d05fe240fb2879)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:19.159666 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f719a1ee-8691-4a5d-ad61-ab91ebde40ce admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:19.163356 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f784bbb8-1c27-46f3-9a5c-1afcb65efbfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2696c41eb9641b5949397eadb97b552, user_id=3ed61ac25ff14611b260bbde5ebe648c, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:19.166016 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f784bbb8-1c27-46f3-9a5c-1afcb65efbfe admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:19.179831 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1405/2794] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:20:19 2022] PUT /identity/v3/projects/c2696c41eb9641b5949397eadb97b552/users/3ed61ac25ff14611b260bbde5ebe648c/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:20:19.184593 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f784bbb8-1c27-46f3-9a5c-1afcb65efbfe admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:19.208185 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f719a1ee-8691-4a5d-ad61-ab91ebde40ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2719ffb1c72a4127a5d05fe240fb2879'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:19.208858 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f719a1ee-8691-4a5d-ad61-ab91ebde40ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2719ffb1c72a4127a5d05fe240fb2879'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:19.209505 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f719a1ee-8691-4a5d-ad61-ab91ebde40ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2719ffb1c72a4127a5d05fe240fb2879'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:19.217205 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f719a1ee-8691-4a5d-ad61-ab91ebde40ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2719ffb1c72a4127a5d05fe240fb2879'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:19.229876 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f719a1ee-8691-4a5d-ad61-ab91ebde40ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2719ffb1c72a4127a5d05fe240fb2879'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:19.244144 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1390/2795] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:20:19 2022] DELETE /identity/v3/users/2719ffb1c72a4127a5d05fe240fb2879 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:20:19.251244 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f784bbb8-1c27-46f3-9a5c-1afcb65efbfe admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:19.309743 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8746a83a-7031-4f36-8c87-5ff452ee6d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:19.310264 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746a83a-7031-4f36-8c87-5ff452ee6d46 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:19.310553 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746a83a-7031-4f36-8c87-5ff452ee6d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:19.310832 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746a83a-7031-4f36-8c87-5ff452ee6d46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:19.311568 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8746a83a-7031-4f36-8c87-5ff452ee6d46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:19.313225 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8746a83a-7031-4f36-8c87-5ff452ee6d46 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:19.323356 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1406/2796] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 12:20:19.327909 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719a1ee-8691-4a5d-ad61-ab91ebde40ce admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:19.329667 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f719a1ee-8691-4a5d-ad61-ab91ebde40ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:19.343218 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719a1ee-8691-4a5d-ad61-ab91ebde40ce admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:19.348448 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1591f3c-eb7b-4337-be20-9cb7dacf9e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:19.349414 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1591f3c-eb7b-4337-be20-9cb7dacf9e1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:19.349768 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1591f3c-eb7b-4337-be20-9cb7dacf9e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:19.350134 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1591f3c-eb7b-4337-be20-9cb7dacf9e1f admin admin] PATH_INFO: `/v3/projects/c2696c41eb9641b5949397eadb97b552/users/3ed61ac25ff14611b260bbde5ebe648c/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:19.352162 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1591f3c-eb7b-4337-be20-9cb7dacf9e1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2696c41eb9641b5949397eadb97b552, user_id=3ed61ac25ff14611b260bbde5ebe648c, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:19.354991 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1591f3c-eb7b-4337-be20-9cb7dacf9e1f admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:19.365977 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1391/2797] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:20:19 2022] PUT /identity/v3/projects/c2696c41eb9641b5949397eadb97b552/users/3ed61ac25ff14611b260bbde5ebe648c/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:20:19.377680 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34098f0-e6a1-497c-9b34-badbe0d03517 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:19.377976 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34098f0-e6a1-497c-9b34-badbe0d03517 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:19.378261 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34098f0-e6a1-497c-9b34-badbe0d03517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:19.384184 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:20:19.409344 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-c34098f0-e6a1-497c-9b34-badbe0d03517 None None] MFA Rules not processed for user `3ed61ac25ff14611b260bbde5ebe648c`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:20:19.410767 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-c34098f0-e6a1-497c-9b34-badbe0d03517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:19.428722 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1591f3c-eb7b-4337-be20-9cb7dacf9e1f admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:19.431111 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f1591f3c-eb7b-4337-be20-9cb7dacf9e1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:19.482544 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:20:19.491661 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1407/2798] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:20:19 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:20:19.502777 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34098f0-e6a1-497c-9b34-badbe0d03517 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:19.504115 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-c34098f0-e6a1-497c-9b34-badbe0d03517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:19.512590 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1591f3c-eb7b-4337-be20-9cb7dacf9e1f admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:19.517442 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6cb988-f803-4f32-b0c6-bf8e2e19e9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:19.518443 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6cb988-f803-4f32-b0c6-bf8e2e19e9aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:19.518791 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6cb988-f803-4f32-b0c6-bf8e2e19e9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:19.519075 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6cb988-f803-4f32-b0c6-bf8e2e19e9aa admin admin] PATH_INFO: `/v3/projects/766fb5f5e9cf4cb998ba8fabc6bc26f3` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:19.520373 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6cb988-f803-4f32-b0c6-bf8e2e19e9aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=766fb5f5e9cf4cb998ba8fabc6bc26f3)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:19.522324 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6cb988-f803-4f32-b0c6-bf8e2e19e9aa admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:19.562293 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34098f0-e6a1-497c-9b34-badbe0d03517 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:19.569657 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-4f6cb988-f803-4f32-b0c6-bf8e2e19e9aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '766fb5f5e9cf4cb998ba8fabc6bc26f3', 'request_id': 'req-4f6cb988-f803-4f32-b0c6-bf8e2e19e9aa'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:19.579206 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-4f6cb988-f803-4f32-b0c6-bf8e2e19e9aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '766fb5f5e9cf4cb998ba8fabc6bc26f3', 'request_id': 'req-4f6cb988-f803-4f32-b0c6-bf8e2e19e9aa'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:19.585840 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-4f6cb988-f803-4f32-b0c6-bf8e2e19e9aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '766fb5f5e9cf4cb998ba8fabc6bc26f3', 'request_id': 'req-4f6cb988-f803-4f32-b0c6-bf8e2e19e9aa'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:19.600193 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-4f6cb988-f803-4f32-b0c6-bf8e2e19e9aa admin admin] The token cache is being invalidate because project 766fb5f5e9cf4cb998ba8fabc6bc26f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:20:19.600491 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-4f6cb988-f803-4f32-b0c6-bf8e2e19e9aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:19.601159 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-4f6cb988-f803-4f32-b0c6-bf8e2e19e9aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:19.602920 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1392/2799] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:20:19 2022] DELETE /identity/v3/projects/766fb5f5e9cf4cb998ba8fabc6bc26f3 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:20:19.607749 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee592fc-9dee-49a7-88d7-1c73ad80769e None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:19.608042 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee592fc-9dee-49a7-88d7-1c73ad80769e None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:19.608372 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee592fc-9dee-49a7-88d7-1c73ad80769e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:19.617741 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd271262-58a6-4ced-8265-6c3ce8649e27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:19.618397 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd271262-58a6-4ced-8265-6c3ce8649e27 service cinder] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:19.618676 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd271262-58a6-4ced-8265-6c3ce8649e27 service cinder] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:19.618950 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd271262-58a6-4ced-8265-6c3ce8649e27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:19.620786 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-dd271262-58a6-4ced-8265-6c3ce8649e27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:19.626803 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-9ee592fc-9dee-49a7-88d7-1c73ad80769e None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:20:19.627995 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-9ee592fc-9dee-49a7-88d7-1c73ad80769e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:19.681589 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:20:19.686376 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd271262-58a6-4ced-8265-6c3ce8649e27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:19.687860 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd271262-58a6-4ced-8265-6c3ce8649e27 service cinder] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:19.689486 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1393/2800] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:20:19.697235 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8084b-c46c-4b81-8faa-b97b73b8c893 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:19.697532 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8084b-c46c-4b81-8faa-b97b73b8c893 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:19.697890 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1408/2801] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:20:19 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 12:20:19.698044 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8084b-c46c-4b81-8faa-b97b73b8c893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:19.716521 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-69f8084b-c46c-4b81-8faa-b97b73b8c893 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:20:19.717729 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-69f8084b-c46c-4b81-8faa-b97b73b8c893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:19.726091 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1394/2802] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:20:19.734483 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd271262-58a6-4ced-8265-6c3ce8649e27 service cinder] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:19.745944 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd271262-58a6-4ced-8265-6c3ce8649e27 service cinder] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:19.751627 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2b278-ac22-44f8-a37f-64f87f43b10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:19.752335 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2b278-ac22-44f8-a37f-64f87f43b10f admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:19.752622 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2b278-ac22-44f8-a37f-64f87f43b10f admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:19.752903 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2b278-ac22-44f8-a37f-64f87f43b10f admin admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:19.753777 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f2b278-ac22-44f8-a37f-64f87f43b10f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:20:19.754052 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f2b278-ac22-44f8-a37f-64f87f43b10f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:19.755679 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f2b278-ac22-44f8-a37f-64f87f43b10f admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:19.772080 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1409/2803] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:20:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:20:19.772265 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f8084b-c46c-4b81-8faa-b97b73b8c893 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:19.773126 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2b278-ac22-44f8-a37f-64f87f43b10f admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:19.773590 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-69f8084b-c46c-4b81-8faa-b97b73b8c893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:19.783217 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2b278-ac22-44f8-a37f-64f87f43b10f admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:19.785793 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f8084b-c46c-4b81-8faa-b97b73b8c893 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:19.787926 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34358574-e75b-4cc3-be91-748882647374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:19.788606 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34358574-e75b-4cc3-be91-748882647374 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:19.788890 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34358574-e75b-4cc3-be91-748882647374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:19.789166 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34358574-e75b-4cc3-be91-748882647374 admin admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:19.789477 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b813a4-8d49-4135-8cb4-89ab9aca9525 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:19.789848 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34358574-e75b-4cc3-be91-748882647374 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:19.790139 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b813a4-8d49-4135-8cb4-89ab9aca9525 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:19.790427 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b813a4-8d49-4135-8cb4-89ab9aca9525 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:19.790707 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b813a4-8d49-4135-8cb4-89ab9aca9525 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:19.791744 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34358574-e75b-4cc3-be91-748882647374 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:19.793278 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-67b813a4-8d49-4135-8cb4-89ab9aca9525 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:19.820199 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1410/2804] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:20:19 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 12:20:19.824494 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34358574-e75b-4cc3-be91-748882647374 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:19.856846 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b813a4-8d49-4135-8cb4-89ab9aca9525 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:19.858230 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b813a4-8d49-4135-8cb4-89ab9aca9525 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:19.862930 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:20:19.868009 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1395/2805] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:20:19 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:20:19.891381 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34358574-e75b-4cc3-be91-748882647374 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:19.896110 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d2d588-be74-41cb-98b2-2be9bcfd191d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:19.896818 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2d588-be74-41cb-98b2-2be9bcfd191d admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:19.897095 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2d588-be74-41cb-98b2-2be9bcfd191d admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:19.897369 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2d588-be74-41cb-98b2-2be9bcfd191d admin admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:19.898064 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d2d588-be74-41cb-98b2-2be9bcfd191d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:19.899961 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d2d588-be74-41cb-98b2-2be9bcfd191d admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:19.921560 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1411/2806] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:20:19 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 12:20:19.926248 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b813a4-8d49-4135-8cb4-89ab9aca9525 service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:19.937392 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b813a4-8d49-4135-8cb4-89ab9aca9525 service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:19.941969 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ef052-cfad-40c7-89f7-a2582302f79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:19.942626 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ef052-cfad-40c7-89f7-a2582302f79b admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:19.942909 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ef052-cfad-40c7-89f7-a2582302f79b admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:19.943183 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ef052-cfad-40c7-89f7-a2582302f79b admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:19.943900 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ef052-cfad-40c7-89f7-a2582302f79b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:19.945525 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ef052-cfad-40c7-89f7-a2582302f79b admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:19.956215 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1396/2807] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:20:19.960360 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d2d588-be74-41cb-98b2-2be9bcfd191d admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:19.971161 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d2d588-be74-41cb-98b2-2be9bcfd191d admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:19.975909 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e90ea-fd69-425a-bf09-d38930a64661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:19.976768 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e90ea-fd69-425a-bf09-d38930a64661 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:19.977256 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e90ea-fd69-425a-bf09-d38930a64661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:19.977562 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e90ea-fd69-425a-bf09-d38930a64661 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:19.978643 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940e90ea-fd69-425a-bf09-d38930a64661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:19.980626 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940e90ea-fd69-425a-bf09-d38930a64661 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:19.991308 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1412/2808] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:20:19.996190 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ef052-cfad-40c7-89f7-a2582302f79b admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:20.006994 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ef052-cfad-40c7-89f7-a2582302f79b admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:20.012370 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b9e5c3-9c27-44b4-a2d8-d89875efd7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:20.013276 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9e5c3-9c27-44b4-a2d8-d89875efd7cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:20.013550 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9e5c3-9c27-44b4-a2d8-d89875efd7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:20.013826 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9e5c3-9c27-44b4-a2d8-d89875efd7cc admin admin] PATH_INFO: `/v3/projects/bf0c6978d6a54455bb211c8cfda6cb8e/users/9c2f7f92864e438882cfcc6ec3a7667a/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:20.035077 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b9e5c3-9c27-44b4-a2d8-d89875efd7cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf0c6978d6a54455bb211c8cfda6cb8e, user_id=9c2f7f92864e438882cfcc6ec3a7667a, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:20.037755 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b9e5c3-9c27-44b4-a2d8-d89875efd7cc admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:20.051837 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1397/2809] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:20:19 2022] PUT /identity/v3/projects/bf0c6978d6a54455bb211c8cfda6cb8e/users/9c2f7f92864e438882cfcc6ec3a7667a/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:20:20.063590 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7226157-bf97-46da-b95e-d4e84a6943a8 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:20.064116 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7226157-bf97-46da-b95e-d4e84a6943a8 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:20.064430 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7226157-bf97-46da-b95e-d4e84a6943a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:20.092934 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-f7226157-bf97-46da-b95e-d4e84a6943a8 None None] MFA Rules not processed for user `9c2f7f92864e438882cfcc6ec3a7667a`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:20:20.094348 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-f7226157-bf97-46da-b95e-d4e84a6943a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:20.176563 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1413/2810] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:20:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:20:20.191256 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b9e5c3-9c27-44b4-a2d8-d89875efd7cc admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:20.251090 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b9e5c3-9c27-44b4-a2d8-d89875efd7cc admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:20.254730 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5cbe84-ba09-46ab-8155-e4061c351e62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:20.255375 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5cbe84-ba09-46ab-8155-e4061c351e62 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:20.255659 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5cbe84-ba09-46ab-8155-e4061c351e62 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:20.255934 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5cbe84-ba09-46ab-8155-e4061c351e62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:20.265269 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5cbe84-ba09-46ab-8155-e4061c351e62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:20.266693 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5cbe84-ba09-46ab-8155-e4061c351e62 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:20.275556 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1398/2811] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:20:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:20:20.295401 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7226157-bf97-46da-b95e-d4e84a6943a8 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:20.328077 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:20:20.362842 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7226157-bf97-46da-b95e-d4e84a6943a8 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:20.367523 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c2a6d8-bbfe-4e17-a1ae-d1363d8479fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:20.368435 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2a6d8-bbfe-4e17-a1ae-d1363d8479fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:20.368715 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2a6d8-bbfe-4e17-a1ae-d1363d8479fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:20.368989 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2a6d8-bbfe-4e17-a1ae-d1363d8479fd admin admin] PATH_INFO: `/v3/users/9c2f7f92864e438882cfcc6ec3a7667a` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:20.370171 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c2a6d8-bbfe-4e17-a1ae-d1363d8479fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c2f7f92864e438882cfcc6ec3a7667a)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:20.372402 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c2a6d8-bbfe-4e17-a1ae-d1363d8479fd admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:20.418145 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-b6c2a6d8-bbfe-4e17-a1ae-d1363d8479fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c2f7f92864e438882cfcc6ec3a7667a'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:20.425135 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-b6c2a6d8-bbfe-4e17-a1ae-d1363d8479fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c2f7f92864e438882cfcc6ec3a7667a'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:20.425813 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-b6c2a6d8-bbfe-4e17-a1ae-d1363d8479fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c2f7f92864e438882cfcc6ec3a7667a'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:20.426444 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-b6c2a6d8-bbfe-4e17-a1ae-d1363d8479fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c2f7f92864e438882cfcc6ec3a7667a'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:20.438504 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-b6c2a6d8-bbfe-4e17-a1ae-d1363d8479fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c2f7f92864e438882cfcc6ec3a7667a'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:20.451848 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1414/2812] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:20:20 2022] DELETE /identity/v3/users/9c2f7f92864e438882cfcc6ec3a7667a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:20:20.456410 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab76603-b994-403a-8c1f-1d91e5471e7a None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:20.456702 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab76603-b994-403a-8c1f-1d91e5471e7a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:20.456982 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab76603-b994-403a-8c1f-1d91e5471e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:20.474619 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-1ab76603-b994-403a-8c1f-1d91e5471e7a None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:20:20.475845 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-1ab76603-b994-403a-8c1f-1d91e5471e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:20.534532 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1399/2813] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:20:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:20:20.544578 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c2a6d8-bbfe-4e17-a1ae-d1363d8479fd admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:20.546041 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-b6c2a6d8-bbfe-4e17-a1ae-d1363d8479fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:20.603509 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c2a6d8-bbfe-4e17-a1ae-d1363d8479fd admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:20.607567 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f8f5c-674a-474a-b89b-64ba836fc19c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:20.608251 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f8f5c-674a-474a-b89b-64ba836fc19c service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:20.608542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f8f5c-674a-474a-b89b-64ba836fc19c service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:20.608818 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f8f5c-674a-474a-b89b-64ba836fc19c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:20.617763 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f8f5c-674a-474a-b89b-64ba836fc19c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:20.619149 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f8f5c-674a-474a-b89b-64ba836fc19c service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:20.639754 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1415/2814] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:20:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:20:20.920835 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab76603-b994-403a-8c1f-1d91e5471e7a None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:20.922313 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-1ab76603-b994-403a-8c1f-1d91e5471e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:20.935282 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab76603-b994-403a-8c1f-1d91e5471e7a None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:20.939975 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996755df-1a3e-4e76-b959-41fce45783c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:20.940894 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996755df-1a3e-4e76-b959-41fce45783c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:20.941171 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996755df-1a3e-4e76-b959-41fce45783c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:20.941447 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996755df-1a3e-4e76-b959-41fce45783c5 admin admin] PATH_INFO: `/v3/projects/bf0c6978d6a54455bb211c8cfda6cb8e` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:20.942771 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996755df-1a3e-4e76-b959-41fce45783c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf0c6978d6a54455bb211c8cfda6cb8e)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:20.944799 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996755df-1a3e-4e76-b959-41fce45783c5 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:20.995160 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-996755df-1a3e-4e76-b959-41fce45783c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf0c6978d6a54455bb211c8cfda6cb8e', 'request_id': 'req-996755df-1a3e-4e76-b959-41fce45783c5'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:21.003553 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-996755df-1a3e-4e76-b959-41fce45783c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf0c6978d6a54455bb211c8cfda6cb8e', 'request_id': 'req-996755df-1a3e-4e76-b959-41fce45783c5'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:21.008368 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:20:21.009636 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-996755df-1a3e-4e76-b959-41fce45783c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf0c6978d6a54455bb211c8cfda6cb8e', 'request_id': 'req-996755df-1a3e-4e76-b959-41fce45783c5'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:21.023001 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-996755df-1a3e-4e76-b959-41fce45783c5 admin admin] The token cache is being invalidate because project bf0c6978d6a54455bb211c8cfda6cb8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:20:21.023290 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-996755df-1a3e-4e76-b959-41fce45783c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:21.023916 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-996755df-1a3e-4e76-b959-41fce45783c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:21.025516 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1400/2815] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:20:20 2022] DELETE /identity/v3/projects/bf0c6978d6a54455bb211c8cfda6cb8e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:20:21.030626 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d056dd-1885-4d06-be7b-755c6eddc179 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:21.030958 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d056dd-1885-4d06-be7b-755c6eddc179 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:21.031297 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d056dd-1885-4d06-be7b-755c6eddc179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:21.051128 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-b5d056dd-1885-4d06-be7b-755c6eddc179 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:20:21.052516 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-b5d056dd-1885-4d06-be7b-755c6eddc179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:21.098184 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:20:21.115251 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1416/2816] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:20:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:20:21.123921 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ecfee9-3ad3-47a2-bc99-92c4bd9ee86c None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:21.124426 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ecfee9-3ad3-47a2-bc99-92c4bd9ee86c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:21.124548 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ecfee9-3ad3-47a2-bc99-92c4bd9ee86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:21.142457 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-b9ecfee9-3ad3-47a2-bc99-92c4bd9ee86c None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:20:21.143638 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b9ecfee9-3ad3-47a2-bc99-92c4bd9ee86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:21.151352 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1401/2817] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:20:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:20:21.155873 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d056dd-1885-4d06-be7b-755c6eddc179 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:21.166705 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d056dd-1885-4d06-be7b-755c6eddc179 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:21.172106 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18717184-9e85-480f-a00f-33ea491d2c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:21.172799 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18717184-9e85-480f-a00f-33ea491d2c8e admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:21.173084 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18717184-9e85-480f-a00f-33ea491d2c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:21.173352 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18717184-9e85-480f-a00f-33ea491d2c8e admin admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:21.174183 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18717184-9e85-480f-a00f-33ea491d2c8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:20:21.174494 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18717184-9e85-480f-a00f-33ea491d2c8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:21.176103 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18717184-9e85-480f-a00f-33ea491d2c8e admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:21.188763 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1417/2818] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:20:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:20:21.193147 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ecfee9-3ad3-47a2-bc99-92c4bd9ee86c None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:21.202974 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ecfee9-3ad3-47a2-bc99-92c4bd9ee86c None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:21.207761 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc4164e-f0a5-4293-aa23-48622d8bbd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:21.208713 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4164e-f0a5-4293-aa23-48622d8bbd64 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:21.208713 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4164e-f0a5-4293-aa23-48622d8bbd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:21.208997 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4164e-f0a5-4293-aa23-48622d8bbd64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:21.209684 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc4164e-f0a5-4293-aa23-48622d8bbd64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:21.211570 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc4164e-f0a5-4293-aa23-48622d8bbd64 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:21.243323 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1402/2819] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:20:21 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:20:21.244462 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18717184-9e85-480f-a00f-33ea491d2c8e admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:21.255208 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18717184-9e85-480f-a00f-33ea491d2c8e admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:21.316047 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b081a9fb-7d96-4e6a-a62d-4d8bcdb87e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:21.316840 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081a9fb-7d96-4e6a-a62d-4d8bcdb87e92 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:21.317128 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081a9fb-7d96-4e6a-a62d-4d8bcdb87e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:21.317405 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081a9fb-7d96-4e6a-a62d-4d8bcdb87e92 admin admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:21.318093 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b081a9fb-7d96-4e6a-a62d-4d8bcdb87e92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:21.320067 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b081a9fb-7d96-4e6a-a62d-4d8bcdb87e92 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:21.340584 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1418/2820] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:20:21 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 12:20:21.344810 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc4164e-f0a5-4293-aa23-48622d8bbd64 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:21.356750 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc4164e-f0a5-4293-aa23-48622d8bbd64 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:21.362899 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5b05a-550d-449d-b02f-32160c5832a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:21.363587 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5b05a-550d-449d-b02f-32160c5832a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:21.363852 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5b05a-550d-449d-b02f-32160c5832a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:21.364122 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5b05a-550d-449d-b02f-32160c5832a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:21.364885 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d5b05a-550d-449d-b02f-32160c5832a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:21.366642 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d5b05a-550d-449d-b02f-32160c5832a6 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:21.377442 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1403/2821] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:20:21.381636 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b081a9fb-7d96-4e6a-a62d-4d8bcdb87e92 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:21.391594 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b081a9fb-7d96-4e6a-a62d-4d8bcdb87e92 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:21.396588 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e317fe64-54df-4fa1-a4d8-541c2b0a1983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:21.397274 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317fe64-54df-4fa1-a4d8-541c2b0a1983 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:21.397562 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317fe64-54df-4fa1-a4d8-541c2b0a1983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:21.397839 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317fe64-54df-4fa1-a4d8-541c2b0a1983 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:21.398554 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e317fe64-54df-4fa1-a4d8-541c2b0a1983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:21.400199 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e317fe64-54df-4fa1-a4d8-541c2b0a1983 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:21.411919 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1419/2822] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:20:21.416084 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5b05a-550d-449d-b02f-32160c5832a6 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:21.427234 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5b05a-550d-449d-b02f-32160c5832a6 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:21.432270 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a1d9c-43c5-4912-8e15-d2c7518c25a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:21.433776 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a1d9c-43c5-4912-8e15-d2c7518c25a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:21.434089 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a1d9c-43c5-4912-8e15-d2c7518c25a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:21.434369 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a1d9c-43c5-4912-8e15-d2c7518c25a6 admin admin] PATH_INFO: `/v3/projects/099767020d9a461fb81c022d9bf2d2f5/users/03d0ed2a19ae4843a4c8dcdf0c70d909/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:21.451722 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4a1d9c-43c5-4912-8e15-d2c7518c25a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=099767020d9a461fb81c022d9bf2d2f5, user_id=03d0ed2a19ae4843a4c8dcdf0c70d909, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:21.454443 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4a1d9c-43c5-4912-8e15-d2c7518c25a6 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:21.469953 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1404/2823] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:20:21 2022] PUT /identity/v3/projects/099767020d9a461fb81c022d9bf2d2f5/users/03d0ed2a19ae4843a4c8dcdf0c70d909/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:20:21.479789 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66b70d-332a-43a9-b28e-2c73b1f827d1 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:21.480856 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66b70d-332a-43a9-b28e-2c73b1f827d1 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:21.481916 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66b70d-332a-43a9-b28e-2c73b1f827d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:21.511897 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-ac66b70d-332a-43a9-b28e-2c73b1f827d1 None None] MFA Rules not processed for user `03d0ed2a19ae4843a4c8dcdf0c70d909`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:20:21.513149 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-ac66b70d-332a-43a9-b28e-2c73b1f827d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:21.579949 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1420/2824] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:20:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:20:21.595183 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a1d9c-43c5-4912-8e15-d2c7518c25a6 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:21.596917 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-da4a1d9c-43c5-4912-8e15-d2c7518c25a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:21.654321 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a1d9c-43c5-4912-8e15-d2c7518c25a6 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:21.657920 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1bd794-feb0-4301-b6c8-b67f60c4c542 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:21.658564 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1bd794-feb0-4301-b6c8-b67f60c4c542 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:21.658844 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1bd794-feb0-4301-b6c8-b67f60c4c542 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:21.659116 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1bd794-feb0-4301-b6c8-b67f60c4c542 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:21.667715 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1bd794-feb0-4301-b6c8-b67f60c4c542 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:21.669298 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1bd794-feb0-4301-b6c8-b67f60c4c542 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:21.677837 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1405/2825] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:20:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:20:23.960604 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac66b70d-332a-43a9-b28e-2c73b1f827d1 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:23.962148 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-ac66b70d-332a-43a9-b28e-2c73b1f827d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:24.009435 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:20:24.031277 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac66b70d-332a-43a9-b28e-2c73b1f827d1 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:24.035839 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f4575-a8aa-460b-9a88-e3ab2ac4ca1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:24.036848 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f4575-a8aa-460b-9a88-e3ab2ac4ca1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:24.037167 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f4575-a8aa-460b-9a88-e3ab2ac4ca1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:24.037476 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f4575-a8aa-460b-9a88-e3ab2ac4ca1a admin admin] PATH_INFO: `/v3/users/4232bd4bbda341cf847c8dc627ea3992` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:24.038701 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592f4575-a8aa-460b-9a88-e3ab2ac4ca1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4232bd4bbda341cf847c8dc627ea3992)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:24.040670 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592f4575-a8aa-460b-9a88-e3ab2ac4ca1a admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:24.087558 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-592f4575-a8aa-460b-9a88-e3ab2ac4ca1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4232bd4bbda341cf847c8dc627ea3992'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:24.095152 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-592f4575-a8aa-460b-9a88-e3ab2ac4ca1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4232bd4bbda341cf847c8dc627ea3992'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:24.095815 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-592f4575-a8aa-460b-9a88-e3ab2ac4ca1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4232bd4bbda341cf847c8dc627ea3992'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:24.096449 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-592f4575-a8aa-460b-9a88-e3ab2ac4ca1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4232bd4bbda341cf847c8dc627ea3992'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:24.108782 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-592f4575-a8aa-460b-9a88-e3ab2ac4ca1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4232bd4bbda341cf847c8dc627ea3992'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:24.121635 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1421/2826] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:20:23 2022] DELETE /identity/v3/users/4232bd4bbda341cf847c8dc627ea3992 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:20:24.126301 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2b692-15f8-4d11-a7f1-14f917421c57 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:24.126809 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2b692-15f8-4d11-a7f1-14f917421c57 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:24.126912 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2b692-15f8-4d11-a7f1-14f917421c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:24.145271 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-a9f2b692-15f8-4d11-a7f1-14f917421c57 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:20:24.146482 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a9f2b692-15f8-4d11-a7f1-14f917421c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:24.211319 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1406/2827] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:20:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:20:24.224469 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f4575-a8aa-460b-9a88-e3ab2ac4ca1a admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:24.225898 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-592f4575-a8aa-460b-9a88-e3ab2ac4ca1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:24.289428 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f4575-a8aa-460b-9a88-e3ab2ac4ca1a admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:24.293571 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7271f-bd72-4700-b49d-06a0cde510fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:24.294316 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7271f-bd72-4700-b49d-06a0cde510fa service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:24.294544 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7271f-bd72-4700-b49d-06a0cde510fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:24.294817 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7271f-bd72-4700-b49d-06a0cde510fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:24.304553 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c7271f-bd72-4700-b49d-06a0cde510fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:24.305994 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c7271f-bd72-4700-b49d-06a0cde510fa service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:24.316492 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1422/2828] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:20:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:20:24.846757 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f2b692-15f8-4d11-a7f1-14f917421c57 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:24.848233 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a9f2b692-15f8-4d11-a7f1-14f917421c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:24.862905 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f2b692-15f8-4d11-a7f1-14f917421c57 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:24.869355 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59419c37-296a-4df5-a584-324eec14822f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:24.871726 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59419c37-296a-4df5-a584-324eec14822f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:24.872063 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59419c37-296a-4df5-a584-324eec14822f admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:24.872372 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59419c37-296a-4df5-a584-324eec14822f admin admin] PATH_INFO: `/v3/projects/1de12d00f4974e9096beca2ff4fbb922` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:24.873650 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59419c37-296a-4df5-a584-324eec14822f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1de12d00f4974e9096beca2ff4fbb922)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:24.875559 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59419c37-296a-4df5-a584-324eec14822f admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:24.910956 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:20:24.928229 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-59419c37-296a-4df5-a584-324eec14822f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1de12d00f4974e9096beca2ff4fbb922', 'request_id': 'req-59419c37-296a-4df5-a584-324eec14822f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:24.936312 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-59419c37-296a-4df5-a584-324eec14822f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1de12d00f4974e9096beca2ff4fbb922', 'request_id': 'req-59419c37-296a-4df5-a584-324eec14822f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:24.942340 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-59419c37-296a-4df5-a584-324eec14822f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1de12d00f4974e9096beca2ff4fbb922', 'request_id': 'req-59419c37-296a-4df5-a584-324eec14822f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:24.955164 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-59419c37-296a-4df5-a584-324eec14822f admin admin] The token cache is being invalidate because project 1de12d00f4974e9096beca2ff4fbb922 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:20:24.955453 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-59419c37-296a-4df5-a584-324eec14822f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:24.956112 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-59419c37-296a-4df5-a584-324eec14822f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:24.957689 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1407/2829] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:20:24 2022] DELETE /identity/v3/projects/1de12d00f4974e9096beca2ff4fbb922 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:20:24.961635 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7271f-bd72-4700-b49d-06a0cde510fa service neutron] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:24.971909 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7271f-bd72-4700-b49d-06a0cde510fa service neutron] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:25.028304 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d402b0-c0ef-423a-8422-e0620be156f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:25.029103 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d402b0-c0ef-423a-8422-e0620be156f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:25.029388 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d402b0-c0ef-423a-8422-e0620be156f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:25.029664 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d402b0-c0ef-423a-8422-e0620be156f4 admin admin] PATH_INFO: `/v3/users/3ed61ac25ff14611b260bbde5ebe648c` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:25.030872 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d402b0-c0ef-423a-8422-e0620be156f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ed61ac25ff14611b260bbde5ebe648c)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:25.032838 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d402b0-c0ef-423a-8422-e0620be156f4 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:25.038137 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:20:25.079753 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-11d402b0-c0ef-423a-8422-e0620be156f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ed61ac25ff14611b260bbde5ebe648c'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:25.088407 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-11d402b0-c0ef-423a-8422-e0620be156f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ed61ac25ff14611b260bbde5ebe648c'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:25.089095 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-11d402b0-c0ef-423a-8422-e0620be156f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ed61ac25ff14611b260bbde5ebe648c'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:25.089708 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-11d402b0-c0ef-423a-8422-e0620be156f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ed61ac25ff14611b260bbde5ebe648c'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:25.101545 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-11d402b0-c0ef-423a-8422-e0620be156f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ed61ac25ff14611b260bbde5ebe648c'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:25.115857 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1423/2830] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:20:24 2022] DELETE /identity/v3/users/3ed61ac25ff14611b260bbde5ebe648c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:20:25.394482 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59419c37-296a-4df5-a584-324eec14822f admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:25.396112 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-59419c37-296a-4df5-a584-324eec14822f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:25.412213 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59419c37-296a-4df5-a584-324eec14822f admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:25.474261 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a219c66-dd5e-44f9-bc7e-be96871b2fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:25.475132 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a219c66-dd5e-44f9-bc7e-be96871b2fa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:25.475416 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a219c66-dd5e-44f9-bc7e-be96871b2fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:25.475694 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a219c66-dd5e-44f9-bc7e-be96871b2fa7 admin admin] PATH_INFO: `/v3/projects/c2696c41eb9641b5949397eadb97b552` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:25.476920 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a219c66-dd5e-44f9-bc7e-be96871b2fa7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2696c41eb9641b5949397eadb97b552)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:25.478834 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a219c66-dd5e-44f9-bc7e-be96871b2fa7 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:25.531341 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-8a219c66-dd5e-44f9-bc7e-be96871b2fa7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2696c41eb9641b5949397eadb97b552', 'request_id': 'req-8a219c66-dd5e-44f9-bc7e-be96871b2fa7'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:25.539450 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-8a219c66-dd5e-44f9-bc7e-be96871b2fa7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2696c41eb9641b5949397eadb97b552', 'request_id': 'req-8a219c66-dd5e-44f9-bc7e-be96871b2fa7'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:25.548288 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-8a219c66-dd5e-44f9-bc7e-be96871b2fa7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2696c41eb9641b5949397eadb97b552', 'request_id': 'req-8a219c66-dd5e-44f9-bc7e-be96871b2fa7'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:25.560824 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-8a219c66-dd5e-44f9-bc7e-be96871b2fa7 admin admin] The token cache is being invalidate because project c2696c41eb9641b5949397eadb97b552 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:20:25.561116 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-8a219c66-dd5e-44f9-bc7e-be96871b2fa7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:25.561788 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-8a219c66-dd5e-44f9-bc7e-be96871b2fa7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:25.563337 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1408/2831] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:20:25 2022] DELETE /identity/v3/projects/c2696c41eb9641b5949397eadb97b552 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:20:25.569454 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a369b7c-d87f-40c9-bd4f-c8d5ed46eb10 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:25.569755 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a369b7c-d87f-40c9-bd4f-c8d5ed46eb10 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:25.570033 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a369b7c-d87f-40c9-bd4f-c8d5ed46eb10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:25.589912 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-0a369b7c-d87f-40c9-bd4f-c8d5ed46eb10 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:20:25.591573 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-0a369b7c-d87f-40c9-bd4f-c8d5ed46eb10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:25.654940 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1424/2832] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:20:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:20:25.666510 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfe7d4-7458-47a8-85c5-735867600088 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:25.666797 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfe7d4-7458-47a8-85c5-735867600088 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:25.667609 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfe7d4-7458-47a8-85c5-735867600088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:25.687084 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-76cfe7d4-7458-47a8-85c5-735867600088 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:20:25.688316 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-76cfe7d4-7458-47a8-85c5-735867600088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:25.696249 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1409/2833] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:20:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:20:25.701053 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a369b7c-d87f-40c9-bd4f-c8d5ed46eb10 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:25.711502 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a369b7c-d87f-40c9-bd4f-c8d5ed46eb10 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:25.716398 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173452a3-9c60-44ec-aaa4-be467aa22c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:25.717100 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173452a3-9c60-44ec-aaa4-be467aa22c52 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:25.717421 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173452a3-9c60-44ec-aaa4-be467aa22c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:25.717742 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173452a3-9c60-44ec-aaa4-be467aa22c52 admin admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:25.718585 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173452a3-9c60-44ec-aaa4-be467aa22c52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:20:25.718943 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173452a3-9c60-44ec-aaa4-be467aa22c52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:25.720686 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173452a3-9c60-44ec-aaa4-be467aa22c52 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:25.733343 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1425/2834] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:20:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:20:25.738209 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cfe7d4-7458-47a8-85c5-735867600088 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:25.749098 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cfe7d4-7458-47a8-85c5-735867600088 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:25.753955 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74675a4c-b60a-4cc0-af7c-7ef270881a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:25.754628 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74675a4c-b60a-4cc0-af7c-7ef270881a9a admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:25.754913 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74675a4c-b60a-4cc0-af7c-7ef270881a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:25.755189 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74675a4c-b60a-4cc0-af7c-7ef270881a9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:25.755930 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74675a4c-b60a-4cc0-af7c-7ef270881a9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:25.757918 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74675a4c-b60a-4cc0-af7c-7ef270881a9a admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:25.786606 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1410/2835] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:20:25 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:20:25.790513 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173452a3-9c60-44ec-aaa4-be467aa22c52 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:25.800706 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173452a3-9c60-44ec-aaa4-be467aa22c52 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:25.858213 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c4e5b-6458-4217-988e-927868b0e5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:25.858895 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c4e5b-6458-4217-988e-927868b0e5bd admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:25.859185 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c4e5b-6458-4217-988e-927868b0e5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:25.859465 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c4e5b-6458-4217-988e-927868b0e5bd admin admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:25.860194 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846c4e5b-6458-4217-988e-927868b0e5bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:25.862140 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846c4e5b-6458-4217-988e-927868b0e5bd admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:25.882198 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1426/2836] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:20:25 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 12:20:25.887288 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74675a4c-b60a-4cc0-af7c-7ef270881a9a admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:25.897678 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74675a4c-b60a-4cc0-af7c-7ef270881a9a admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:25.902459 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ce205-4bfe-4b26-8eab-511c808073d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:25.903120 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ce205-4bfe-4b26-8eab-511c808073d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:25.903400 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ce205-4bfe-4b26-8eab-511c808073d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:25.903673 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ce205-4bfe-4b26-8eab-511c808073d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:25.904422 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593ce205-4bfe-4b26-8eab-511c808073d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:25.906017 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593ce205-4bfe-4b26-8eab-511c808073d4 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:25.916453 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1411/2837] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:20:25.920592 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c4e5b-6458-4217-988e-927868b0e5bd admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:25.925775 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:20:25.933234 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c4e5b-6458-4217-988e-927868b0e5bd admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:25.938817 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c13b5-06fb-4ebd-8c52-b37b1c0e0472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:25.939487 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c13b5-06fb-4ebd-8c52-b37b1c0e0472 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:25.939771 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c13b5-06fb-4ebd-8c52-b37b1c0e0472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:25.940046 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c13b5-06fb-4ebd-8c52-b37b1c0e0472 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:25.940951 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422c13b5-06fb-4ebd-8c52-b37b1c0e0472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:25.942547 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422c13b5-06fb-4ebd-8c52-b37b1c0e0472 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:25.953542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1427/2838] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:20:25.957705 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ce205-4bfe-4b26-8eab-511c808073d4 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:25.964109 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:20:25.968753 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ce205-4bfe-4b26-8eab-511c808073d4 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:25.974368 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eee664-7535-44c4-87ec-547a346f26af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:25.975469 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eee664-7535-44c4-87ec-547a346f26af admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:25.975942 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eee664-7535-44c4-87ec-547a346f26af admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:25.976312 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eee664-7535-44c4-87ec-547a346f26af admin admin] PATH_INFO: `/v3/projects/7fed822c1d4d4293ab06053dfb9ed2a4/users/cd3e1d2d270a493498c21a18bac36399/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:25.991837 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eee664-7535-44c4-87ec-547a346f26af admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fed822c1d4d4293ab06053dfb9ed2a4, user_id=cd3e1d2d270a493498c21a18bac36399, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:25.994534 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eee664-7535-44c4-87ec-547a346f26af admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:26.008273 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1412/2839] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:20:25 2022] PUT /identity/v3/projects/7fed822c1d4d4293ab06053dfb9ed2a4/users/cd3e1d2d270a493498c21a18bac36399/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:20:26.019771 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01163156-e525-43bf-9c69-99b875096255 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:26.020318 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01163156-e525-43bf-9c69-99b875096255 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:26.020527 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01163156-e525-43bf-9c69-99b875096255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:26.055744 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-01163156-e525-43bf-9c69-99b875096255 None None] MFA Rules not processed for user `cd3e1d2d270a493498c21a18bac36399`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:20:26.056916 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-01163156-e525-43bf-9c69-99b875096255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:26.126121 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1428/2840] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:20:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:20:26.137444 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eee664-7535-44c4-87ec-547a346f26af admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:26.139214 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a5eee664-7535-44c4-87ec-547a346f26af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:26.201200 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eee664-7535-44c4-87ec-547a346f26af admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:26.205371 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd800211-dbbf-49f1-afc9-e029a6570073 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:26.206089 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd800211-dbbf-49f1-afc9-e029a6570073 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:26.206452 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd800211-dbbf-49f1-afc9-e029a6570073 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:26.206786 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd800211-dbbf-49f1-afc9-e029a6570073 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:26.216124 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd800211-dbbf-49f1-afc9-e029a6570073 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:26.217654 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd800211-dbbf-49f1-afc9-e029a6570073 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:26.228305 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1413/2841] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:20:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:20:31.384449 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01163156-e525-43bf-9c69-99b875096255 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:31.450424 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01163156-e525-43bf-9c69-99b875096255 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:31.455347 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce832b-8eda-4bbc-89ac-b8b426bfa67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:31.456253 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce832b-8eda-4bbc-89ac-b8b426bfa67a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:31.456539 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce832b-8eda-4bbc-89ac-b8b426bfa67a admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:31.456814 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce832b-8eda-4bbc-89ac-b8b426bfa67a admin admin] PATH_INFO: `/v3/users/cd3e1d2d270a493498c21a18bac36399` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:31.458018 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ce832b-8eda-4bbc-89ac-b8b426bfa67a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd3e1d2d270a493498c21a18bac36399)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:31.459951 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ce832b-8eda-4bbc-89ac-b8b426bfa67a admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:31.513097 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-e2ce832b-8eda-4bbc-89ac-b8b426bfa67a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd3e1d2d270a493498c21a18bac36399'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:31.519970 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-e2ce832b-8eda-4bbc-89ac-b8b426bfa67a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd3e1d2d270a493498c21a18bac36399'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:31.520679 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-e2ce832b-8eda-4bbc-89ac-b8b426bfa67a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd3e1d2d270a493498c21a18bac36399'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:31.521291 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-e2ce832b-8eda-4bbc-89ac-b8b426bfa67a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd3e1d2d270a493498c21a18bac36399'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:31.533172 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-e2ce832b-8eda-4bbc-89ac-b8b426bfa67a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd3e1d2d270a493498c21a18bac36399'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:31.543625 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:20:31.549028 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1429/2842] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:20:31 2022] DELETE /identity/v3/users/cd3e1d2d270a493498c21a18bac36399 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:20:31.554814 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e293dff-0f34-4cfb-b01b-f868ed866ea5 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:31.555412 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e293dff-0f34-4cfb-b01b-f868ed866ea5 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:31.555522 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e293dff-0f34-4cfb-b01b-f868ed866ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:31.574115 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-1e293dff-0f34-4cfb-b01b-f868ed866ea5 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:20:31.575269 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-1e293dff-0f34-4cfb-b01b-f868ed866ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:31.639001 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1414/2843] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:20:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:20:31.648875 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce832b-8eda-4bbc-89ac-b8b426bfa67a admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:31.650293 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-e2ce832b-8eda-4bbc-89ac-b8b426bfa67a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:31.708602 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce832b-8eda-4bbc-89ac-b8b426bfa67a admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:31.712438 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561d64a-b2cf-458d-8d29-bec53c6fe84f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:31.713092 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561d64a-b2cf-458d-8d29-bec53c6fe84f service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:31.713375 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561d64a-b2cf-458d-8d29-bec53c6fe84f service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:31.713648 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561d64a-b2cf-458d-8d29-bec53c6fe84f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:31.723164 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9561d64a-b2cf-458d-8d29-bec53c6fe84f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:31.724643 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9561d64a-b2cf-458d-8d29-bec53c6fe84f service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:31.734907 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1430/2844] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:20:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 12:20:32.009174 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e293dff-0f34-4cfb-b01b-f868ed866ea5 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:32.010682 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-1e293dff-0f34-4cfb-b01b-f868ed866ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:32.023021 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e293dff-0f34-4cfb-b01b-f868ed866ea5 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:32.028918 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6bf89-27f2-4887-bf5f-4540c92e0d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:32.030042 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6bf89-27f2-4887-bf5f-4540c92e0d68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:32.030321 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6bf89-27f2-4887-bf5f-4540c92e0d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:32.030598 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6bf89-27f2-4887-bf5f-4540c92e0d68 admin admin] PATH_INFO: `/v3/projects/7fed822c1d4d4293ab06053dfb9ed2a4` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:32.034677 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd6bf89-27f2-4887-bf5f-4540c92e0d68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fed822c1d4d4293ab06053dfb9ed2a4)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:32.034677 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd6bf89-27f2-4887-bf5f-4540c92e0d68 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:32.092591 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-efd6bf89-27f2-4887-bf5f-4540c92e0d68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fed822c1d4d4293ab06053dfb9ed2a4', 'request_id': 'req-efd6bf89-27f2-4887-bf5f-4540c92e0d68'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:32.100659 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-efd6bf89-27f2-4887-bf5f-4540c92e0d68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fed822c1d4d4293ab06053dfb9ed2a4', 'request_id': 'req-efd6bf89-27f2-4887-bf5f-4540c92e0d68'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:32.108023 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-efd6bf89-27f2-4887-bf5f-4540c92e0d68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fed822c1d4d4293ab06053dfb9ed2a4', 'request_id': 'req-efd6bf89-27f2-4887-bf5f-4540c92e0d68'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:32.119297 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-efd6bf89-27f2-4887-bf5f-4540c92e0d68 admin admin] The token cache is being invalidate because project 7fed822c1d4d4293ab06053dfb9ed2a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:20:32.119587 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-efd6bf89-27f2-4887-bf5f-4540c92e0d68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:32.120323 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-efd6bf89-27f2-4887-bf5f-4540c92e0d68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:32.122031 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1415/2845] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:20:32 2022] DELETE /identity/v3/projects/7fed822c1d4d4293ab06053dfb9ed2a4 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:20:32.126898 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76291140-85b1-47db-adf1-8ce3214463eb None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:32.127185 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76291140-85b1-47db-adf1-8ce3214463eb None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:32.127491 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76291140-85b1-47db-adf1-8ce3214463eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:32.146051 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-76291140-85b1-47db-adf1-8ce3214463eb None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:20:32.147256 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-76291140-85b1-47db-adf1-8ce3214463eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:32.155702 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6bf89-27f2-4887-bf5f-4540c92e0d68 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:32.157691 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-efd6bf89-27f2-4887-bf5f-4540c92e0d68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:32.169816 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:20:32.212714 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1431/2846] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:20:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:20:32.233933 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6bf89-27f2-4887-bf5f-4540c92e0d68 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:32.239274 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622b8f5-74ab-4504-ae78-a4dde1c9bbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:32.240216 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622b8f5-74ab-4504-ae78-a4dde1c9bbbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:32.240503 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622b8f5-74ab-4504-ae78-a4dde1c9bbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:32.240776 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622b8f5-74ab-4504-ae78-a4dde1c9bbbb admin admin] PATH_INFO: `/v3/users/03d0ed2a19ae4843a4c8dcdf0c70d909` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:32.242061 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622b8f5-74ab-4504-ae78-a4dde1c9bbbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=03d0ed2a19ae4843a4c8dcdf0c70d909)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:32.244068 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622b8f5-74ab-4504-ae78-a4dde1c9bbbb admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:32.277496 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5f27f-8b31-47f1-ae2c-46fda591c201 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:32.277821 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5f27f-8b31-47f1-ae2c-46fda591c201 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:32.278175 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5f27f-8b31-47f1-ae2c-46fda591c201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:32.298047 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-79b5f27f-8b31-47f1-ae2c-46fda591c201 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:20:32.299244 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-79b5f27f-8b31-47f1-ae2c-46fda591c201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:32.300991 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1622b8f5-74ab-4504-ae78-a4dde1c9bbbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03d0ed2a19ae4843a4c8dcdf0c70d909'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:32.301648 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1622b8f5-74ab-4504-ae78-a4dde1c9bbbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03d0ed2a19ae4843a4c8dcdf0c70d909'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:32.302259 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1622b8f5-74ab-4504-ae78-a4dde1c9bbbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03d0ed2a19ae4843a4c8dcdf0c70d909'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:32.307698 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1432/2847] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:20:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:20:32.309694 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1622b8f5-74ab-4504-ae78-a4dde1c9bbbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03d0ed2a19ae4843a4c8dcdf0c70d909'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:32.311810 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b5f27f-8b31-47f1-ae2c-46fda591c201 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:32.321032 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b5f27f-8b31-47f1-ae2c-46fda591c201 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:32.322016 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1622b8f5-74ab-4504-ae78-a4dde1c9bbbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03d0ed2a19ae4843a4c8dcdf0c70d909'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:32.327944 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f919303-8ba9-4fcc-80e6-2cd8bf359975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:32.328939 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f919303-8ba9-4fcc-80e6-2cd8bf359975 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:32.329224 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f919303-8ba9-4fcc-80e6-2cd8bf359975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:32.329512 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f919303-8ba9-4fcc-80e6-2cd8bf359975 admin admin] PATH_INFO: `/v3/domains` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:32.330405 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f919303-8ba9-4fcc-80e6-2cd8bf359975 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:20:32.330955 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f919303-8ba9-4fcc-80e6-2cd8bf359975 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:32.333072 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f919303-8ba9-4fcc-80e6-2cd8bf359975 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:32.340132 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1416/2848] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:20:32 2022] DELETE /identity/v3/users/03d0ed2a19ae4843a4c8dcdf0c70d909 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:20:32.345194 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4be76b-b728-4db3-8ded-83d619a7d099 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:32.345550 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4be76b-b728-4db3-8ded-83d619a7d099 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:32.345835 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4be76b-b728-4db3-8ded-83d619a7d099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:32.346117 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1433/2849] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:20:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 08 12:20:32.350411 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f919303-8ba9-4fcc-80e6-2cd8bf359975 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:32.361457 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f919303-8ba9-4fcc-80e6-2cd8bf359975 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:32.364363 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-4d4be76b-b728-4db3-8ded-83d619a7d099 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:20:32.365637 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-4d4be76b-b728-4db3-8ded-83d619a7d099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:32.420895 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50401cdb-b3d8-4606-a15f-38433635ce88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:32.421602 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50401cdb-b3d8-4606-a15f-38433635ce88 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:32.421895 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50401cdb-b3d8-4606-a15f-38433635ce88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:32.422176 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50401cdb-b3d8-4606-a15f-38433635ce88 admin admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:32.422880 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50401cdb-b3d8-4606-a15f-38433635ce88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:32.424868 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50401cdb-b3d8-4606-a15f-38433635ce88 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:32.435030 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1417/2850] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:20:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:20:32.447092 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4be76b-b728-4db3-8ded-83d619a7d099 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:32.449690 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-4d4be76b-b728-4db3-8ded-83d619a7d099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:32.455791 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1434/2851] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:20:32 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 12:20:32.460340 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50401cdb-b3d8-4606-a15f-38433635ce88 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:32.472006 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:20:32.489327 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:20:32.519107 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4be76b-b728-4db3-8ded-83d619a7d099 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:32.533583 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50401cdb-b3d8-4606-a15f-38433635ce88 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:32.538525 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0998e75-71c2-46ce-94d5-a71199a78f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:32.539239 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0998e75-71c2-46ce-94d5-a71199a78f93 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:32.539530 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0998e75-71c2-46ce-94d5-a71199a78f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:32.539814 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0998e75-71c2-46ce-94d5-a71199a78f93 admin admin] PATH_INFO: `/v3/users` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:32.540590 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0998e75-71c2-46ce-94d5-a71199a78f93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:32.542829 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0998e75-71c2-46ce-94d5-a71199a78f93 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:32.566917 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1435/2852] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:20:32 2022] POST /identity/v3/users => generated 288 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 12:20:32.570868 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0998e75-71c2-46ce-94d5-a71199a78f93 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:32.580045 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee76f065-0b77-468e-ae87-2a8a18c324f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:32.580045 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76f065-0b77-468e-ae87-2a8a18c324f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:32.580045 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76f065-0b77-468e-ae87-2a8a18c324f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:32.580045 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76f065-0b77-468e-ae87-2a8a18c324f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:32.583736 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0998e75-71c2-46ce-94d5-a71199a78f93 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:32.588802 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143bc750-9730-4294-aa18-df8db2b922b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:32.593624 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143bc750-9730-4294-aa18-df8db2b922b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:32.593624 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143bc750-9730-4294-aa18-df8db2b922b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:32.593624 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143bc750-9730-4294-aa18-df8db2b922b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:32.594013 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee76f065-0b77-468e-ae87-2a8a18c324f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:32.594114 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143bc750-9730-4294-aa18-df8db2b922b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:32.594812 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee76f065-0b77-468e-ae87-2a8a18c324f1 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:32.595013 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143bc750-9730-4294-aa18-df8db2b922b5 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:32.605351 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1436/2853] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 12:20:32.609961 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143bc750-9730-4294-aa18-df8db2b922b5 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:32.610739 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1418/2854] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:20:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 12:20:32.621002 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143bc750-9730-4294-aa18-df8db2b922b5 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:32.626310 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d4fa4-f11f-4b6b-84fa-cae31dccab29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:32.626983 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d4fa4-f11f-4b6b-84fa-cae31dccab29 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:32.627270 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d4fa4-f11f-4b6b-84fa-cae31dccab29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:32.627546 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d4fa4-f11f-4b6b-84fa-cae31dccab29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:32.628304 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d4fa4-f11f-4b6b-84fa-cae31dccab29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:32.629918 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d4fa4-f11f-4b6b-84fa-cae31dccab29 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:32.641698 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1437/2855] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 12:20:32.646270 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee76f065-0b77-468e-ae87-2a8a18c324f1 service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:32.659419 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee76f065-0b77-468e-ae87-2a8a18c324f1 service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:32.665226 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1babbc-5b18-4535-97ad-826bd5f2d509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:32.666307 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1babbc-5b18-4535-97ad-826bd5f2d509 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:32.666629 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1babbc-5b18-4535-97ad-826bd5f2d509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:32.667076 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1babbc-5b18-4535-97ad-826bd5f2d509 admin admin] PATH_INFO: `/v3/projects/e150daa6093a4033bc6f0fe9a7f78d84/users/eaeb07a3458a4c58b7cad4fc6b3b2a2c/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:32.685115 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1babbc-5b18-4535-97ad-826bd5f2d509 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e150daa6093a4033bc6f0fe9a7f78d84, user_id=eaeb07a3458a4c58b7cad4fc6b3b2a2c, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:32.688410 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1babbc-5b18-4535-97ad-826bd5f2d509 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:32.703830 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1419/2856] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:20:32 2022] PUT /identity/v3/projects/e150daa6093a4033bc6f0fe9a7f78d84/users/eaeb07a3458a4c58b7cad4fc6b3b2a2c/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:20:32.716282 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e2e70-667d-4657-b2bd-038642e109e2 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:32.716722 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e2e70-667d-4657-b2bd-038642e109e2 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:32.717075 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e2e70-667d-4657-b2bd-038642e109e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:32.746344 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-661e2e70-667d-4657-b2bd-038642e109e2 None None] MFA Rules not processed for user `eaeb07a3458a4c58b7cad4fc6b3b2a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:20:32.747628 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-661e2e70-667d-4657-b2bd-038642e109e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:32.814247 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1438/2857] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:20:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:20:32.825457 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1babbc-5b18-4535-97ad-826bd5f2d509 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:32.827247 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ab1babbc-5b18-4535-97ad-826bd5f2d509 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:32.891720 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1babbc-5b18-4535-97ad-826bd5f2d509 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:32.895956 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580be9e-704e-4c50-8c2b-7bea26800a86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2d235956e984676be738414b948bde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:32.896858 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580be9e-704e-4c50-8c2b-7bea26800a86 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:32.897168 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580be9e-704e-4c50-8c2b-7bea26800a86 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:32.897498 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580be9e-704e-4c50-8c2b-7bea26800a86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:32.905980 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e2e70-667d-4657-b2bd-038642e109e2 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:32.907249 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a580be9e-704e-4c50-8c2b-7bea26800a86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:32.907451 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-661e2e70-667d-4657-b2bd-038642e109e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:32.908744 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a580be9e-704e-4c50-8c2b-7bea26800a86 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:32.920622 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1420/2858] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:20:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:20:33.003825 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e2e70-667d-4657-b2bd-038642e109e2 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:33.008496 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acc7c45-3ece-49e0-9209-37c78f9c83d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:33.009369 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc7c45-3ece-49e0-9209-37c78f9c83d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:33.009656 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc7c45-3ece-49e0-9209-37c78f9c83d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:33.009935 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc7c45-3ece-49e0-9209-37c78f9c83d8 admin admin] PATH_INFO: `/v3/projects/099767020d9a461fb81c022d9bf2d2f5` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:33.011393 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acc7c45-3ece-49e0-9209-37c78f9c83d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=099767020d9a461fb81c022d9bf2d2f5)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:33.013364 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acc7c45-3ece-49e0-9209-37c78f9c83d8 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:33.021861 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:20:33.064961 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-5acc7c45-3ece-49e0-9209-37c78f9c83d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '099767020d9a461fb81c022d9bf2d2f5', 'request_id': 'req-5acc7c45-3ece-49e0-9209-37c78f9c83d8'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:33.072981 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-5acc7c45-3ece-49e0-9209-37c78f9c83d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '099767020d9a461fb81c022d9bf2d2f5', 'request_id': 'req-5acc7c45-3ece-49e0-9209-37c78f9c83d8'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:33.079601 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-5acc7c45-3ece-49e0-9209-37c78f9c83d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '099767020d9a461fb81c022d9bf2d2f5', 'request_id': 'req-5acc7c45-3ece-49e0-9209-37c78f9c83d8'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:33.093107 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-5acc7c45-3ece-49e0-9209-37c78f9c83d8 admin admin] The token cache is being invalidate because project 099767020d9a461fb81c022d9bf2d2f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:20:33.093601 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-5acc7c45-3ece-49e0-9209-37c78f9c83d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:33.094686 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-5acc7c45-3ece-49e0-9209-37c78f9c83d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:33.096495 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1439/2859] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:20:32 2022] DELETE /identity/v3/projects/099767020d9a461fb81c022d9bf2d2f5 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:20:42.920414 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=70,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:20:43.088113 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=21,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:20:43.224682 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580be9e-704e-4c50-8c2b-7bea26800a86 service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:43.237213 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580be9e-704e-4c50-8c2b-7bea26800a86 service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:43.296492 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee833db-3f99-4b11-ba52-5bd9138fda5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:43.297381 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee833db-3f99-4b11-ba52-5bd9138fda5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:43.297661 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee833db-3f99-4b11-ba52-5bd9138fda5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:43.297937 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee833db-3f99-4b11-ba52-5bd9138fda5a admin admin] PATH_INFO: `/v3/users/eaeb07a3458a4c58b7cad4fc6b3b2a2c` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:43.299120 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee833db-3f99-4b11-ba52-5bd9138fda5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaeb07a3458a4c58b7cad4fc6b3b2a2c)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:43.301148 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee833db-3f99-4b11-ba52-5bd9138fda5a admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:43.350932 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3ee833db-3f99-4b11-ba52-5bd9138fda5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaeb07a3458a4c58b7cad4fc6b3b2a2c'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:43.351595 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3ee833db-3f99-4b11-ba52-5bd9138fda5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaeb07a3458a4c58b7cad4fc6b3b2a2c'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:43.352240 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3ee833db-3f99-4b11-ba52-5bd9138fda5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaeb07a3458a4c58b7cad4fc6b3b2a2c'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:43.360612 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3ee833db-3f99-4b11-ba52-5bd9138fda5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaeb07a3458a4c58b7cad4fc6b3b2a2c'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:43.373144 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3ee833db-3f99-4b11-ba52-5bd9138fda5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaeb07a3458a4c58b7cad4fc6b3b2a2c'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:43.386766 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1421/2860] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:20:43 2022] DELETE /identity/v3/users/eaeb07a3458a4c58b7cad4fc6b3b2a2c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:20:43.391409 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dad346-edc2-4ae3-a4e5-4aeab37de890 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:43.391702 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dad346-edc2-4ae3-a4e5-4aeab37de890 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:43.392104 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dad346-edc2-4ae3-a4e5-4aeab37de890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:43.419085 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-f5dad346-edc2-4ae3-a4e5-4aeab37de890 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:20:43.420352 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-f5dad346-edc2-4ae3-a4e5-4aeab37de890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:43.487856 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1440/2861] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:20:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:20:43.498212 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee833db-3f99-4b11-ba52-5bd9138fda5a admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:43.499624 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-3ee833db-3f99-4b11-ba52-5bd9138fda5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:43.560917 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee833db-3f99-4b11-ba52-5bd9138fda5a admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:43.564638 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b818e-74f6-4c68-a52a-d52bc23486ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:43.565291 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b818e-74f6-4c68-a52a-d52bc23486ac service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:43.565573 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b818e-74f6-4c68-a52a-d52bc23486ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:43.565848 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b818e-74f6-4c68-a52a-d52bc23486ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:43.576541 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b818e-74f6-4c68-a52a-d52bc23486ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:43.577997 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b818e-74f6-4c68-a52a-d52bc23486ac service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:43.587851 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1422/2862] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:20:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:20:43.867964 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dad346-edc2-4ae3-a4e5-4aeab37de890 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:43.869818 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-f5dad346-edc2-4ae3-a4e5-4aeab37de890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:43.883378 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dad346-edc2-4ae3-a4e5-4aeab37de890 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:43.890760 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb578ec9-641d-47bf-9a1d-46593385e7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:43.891637 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb578ec9-641d-47bf-9a1d-46593385e7e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:43.891921 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb578ec9-641d-47bf-9a1d-46593385e7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:43.892220 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb578ec9-641d-47bf-9a1d-46593385e7e9 admin admin] PATH_INFO: `/v3/projects/e150daa6093a4033bc6f0fe9a7f78d84` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:43.893512 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb578ec9-641d-47bf-9a1d-46593385e7e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e150daa6093a4033bc6f0fe9a7f78d84)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:43.895373 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb578ec9-641d-47bf-9a1d-46593385e7e9 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:43.943601 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-fb578ec9-641d-47bf-9a1d-46593385e7e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e150daa6093a4033bc6f0fe9a7f78d84', 'request_id': 'req-fb578ec9-641d-47bf-9a1d-46593385e7e9'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:43.953077 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-fb578ec9-641d-47bf-9a1d-46593385e7e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e150daa6093a4033bc6f0fe9a7f78d84', 'request_id': 'req-fb578ec9-641d-47bf-9a1d-46593385e7e9'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:43.958754 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-fb578ec9-641d-47bf-9a1d-46593385e7e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e150daa6093a4033bc6f0fe9a7f78d84', 'request_id': 'req-fb578ec9-641d-47bf-9a1d-46593385e7e9'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:43.970239 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-fb578ec9-641d-47bf-9a1d-46593385e7e9 admin admin] The token cache is being invalidate because project e150daa6093a4033bc6f0fe9a7f78d84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:20:43.970526 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-fb578ec9-641d-47bf-9a1d-46593385e7e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:43.971162 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-fb578ec9-641d-47bf-9a1d-46593385e7e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:20:43.972745 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1441/2863] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:20:43 2022] DELETE /identity/v3/projects/e150daa6093a4033bc6f0fe9a7f78d84 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:20:43.977694 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120795f2-4f2c-4647-ba50-4dd048dfe399 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:43.978179 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120795f2-4f2c-4647-ba50-4dd048dfe399 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:43.978291 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120795f2-4f2c-4647-ba50-4dd048dfe399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:43.998105 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-120795f2-4f2c-4647-ba50-4dd048dfe399 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:20:43.999236 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-120795f2-4f2c-4647-ba50-4dd048dfe399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:44.016614 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:20:44.063693 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1423/2864] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:20:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:20:44.072475 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ed479-2aba-489a-89db-27473f2adfd7 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:44.072770 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ed479-2aba-489a-89db-27473f2adfd7 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:44.073055 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ed479-2aba-489a-89db-27473f2adfd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:44.092210 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-a55ed479-2aba-489a-89db-27473f2adfd7 None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:20:44.093443 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-a55ed479-2aba-489a-89db-27473f2adfd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:44.101359 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1442/2865] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:20:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:20:44.105667 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120795f2-4f2c-4647-ba50-4dd048dfe399 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:44.115636 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120795f2-4f2c-4647-ba50-4dd048dfe399 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:44.120691 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0246e-68e6-44ec-b56a-9ca4b537d9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:44.121358 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0246e-68e6-44ec-b56a-9ca4b537d9c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:44.121641 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0246e-68e6-44ec-b56a-9ca4b537d9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:44.121924 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0246e-68e6-44ec-b56a-9ca4b537d9c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:44.122647 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a0246e-68e6-44ec-b56a-9ca4b537d9c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 08 12:20:44.122977 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a0246e-68e6-44ec-b56a-9ca4b537d9c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:44.124633 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a0246e-68e6-44ec-b56a-9ca4b537d9c7 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:44.136836 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1424/2866] 10.222.0.39 () {58 vars in 1152 bytes} [Wed Jun 8 12:20:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 08 12:20:44.141218 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ed479-2aba-489a-89db-27473f2adfd7 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:44.150318 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ed479-2aba-489a-89db-27473f2adfd7 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:44.156315 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee75aa-7bbd-4cbe-89e1-82eda8b44804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:44.156803 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee75aa-7bbd-4cbe-89e1-82eda8b44804 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:44.157158 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee75aa-7bbd-4cbe-89e1-82eda8b44804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:44.157455 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee75aa-7bbd-4cbe-89e1-82eda8b44804 admin admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:44.158348 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee75aa-7bbd-4cbe-89e1-82eda8b44804 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:44.161626 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee75aa-7bbd-4cbe-89e1-82eda8b44804 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:44.192213 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1443/2867] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:20:44 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 08 12:20:44.196280 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0246e-68e6-44ec-b56a-9ca4b537d9c7 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:44.206521 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0246e-68e6-44ec-b56a-9ca4b537d9c7 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:44.264934 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b6231-ab50-4cf6-b45f-d99df464eff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:44.265526 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b6231-ab50-4cf6-b45f-d99df464eff6 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:44.265809 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b6231-ab50-4cf6-b45f-d99df464eff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:44.266083 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b6231-ab50-4cf6-b45f-d99df464eff6 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:44.266764 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b6231-ab50-4cf6-b45f-d99df464eff6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:44.268723 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b6231-ab50-4cf6-b45f-d99df464eff6 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:44.289347 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1425/2868] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:20:44 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:20:44.294090 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee75aa-7bbd-4cbe-89e1-82eda8b44804 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:44.304735 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee75aa-7bbd-4cbe-89e1-82eda8b44804 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:44.312735 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ef84c-5dce-411f-b066-7b4b998d71ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:44.313413 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ef84c-5dce-411f-b066-7b4b998d71ea admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:44.313700 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ef84c-5dce-411f-b066-7b4b998d71ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:44.314084 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ef84c-5dce-411f-b066-7b4b998d71ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:44.314818 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ef84c-5dce-411f-b066-7b4b998d71ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:44.316450 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ef84c-5dce-411f-b066-7b4b998d71ea admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:44.327606 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1444/2869] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:20:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:20:44.331915 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b6231-ab50-4cf6-b45f-d99df464eff6 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:44.343309 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b6231-ab50-4cf6-b45f-d99df464eff6 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:44.349204 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f76d864-b059-4920-901c-fb39fb65268e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:44.349989 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76d864-b059-4920-901c-fb39fb65268e admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:44.350302 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76d864-b059-4920-901c-fb39fb65268e admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:44.350698 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76d864-b059-4920-901c-fb39fb65268e admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:44.351464 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f76d864-b059-4920-901c-fb39fb65268e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:44.353460 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f76d864-b059-4920-901c-fb39fb65268e admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:44.367033 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1426/2870] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:20:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 08 12:20:44.372549 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ef84c-5dce-411f-b066-7b4b998d71ea admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:44.383336 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ef84c-5dce-411f-b066-7b4b998d71ea admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:44.389086 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54acf4df-ae11-4279-bf7c-0fe47fe840b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:44.391314 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54acf4df-ae11-4279-bf7c-0fe47fe840b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:44.391314 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54acf4df-ae11-4279-bf7c-0fe47fe840b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:44.391314 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54acf4df-ae11-4279-bf7c-0fe47fe840b1 admin admin] PATH_INFO: `/v3/projects/18250555de5d4d018d1dd35f42199062/users/c3765f25faff4063b979324f0ab02f2d/roles/3682372ab3c145ba87e8baa5c520625f` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:44.406130 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54acf4df-ae11-4279-bf7c-0fe47fe840b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18250555de5d4d018d1dd35f42199062, user_id=c3765f25faff4063b979324f0ab02f2d, role_id=3682372ab3c145ba87e8baa5c520625f)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:44.408869 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54acf4df-ae11-4279-bf7c-0fe47fe840b1 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:44.426425 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1445/2871] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:20:44 2022] PUT /identity/v3/projects/18250555de5d4d018d1dd35f42199062/users/c3765f25faff4063b979324f0ab02f2d/roles/3682372ab3c145ba87e8baa5c520625f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:20:44.431563 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604bc7e-98f4-4068-9b8a-f86eed31070c None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:44.431850 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604bc7e-98f4-4068-9b8a-f86eed31070c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:44.432125 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604bc7e-98f4-4068-9b8a-f86eed31070c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:44.451863 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-5604bc7e-98f4-4068-9b8a-f86eed31070c None None] MFA Rules not processed for user `0451f9cd1a224f47a21e570061ffb155`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:20:44.453115 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-5604bc7e-98f4-4068-9b8a-f86eed31070c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:44.514167 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1427/2872] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:20:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:20:44.526780 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54acf4df-ae11-4279-bf7c-0fe47fe840b1 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:44.529731 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-54acf4df-ae11-4279-bf7c-0fe47fe840b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:44.561396 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:20:44.602582 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54acf4df-ae11-4279-bf7c-0fe47fe840b1 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:44.607510 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767db3d-26ab-4659-8dcc-81496053edeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:44.608199 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767db3d-26ab-4659-8dcc-81496053edeb service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:44.608486 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767db3d-26ab-4659-8dcc-81496053edeb service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:44.608766 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767db3d-26ab-4659-8dcc-81496053edeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:44.618221 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f767db3d-26ab-4659-8dcc-81496053edeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:44.619676 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f767db3d-26ab-4659-8dcc-81496053edeb service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:44.629380 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1446/2873] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:20:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:20:48.894119 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de09736-4bf3-427e-836c-392ff2353d04 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:48.894119 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de09736-4bf3-427e-836c-392ff2353d04 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:48.894794 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de09736-4bf3-427e-836c-392ff2353d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:48.924642 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-9de09736-4bf3-427e-836c-392ff2353d04 None None] MFA Rules not processed for user `c3765f25faff4063b979324f0ab02f2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:20:48.925872 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-9de09736-4bf3-427e-836c-392ff2353d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:48.950999 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:20:49.017923 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1428/2874] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:20:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:20:49.022453 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767db3d-26ab-4659-8dcc-81496053edeb service neutron] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:49.033554 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767db3d-26ab-4659-8dcc-81496053edeb service neutron] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:49.047220 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434970e0-7f83-4659-9f48-d1c3dd705ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:49.047907 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434970e0-7f83-4659-9f48-d1c3dd705ca0 admin admin] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:49.048217 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434970e0-7f83-4659-9f48-d1c3dd705ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:49.048502 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434970e0-7f83-4659-9f48-d1c3dd705ca0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:49.049209 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434970e0-7f83-4659-9f48-d1c3dd705ca0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:49.051131 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434970e0-7f83-4659-9f48-d1c3dd705ca0 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:49.084152 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1447/2875] 10.222.0.39 () {60 vars in 1152 bytes} [Wed Jun 8 12:20:49 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:20:49.088499 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de09736-4bf3-427e-836c-392ff2353d04 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:49.100109 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de09736-4bf3-427e-836c-392ff2353d04 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:49.194021 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c73ccd1-e3b5-4926-b392-bcc410c41296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:49.194716 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73ccd1-e3b5-4926-b392-bcc410c41296 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:49.195141 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73ccd1-e3b5-4926-b392-bcc410c41296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:49.195423 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73ccd1-e3b5-4926-b392-bcc410c41296 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:49.196130 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c73ccd1-e3b5-4926-b392-bcc410c41296 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:49.198214 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c73ccd1-e3b5-4926-b392-bcc410c41296 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:49.225119 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1429/2876] 10.222.0.39 () {60 vars in 1143 bytes} [Wed Jun 8 12:20:49 2022] POST /identity/v3/users => generated 298 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 08 12:20:49.229154 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434970e0-7f83-4659-9f48-d1c3dd705ca0 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:49.241135 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434970e0-7f83-4659-9f48-d1c3dd705ca0 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:49.246763 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25462e7-e75d-49ba-95a1-c830bf6f4589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:49.247445 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25462e7-e75d-49ba-95a1-c830bf6f4589 admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:49.247730 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25462e7-e75d-49ba-95a1-c830bf6f4589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:49.248006 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25462e7-e75d-49ba-95a1-c830bf6f4589 admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:49.248886 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25462e7-e75d-49ba-95a1-c830bf6f4589 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:49.250542 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25462e7-e75d-49ba-95a1-c830bf6f4589 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:49.263693 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1448/2877] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 12:20:49.269056 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c73ccd1-e3b5-4926-b392-bcc410c41296 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:49.280828 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c73ccd1-e3b5-4926-b392-bcc410c41296 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:49.286053 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e232f3f-7a8f-4bae-b154-7b7054352898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:49.287121 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e232f3f-7a8f-4bae-b154-7b7054352898 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:49.287410 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e232f3f-7a8f-4bae-b154-7b7054352898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:49.287688 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e232f3f-7a8f-4bae-b154-7b7054352898 admin admin] PATH_INFO: `/v3/projects/c05f923e1ef44b59aa53599041b03213/users/beb29b460757451882d9860a0920ec6c/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:49.307370 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e232f3f-7a8f-4bae-b154-7b7054352898 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c05f923e1ef44b59aa53599041b03213, user_id=beb29b460757451882d9860a0920ec6c, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:49.310466 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e232f3f-7a8f-4bae-b154-7b7054352898 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:49.331875 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1430/2878] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:20:49 2022] PUT /identity/v3/projects/c05f923e1ef44b59aa53599041b03213/users/beb29b460757451882d9860a0920ec6c/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:20:49.335835 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25462e7-e75d-49ba-95a1-c830bf6f4589 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:49.347088 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25462e7-e75d-49ba-95a1-c830bf6f4589 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:49.428996 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4399920-b0b0-4018-bfc2-83e70019c07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:49.429794 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4399920-b0b0-4018-bfc2-83e70019c07f admin admin] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:49.432890 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4399920-b0b0-4018-bfc2-83e70019c07f admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:49.432890 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4399920-b0b0-4018-bfc2-83e70019c07f admin admin] PATH_INFO: `/v3/roles` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:49.432890 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4399920-b0b0-4018-bfc2-83e70019c07f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:49.433530 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4399920-b0b0-4018-bfc2-83e70019c07f admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:49.450342 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1449/2879] 10.222.0.39 () {58 vars in 1121 bytes} [Wed Jun 8 12:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 08 12:20:49.451594 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e232f3f-7a8f-4bae-b154-7b7054352898 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:49.462944 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e232f3f-7a8f-4bae-b154-7b7054352898 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:49.475296 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ee3eb-4086-4ca5-acbf-4854473010c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:49.476807 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ee3eb-4086-4ca5-acbf-4854473010c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:49.477831 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ee3eb-4086-4ca5-acbf-4854473010c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:49.478314 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ee3eb-4086-4ca5-acbf-4854473010c1 admin admin] PATH_INFO: `/v3/projects/c05f923e1ef44b59aa53599041b03213/users/beb29b460757451882d9860a0920ec6c/roles/028d4429a4554bbb88b3aec9f6a9d937` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:49.480904 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ee3eb-4086-4ca5-acbf-4854473010c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c05f923e1ef44b59aa53599041b03213, user_id=beb29b460757451882d9860a0920ec6c, role_id=028d4429a4554bbb88b3aec9f6a9d937)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:49.484061 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ee3eb-4086-4ca5-acbf-4854473010c1 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:49.497801 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1431/2880] 10.222.0.39 () {60 vars in 1482 bytes} [Wed Jun 8 12:20:49 2022] PUT /identity/v3/projects/c05f923e1ef44b59aa53599041b03213/users/beb29b460757451882d9860a0920ec6c/roles/028d4429a4554bbb88b3aec9f6a9d937 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:20:54.771173 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a18a68-40a6-4748-b16a-3fc8c658bf13 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:54.771749 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a18a68-40a6-4748-b16a-3fc8c658bf13 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:54.772048 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a18a68-40a6-4748-b16a-3fc8c658bf13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:54.802708 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-28a18a68-40a6-4748-b16a-3fc8c658bf13 None None] MFA Rules not processed for user `beb29b460757451882d9860a0920ec6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:20:54.804086 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-28a18a68-40a6-4748-b16a-3fc8c658bf13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:54.889363 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1450/2881] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:20:54 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:20:54.903306 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ee3eb-4086-4ca5-acbf-4854473010c1 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:54.906276 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-4f9ee3eb-4086-4ca5-acbf-4854473010c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:54.975573 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ee3eb-4086-4ca5-acbf-4854473010c1 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:54.979552 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee353f81-23da-4617-8d14-d451429b0642 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2f8b5040a048c5bf4eef36f2ecd678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:54.980923 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee353f81-23da-4617-8d14-d451429b0642 service glance] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:54.981211 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee353f81-23da-4617-8d14-d451429b0642 service glance] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:54.981488 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee353f81-23da-4617-8d14-d451429b0642 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:55.011826 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:20:55.059166 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee353f81-23da-4617-8d14-d451429b0642 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:55.060758 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee353f81-23da-4617-8d14-d451429b0642 service glance] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:55.073944 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1432/2882] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:20:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:20:55.197644 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3949316-7ea4-4014-86df-029997913f53 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:55.199915 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3949316-7ea4-4014-86df-029997913f53 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:55.200254 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3949316-7ea4-4014-86df-029997913f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:55.217601 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:20:55.275320 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-a3949316-7ea4-4014-86df-029997913f53 None None] MFA Rules not processed for user `d52efc21c66d4300a8a979d92dbfeb47`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:20:55.276632 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-a3949316-7ea4-4014-86df-029997913f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:55.408800 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1451/2883] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Jun 8 12:20:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:20:55.466826 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee353f81-23da-4617-8d14-d451429b0642 service glance] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:20:55.468410 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ee353f81-23da-4617-8d14-d451429b0642 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:20:55.595940 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee353f81-23da-4617-8d14-d451429b0642 service glance] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:20:55.601455 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528fa48-da97-4d2d-84a1-446faa195c27 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753bde6a72d64045abd3ad44b9b0de04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:20:55.602128 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528fa48-da97-4d2d-84a1-446faa195c27 service swift] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:20:55.602413 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528fa48-da97-4d2d-84a1-446faa195c27 service swift] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:20:55.602683 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528fa48-da97-4d2d-84a1-446faa195c27 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:20:55.613694 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0528fa48-da97-4d2d-84a1-446faa195c27 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:20:55.615754 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0528fa48-da97-4d2d-84a1-446faa195c27 service swift] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:20:55.626441 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1433/2884] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Jun 8 12:20:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 12:21:04.654666 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4b95a-0e67-466f-b6b2-75ab4f7262a0 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:21:04.655257 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4b95a-0e67-466f-b6b2-75ab4f7262a0 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:21:04.655257 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4b95a-0e67-466f-b6b2-75ab4f7262a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:21:04.672950 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-03a4b95a-0e67-466f-b6b2-75ab4f7262a0 None None] MFA Rules not processed for user `c3765f25faff4063b979324f0ab02f2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:21:04.674810 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-03a4b95a-0e67-466f-b6b2-75ab4f7262a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:21:04.682055 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1452/2885] 10.222.0.39 () {58 vars in 957 bytes} [Wed Jun 8 12:21:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:21:04.943037 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528fa48-da97-4d2d-84a1-446faa195c27 service swift] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:21:04.999136 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528fa48-da97-4d2d-84a1-446faa195c27 service swift] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:21:05.002780 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78a4c9-44df-445d-94ab-d889d5f8a1b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:21:05.003437 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78a4c9-44df-445d-94ab-d889d5f8a1b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:21:05.003723 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78a4c9-44df-445d-94ab-d889d5f8a1b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:21:05.003998 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78a4c9-44df-445d-94ab-d889d5f8a1b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:21:05.005838 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-2b78a4c9-44df-445d-94ab-d889d5f8a1b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:21:05.017038 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b78a4c9-44df-445d-94ab-d889d5f8a1b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:21:05.018486 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b78a4c9-44df-445d-94ab-d889d5f8a1b5 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:21:05.027243 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1434/2886] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:21:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:21:06.524471 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf140d-c26a-4fe9-9039-9393dcc11424 None None] REQUEST_METHOD: `POST` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:21:06.525001 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf140d-c26a-4fe9-9039-9393dcc11424 None None] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:21:06.525157 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf140d-c26a-4fe9-9039-9393dcc11424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:21:06.545408 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.auth.core [None req-b6cf140d-c26a-4fe9-9039-9393dcc11424 None None] MFA Rules not processed for user `d52efc21c66d4300a8a979d92dbfeb47`. Rule list: `[]` (Enabled: `True`). {{(pid=80216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:21:06.547558 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-b6cf140d-c26a-4fe9-9039-9393dcc11424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:21:06.560472 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1453/2887] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Jun 8 12:21:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 08 12:21:06.573743 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78a4c9-44df-445d-94ab-d889d5f8a1b5 service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:21:06.591971 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78a4c9-44df-445d-94ab-d889d5f8a1b5 service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:21:06.598344 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a700961-c36c-4928-903b-596987775d95 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753bde6a72d64045abd3ad44b9b0de04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:21:06.599013 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a700961-c36c-4928-903b-596987775d95 service swift] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:21:06.599297 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a700961-c36c-4928-903b-596987775d95 service swift] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:21:06.599568 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a700961-c36c-4928-903b-596987775d95 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:21:06.608713 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a700961-c36c-4928-903b-596987775d95 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:21:06.610317 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a700961-c36c-4928-903b-596987775d95 service swift] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:21:06.619027 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1435/2888] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Jun 8 12:21:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 12:21:14.932785 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf140d-c26a-4fe9-9039-9393dcc11424 None None] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:21:14.935119 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-b6cf140d-c26a-4fe9-9039-9393dcc11424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:21:15.064348 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf140d-c26a-4fe9-9039-9393dcc11424 None None] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:21:15.071465 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79698f4d-7922-4280-9f09-67df3ecf9235 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef7edb5e9ce49e6b098f48bf060b228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:21:15.072364 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79698f4d-7922-4280-9f09-67df3ecf9235 service nova] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:21:15.072792 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79698f4d-7922-4280-9f09-67df3ecf9235 service nova] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:21:15.073988 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79698f4d-7922-4280-9f09-67df3ecf9235 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:21:15.075229 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-79698f4d-7922-4280-9f09-67df3ecf9235 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:21:15.088876 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79698f4d-7922-4280-9f09-67df3ecf9235 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:21:15.090503 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79698f4d-7922-4280-9f09-67df3ecf9235 service nova] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:21:15.101727 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1454/2889] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:21:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:21:16.615557 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:21:25.097001 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=91 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:21:33.280010 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a700961-c36c-4928-903b-596987775d95 service swift] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:21:33.289484 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a700961-c36c-4928-903b-596987775d95 service swift] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:21:33.293617 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006aef9b-f0d0-4b39-b116-29824d6c731e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:21:33.294257 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006aef9b-f0d0-4b39-b116-29824d6c731e service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:21:33.294540 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006aef9b-f0d0-4b39-b116-29824d6c731e service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:21:33.294815 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006aef9b-f0d0-4b39-b116-29824d6c731e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:21:33.296639 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-006aef9b-f0d0-4b39-b116-29824d6c731e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:21:33.361476 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006aef9b-f0d0-4b39-b116-29824d6c731e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:21:33.362938 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006aef9b-f0d0-4b39-b116-29824d6c731e service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:21:33.373450 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1436/2890] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:21:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:21:39.752937 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79698f4d-7922-4280-9f09-67df3ecf9235 service nova] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:21:39.769773 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79698f4d-7922-4280-9f09-67df3ecf9235 service nova] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:21:39.773928 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b7050f-7931-4031-b7c2-700643c057fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:21:39.774632 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7050f-7931-4031-b7c2-700643c057fe service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:21:39.775096 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7050f-7931-4031-b7c2-700643c057fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:21:39.776146 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7050f-7931-4031-b7c2-700643c057fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:21:39.778652 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-95b7050f-7931-4031-b7c2-700643c057fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:21:39.796109 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b7050f-7931-4031-b7c2-700643c057fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:21:39.797709 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b7050f-7931-4031-b7c2-700643c057fe service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:21:39.811514 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1455/2891] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:21:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:21:40.058947 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006aef9b-f0d0-4b39-b116-29824d6c731e service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:21:40.068211 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006aef9b-f0d0-4b39-b116-29824d6c731e service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:21:40.070111 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b7050f-7931-4031-b7c2-700643c057fe service neutron] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:21:40.071682 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-95b7050f-7931-4031-b7c2-700643c057fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:21:40.072247 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de3b636-1ae7-43a1-a5dc-2acf3f77d118 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:21:40.075545 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de3b636-1ae7-43a1-a5dc-2acf3f77d118 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:21:40.075838 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de3b636-1ae7-43a1-a5dc-2acf3f77d118 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:21:40.076116 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de3b636-1ae7-43a1-a5dc-2acf3f77d118 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:21:40.086002 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de3b636-1ae7-43a1-a5dc-2acf3f77d118 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:21:40.087463 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de3b636-1ae7-43a1-a5dc-2acf3f77d118 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:21:40.088014 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b7050f-7931-4031-b7c2-700643c057fe service neutron] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:21:40.099131 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdcfb89-fd40-4bbe-868d-3213391084d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:21:40.100056 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdcfb89-fd40-4bbe-868d-3213391084d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:21:40.100443 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdcfb89-fd40-4bbe-868d-3213391084d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:21:40.100719 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdcfb89-fd40-4bbe-868d-3213391084d6 admin admin] PATH_INFO: `/v3/users/5a2945ee4e3f4c6a91fef4978bcbfd88` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:21:40.102058 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1437/2892] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:21:40 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:21:40.123007 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdcfb89-fd40-4bbe-868d-3213391084d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a2945ee4e3f4c6a91fef4978bcbfd88)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:21:40.125047 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdcfb89-fd40-4bbe-868d-3213391084d6 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:21:40.175780 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-3cdcfb89-fd40-4bbe-868d-3213391084d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a2945ee4e3f4c6a91fef4978bcbfd88'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:21:40.186509 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-3cdcfb89-fd40-4bbe-868d-3213391084d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a2945ee4e3f4c6a91fef4978bcbfd88'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:21:40.187934 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-3cdcfb89-fd40-4bbe-868d-3213391084d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a2945ee4e3f4c6a91fef4978bcbfd88'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:21:40.189176 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-3cdcfb89-fd40-4bbe-868d-3213391084d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a2945ee4e3f4c6a91fef4978bcbfd88'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:21:40.204867 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-3cdcfb89-fd40-4bbe-868d-3213391084d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a2945ee4e3f4c6a91fef4978bcbfd88'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:21:40.219117 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1456/2893] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:21:40 2022] DELETE /identity/v3/users/5a2945ee4e3f4c6a91fef4978bcbfd88 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:21:40.413939 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de3b636-1ae7-43a1-a5dc-2acf3f77d118 service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:21:40.445211 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de3b636-1ae7-43a1-a5dc-2acf3f77d118 service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:21:40.522300 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c849a-8537-4985-be46-67dacf3c811a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:21:40.524888 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c849a-8537-4985-be46-67dacf3c811a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:21:40.524888 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c849a-8537-4985-be46-67dacf3c811a admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:21:40.525351 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c849a-8537-4985-be46-67dacf3c811a admin admin] PATH_INFO: `/v3/projects/7460a664cf154be08f3df2ec025632e2` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:21:40.539004 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2c849a-8537-4985-be46-67dacf3c811a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7460a664cf154be08f3df2ec025632e2)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:21:40.541679 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2c849a-8537-4985-be46-67dacf3c811a admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:21:40.600739 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-4c2c849a-8537-4985-be46-67dacf3c811a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7460a664cf154be08f3df2ec025632e2', 'request_id': 'req-4c2c849a-8537-4985-be46-67dacf3c811a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:21:40.616930 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-4c2c849a-8537-4985-be46-67dacf3c811a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7460a664cf154be08f3df2ec025632e2', 'request_id': 'req-4c2c849a-8537-4985-be46-67dacf3c811a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:21:40.624082 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-4c2c849a-8537-4985-be46-67dacf3c811a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7460a664cf154be08f3df2ec025632e2', 'request_id': 'req-4c2c849a-8537-4985-be46-67dacf3c811a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:21:40.641856 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-4c2c849a-8537-4985-be46-67dacf3c811a admin admin] The token cache is being invalidate because project 7460a664cf154be08f3df2ec025632e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:21:40.642143 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-4c2c849a-8537-4985-be46-67dacf3c811a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:21:40.642827 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-4c2c849a-8537-4985-be46-67dacf3c811a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:21:40.644416 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1438/2894] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:21:40 2022] DELETE /identity/v3/projects/7460a664cf154be08f3df2ec025632e2 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:21:40.650457 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdcfb89-fd40-4bbe-868d-3213391084d6 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:21:40.650457 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-3cdcfb89-fd40-4bbe-868d-3213391084d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:21:40.665843 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdcfb89-fd40-4bbe-868d-3213391084d6 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:21:40.731780 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa427f6a-318e-4a45-ae21-a4cba01cc01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:21:40.732960 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa427f6a-318e-4a45-ae21-a4cba01cc01b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:21:40.733243 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa427f6a-318e-4a45-ae21-a4cba01cc01b admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:21:40.733517 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa427f6a-318e-4a45-ae21-a4cba01cc01b admin admin] PATH_INFO: `/v3/users/8800016871b34731b7b6189ec16c1667` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:21:40.752429 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa427f6a-318e-4a45-ae21-a4cba01cc01b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8800016871b34731b7b6189ec16c1667)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:21:40.755929 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa427f6a-318e-4a45-ae21-a4cba01cc01b admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:21:40.815949 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:21:40.824718 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-aa427f6a-318e-4a45-ae21-a4cba01cc01b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8800016871b34731b7b6189ec16c1667'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:21:40.833958 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-aa427f6a-318e-4a45-ae21-a4cba01cc01b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8800016871b34731b7b6189ec16c1667'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:21:40.834843 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-aa427f6a-318e-4a45-ae21-a4cba01cc01b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8800016871b34731b7b6189ec16c1667'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:21:40.835754 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-aa427f6a-318e-4a45-ae21-a4cba01cc01b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8800016871b34731b7b6189ec16c1667'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:21:40.849105 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-aa427f6a-318e-4a45-ae21-a4cba01cc01b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8800016871b34731b7b6189ec16c1667'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:21:40.864191 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1457/2895] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:21:40 2022] DELETE /identity/v3/users/8800016871b34731b7b6189ec16c1667 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:21:41.060148 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c849a-8537-4985-be46-67dacf3c811a admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:21:41.061705 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-4c2c849a-8537-4985-be46-67dacf3c811a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:21:41.072747 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:21:41.077456 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c849a-8537-4985-be46-67dacf3c811a admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:21:41.149297 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7adef15-01aa-4cfe-a4d7-539794c4d4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:21:41.150172 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7adef15-01aa-4cfe-a4d7-539794c4d4fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:21:41.152268 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7adef15-01aa-4cfe-a4d7-539794c4d4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:21:41.152612 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7adef15-01aa-4cfe-a4d7-539794c4d4fd admin admin] PATH_INFO: `/v3/projects/04921bc6d96e4310b9774c0858355d30` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:21:41.163868 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7adef15-01aa-4cfe-a4d7-539794c4d4fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=04921bc6d96e4310b9774c0858355d30)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:21:41.165749 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7adef15-01aa-4cfe-a4d7-539794c4d4fd admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:21:41.219951 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a7adef15-01aa-4cfe-a4d7-539794c4d4fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04921bc6d96e4310b9774c0858355d30', 'request_id': 'req-a7adef15-01aa-4cfe-a4d7-539794c4d4fd'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:21:41.230976 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a7adef15-01aa-4cfe-a4d7-539794c4d4fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04921bc6d96e4310b9774c0858355d30', 'request_id': 'req-a7adef15-01aa-4cfe-a4d7-539794c4d4fd'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:21:41.237884 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a7adef15-01aa-4cfe-a4d7-539794c4d4fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04921bc6d96e4310b9774c0858355d30', 'request_id': 'req-a7adef15-01aa-4cfe-a4d7-539794c4d4fd'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:21:41.250558 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a7adef15-01aa-4cfe-a4d7-539794c4d4fd admin admin] The token cache is being invalidate because project 04921bc6d96e4310b9774c0858355d30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:21:41.250856 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a7adef15-01aa-4cfe-a4d7-539794c4d4fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:21:41.251539 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a7adef15-01aa-4cfe-a4d7-539794c4d4fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:21:41.253163 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1439/2896] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:21:41 2022] DELETE /identity/v3/projects/04921bc6d96e4310b9774c0858355d30 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:21:43.713734 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa427f6a-318e-4a45-ae21-a4cba01cc01b admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:21:43.715976 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-aa427f6a-318e-4a45-ae21-a4cba01cc01b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:21:43.787609 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa427f6a-318e-4a45-ae21-a4cba01cc01b admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:21:43.846452 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02948dde-ece4-491a-88cd-391c146cfb4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:21:43.847126 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02948dde-ece4-491a-88cd-391c146cfb4f service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:21:43.847419 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02948dde-ece4-491a-88cd-391c146cfb4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:21:43.847696 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02948dde-ece4-491a-88cd-391c146cfb4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:21:43.849741 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-02948dde-ece4-491a-88cd-391c146cfb4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:21:43.924946 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02948dde-ece4-491a-88cd-391c146cfb4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:21:43.926537 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02948dde-ece4-491a-88cd-391c146cfb4f service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:21:43.939693 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1458/2897] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:21:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:21:51.247412 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:21:53.934665 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:DELETE=5,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:22:30.811361 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7adef15-01aa-4cfe-a4d7-539794c4d4fd admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:22:30.813506 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a7adef15-01aa-4cfe-a4d7-539794c4d4fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:22:30.826151 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7adef15-01aa-4cfe-a4d7-539794c4d4fd admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:22:30.830078 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd066e2-17d1-419c-b37b-2bb83fc96173 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:22:30.830715 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd066e2-17d1-419c-b37b-2bb83fc96173 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:22:30.830999 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd066e2-17d1-419c-b37b-2bb83fc96173 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:22:30.831329 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd066e2-17d1-419c-b37b-2bb83fc96173 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:22:30.833079 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ffd066e2-17d1-419c-b37b-2bb83fc96173 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:22:30.842173 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd066e2-17d1-419c-b37b-2bb83fc96173 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:22:30.843928 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd066e2-17d1-419c-b37b-2bb83fc96173 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:22:30.852284 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1440/2898] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:22:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:22:34.956819 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02948dde-ece4-491a-88cd-391c146cfb4f service neutron] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:22:34.958347 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-02948dde-ece4-491a-88cd-391c146cfb4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:22:34.969590 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02948dde-ece4-491a-88cd-391c146cfb4f service neutron] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:22:34.973230 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe0fbd2-44b3-4039-9e28-6f2466ae90cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:22:34.973879 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0fbd2-44b3-4039-9e28-6f2466ae90cd service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:22:34.974191 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0fbd2-44b3-4039-9e28-6f2466ae90cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:22:34.974465 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0fbd2-44b3-4039-9e28-6f2466ae90cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:22:34.976262 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-fbe0fbd2-44b3-4039-9e28-6f2466ae90cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:22:34.987585 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe0fbd2-44b3-4039-9e28-6f2466ae90cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:22:34.989071 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe0fbd2-44b3-4039-9e28-6f2466ae90cd service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:22:34.997477 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1459/2899] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:22:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 08 12:22:35.098045 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd066e2-17d1-419c-b37b-2bb83fc96173 service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:22:35.106838 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd066e2-17d1-419c-b37b-2bb83fc96173 service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:22:35.110932 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0fc3a-3490-422b-aa62-4265c2e119d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:22:35.111649 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0fc3a-3490-422b-aa62-4265c2e119d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:22:35.111997 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0fc3a-3490-422b-aa62-4265c2e119d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:22:35.112372 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0fc3a-3490-422b-aa62-4265c2e119d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:22:35.114305 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a5d0fc3a-3490-422b-aa62-4265c2e119d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:22:35.129571 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d0fc3a-3490-422b-aa62-4265c2e119d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:22:35.131049 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d0fc3a-3490-422b-aa62-4265c2e119d4 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:22:35.142951 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1441/2900] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:22:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:22:44.993658 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=6 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:22:45.137246 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=12 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:24:07.996622 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe0fbd2-44b3-4039-9e28-6f2466ae90cd service neutron] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:24:07.998697 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-fbe0fbd2-44b3-4039-9e28-6f2466ae90cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:24:08.016687 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe0fbd2-44b3-4039-9e28-6f2466ae90cd service neutron] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:24:08.023114 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5ff56-3a5f-4cda-97d1-28408a5c840f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef7edb5e9ce49e6b098f48bf060b228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:24:08.023811 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5ff56-3a5f-4cda-97d1-28408a5c840f service nova] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:24:08.024091 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5ff56-3a5f-4cda-97d1-28408a5c840f service nova] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:24:08.024415 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5ff56-3a5f-4cda-97d1-28408a5c840f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:24:08.026186 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-4fd5ff56-3a5f-4cda-97d1-28408a5c840f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:24:08.040075 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5ff56-3a5f-4cda-97d1-28408a5c840f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:24:08.041707 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5ff56-3a5f-4cda-97d1-28408a5c840f service nova] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:24:08.054705 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1460/2901] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:24:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:24:09.129409 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639658f-1ecd-4c33-92c8-0ad3603825e2 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:24:09.129932 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639658f-1ecd-4c33-92c8-0ad3603825e2 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:24:09.130076 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639658f-1ecd-4c33-92c8-0ad3603825e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:24:09.147839 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-d639658f-1ecd-4c33-92c8-0ad3603825e2 None None] MFA Rules not processed for user `d52efc21c66d4300a8a979d92dbfeb47`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 08 12:24:09.149070 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-d639658f-1ecd-4c33-92c8-0ad3603825e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:24:09.204556 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1442/2902] 10.222.0.39 () {58 vars in 967 bytes} [Wed Jun 8 12:24:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 08 12:24:09.245779 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5ff56-3a5f-4cda-97d1-28408a5c840f service nova] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:24:09.247563 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-4fd5ff56-3a5f-4cda-97d1-28408a5c840f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:24:09.316906 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5ff56-3a5f-4cda-97d1-28408a5c840f service nova] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:24:09.321824 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e6766-11c0-4d6b-951f-4b7d52836c99 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753bde6a72d64045abd3ad44b9b0de04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:24:09.322476 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e6766-11c0-4d6b-951f-4b7d52836c99 service swift] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:24:09.322760 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e6766-11c0-4d6b-951f-4b7d52836c99 service swift] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:24:09.323037 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e6766-11c0-4d6b-951f-4b7d52836c99 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:24:09.331964 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e6766-11c0-4d6b-951f-4b7d52836c99 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:24:09.333637 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e6766-11c0-4d6b-951f-4b7d52836c99 service swift] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:24:09.341775 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1461/2903] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Jun 8 12:24:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 08 12:24:13.042541 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639658f-1ecd-4c33-92c8-0ad3603825e2 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:24:13.044395 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-d639658f-1ecd-4c33-92c8-0ad3603825e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:24:13.152714 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639658f-1ecd-4c33-92c8-0ad3603825e2 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:24:13.159786 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7de52d-234e-4599-9c98-4a127bd1dfc1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9009560a846414b849d42efa8625ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:24:13.160624 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7de52d-234e-4599-9c98-4a127bd1dfc1 service placement] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:24:13.160914 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7de52d-234e-4599-9c98-4a127bd1dfc1 service placement] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:24:13.161190 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7de52d-234e-4599-9c98-4a127bd1dfc1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:24:13.163203 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-2b7de52d-234e-4599-9c98-4a127bd1dfc1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:24:13.176606 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7de52d-234e-4599-9c98-4a127bd1dfc1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:24:13.178272 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7de52d-234e-4599-9c98-4a127bd1dfc1 service placement] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:24:13.192135 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1443/2904] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:24:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:24:16.413452 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e6766-11c0-4d6b-951f-4b7d52836c99 service swift] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:24:16.415098 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-9c1e6766-11c0-4d6b-951f-4b7d52836c99 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:24:16.481388 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e6766-11c0-4d6b-951f-4b7d52836c99 service swift] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:24:16.487493 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae126baf-bd8d-4f60-9469-5d5c5d8889a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:24:16.488401 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae126baf-bd8d-4f60-9469-5d5c5d8889a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:24:16.488816 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae126baf-bd8d-4f60-9469-5d5c5d8889a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:24:16.489096 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae126baf-bd8d-4f60-9469-5d5c5d8889a7 admin admin] PATH_INFO: `/v3/users/c3765f25faff4063b979324f0ab02f2d` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:24:16.490281 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae126baf-bd8d-4f60-9469-5d5c5d8889a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3765f25faff4063b979324f0ab02f2d)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:24:16.492193 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae126baf-bd8d-4f60-9469-5d5c5d8889a7 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:24:16.537816 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-ae126baf-bd8d-4f60-9469-5d5c5d8889a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3765f25faff4063b979324f0ab02f2d'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:24:16.544494 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-ae126baf-bd8d-4f60-9469-5d5c5d8889a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3765f25faff4063b979324f0ab02f2d'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:24:16.545839 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-ae126baf-bd8d-4f60-9469-5d5c5d8889a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3765f25faff4063b979324f0ab02f2d'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:24:16.546576 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-ae126baf-bd8d-4f60-9469-5d5c5d8889a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3765f25faff4063b979324f0ab02f2d'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:24:16.558072 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-ae126baf-bd8d-4f60-9469-5d5c5d8889a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3765f25faff4063b979324f0ab02f2d'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:24:16.562184 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:24:16.573680 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1462/2905] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:24:16 2022] DELETE /identity/v3/users/c3765f25faff4063b979324f0ab02f2d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:24:16.754246 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7de52d-234e-4599-9c98-4a127bd1dfc1 service placement] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:24:16.765963 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7de52d-234e-4599-9c98-4a127bd1dfc1 service placement] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:24:16.822347 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f7778-4fbf-4e6a-9874-cbf62d6071ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:24:16.823148 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f7778-4fbf-4e6a-9874-cbf62d6071ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:24:16.823436 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f7778-4fbf-4e6a-9874-cbf62d6071ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:24:16.823713 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f7778-4fbf-4e6a-9874-cbf62d6071ce admin admin] PATH_INFO: `/v3/projects/18250555de5d4d018d1dd35f42199062` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:24:16.824913 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283f7778-4fbf-4e6a-9874-cbf62d6071ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=18250555de5d4d018d1dd35f42199062)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:24:16.827512 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283f7778-4fbf-4e6a-9874-cbf62d6071ce admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:24:16.865677 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:24:16.875509 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-283f7778-4fbf-4e6a-9874-cbf62d6071ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18250555de5d4d018d1dd35f42199062', 'request_id': 'req-283f7778-4fbf-4e6a-9874-cbf62d6071ce'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:24:16.882051 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-283f7778-4fbf-4e6a-9874-cbf62d6071ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18250555de5d4d018d1dd35f42199062', 'request_id': 'req-283f7778-4fbf-4e6a-9874-cbf62d6071ce'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:24:16.887616 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-283f7778-4fbf-4e6a-9874-cbf62d6071ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18250555de5d4d018d1dd35f42199062', 'request_id': 'req-283f7778-4fbf-4e6a-9874-cbf62d6071ce'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:24:16.898969 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-283f7778-4fbf-4e6a-9874-cbf62d6071ce admin admin] The token cache is being invalidate because project 18250555de5d4d018d1dd35f42199062 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:24:16.899255 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-283f7778-4fbf-4e6a-9874-cbf62d6071ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:24:16.899873 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-283f7778-4fbf-4e6a-9874-cbf62d6071ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:24:16.901466 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1444/2906] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:24:16 2022] DELETE /identity/v3/projects/18250555de5d4d018d1dd35f42199062 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:24:16.906034 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae126baf-bd8d-4f60-9469-5d5c5d8889a7 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:24:16.907447 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-ae126baf-bd8d-4f60-9469-5d5c5d8889a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:24:16.920435 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae126baf-bd8d-4f60-9469-5d5c5d8889a7 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:24:16.976222 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e926dc-2f64-492a-88ca-fb1a474eba92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:24:16.977091 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e926dc-2f64-492a-88ca-fb1a474eba92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:24:16.977375 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e926dc-2f64-492a-88ca-fb1a474eba92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:24:16.977650 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e926dc-2f64-492a-88ca-fb1a474eba92 admin admin] PATH_INFO: `/v3/users/beb29b460757451882d9860a0920ec6c` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:24:16.978819 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e926dc-2f64-492a-88ca-fb1a474eba92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=beb29b460757451882d9860a0920ec6c)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:24:16.980797 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e926dc-2f64-492a-88ca-fb1a474eba92 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:24:17.025546 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-f3e926dc-2f64-492a-88ca-fb1a474eba92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'beb29b460757451882d9860a0920ec6c'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:24:17.033528 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-f3e926dc-2f64-492a-88ca-fb1a474eba92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'beb29b460757451882d9860a0920ec6c'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:24:17.034189 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-f3e926dc-2f64-492a-88ca-fb1a474eba92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'beb29b460757451882d9860a0920ec6c'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:24:17.034831 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-f3e926dc-2f64-492a-88ca-fb1a474eba92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'beb29b460757451882d9860a0920ec6c'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:24:17.046473 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-f3e926dc-2f64-492a-88ca-fb1a474eba92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'beb29b460757451882d9860a0920ec6c'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:24:17.058959 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1463/2907] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:24:16 2022] DELETE /identity/v3/users/beb29b460757451882d9860a0920ec6c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 08 12:24:17.231241 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f7778-4fbf-4e6a-9874-cbf62d6071ce admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:24:17.233021 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-283f7778-4fbf-4e6a-9874-cbf62d6071ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:24:17.246308 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f7778-4fbf-4e6a-9874-cbf62d6071ce admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:24:17.303820 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3553d6-b1b1-422f-ae86-e7426e95d5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:24:17.304763 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3553d6-b1b1-422f-ae86-e7426e95d5eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:24:17.305052 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3553d6-b1b1-422f-ae86-e7426e95d5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:24:17.305328 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3553d6-b1b1-422f-ae86-e7426e95d5eb admin admin] PATH_INFO: `/v3/projects/c05f923e1ef44b59aa53599041b03213` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:24:17.306503 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3553d6-b1b1-422f-ae86-e7426e95d5eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c05f923e1ef44b59aa53599041b03213)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:24:17.308479 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3553d6-b1b1-422f-ae86-e7426e95d5eb admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:24:17.354262 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-bc3553d6-b1b1-422f-ae86-e7426e95d5eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c05f923e1ef44b59aa53599041b03213', 'request_id': 'req-bc3553d6-b1b1-422f-ae86-e7426e95d5eb'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:24:17.362149 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-bc3553d6-b1b1-422f-ae86-e7426e95d5eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c05f923e1ef44b59aa53599041b03213', 'request_id': 'req-bc3553d6-b1b1-422f-ae86-e7426e95d5eb'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:24:17.367962 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-bc3553d6-b1b1-422f-ae86-e7426e95d5eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c05f923e1ef44b59aa53599041b03213', 'request_id': 'req-bc3553d6-b1b1-422f-ae86-e7426e95d5eb'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:24:17.379489 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-bc3553d6-b1b1-422f-ae86-e7426e95d5eb admin admin] The token cache is being invalidate because project c05f923e1ef44b59aa53599041b03213 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:24:17.379781 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-bc3553d6-b1b1-422f-ae86-e7426e95d5eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:24:17.380454 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-bc3553d6-b1b1-422f-ae86-e7426e95d5eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:24:17.381991 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1445/2908] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:24:17 2022] DELETE /identity/v3/projects/c05f923e1ef44b59aa53599041b03213 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:24:22.711170 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e926dc-2f64-492a-88ca-fb1a474eba92 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:24:22.712609 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-f3e926dc-2f64-492a-88ca-fb1a474eba92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:24:22.768977 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e926dc-2f64-492a-88ca-fb1a474eba92 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:24:22.796825 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:24:22.817487 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d537d24-67b4-4b9d-b0f7-3112b74810c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:24:22.818139 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d537d24-67b4-4b9d-b0f7-3112b74810c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:24:22.818428 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d537d24-67b4-4b9d-b0f7-3112b74810c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:24:22.818705 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d537d24-67b4-4b9d-b0f7-3112b74810c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:24:22.820522 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-8d537d24-67b4-4b9d-b0f7-3112b74810c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:24:22.878684 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d537d24-67b4-4b9d-b0f7-3112b74810c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:24:22.880034 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d537d24-67b4-4b9d-b0f7-3112b74810c4 service neutron] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:24:22.889063 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1464/2909] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:24:22 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:24:27.376471 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=62,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:24:27.860161 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3553d6-b1b1-422f-ae86-e7426e95d5eb admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:24:27.861729 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-bc3553d6-b1b1-422f-ae86-e7426e95d5eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:24:27.873849 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3553d6-b1b1-422f-ae86-e7426e95d5eb admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:24:27.878754 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ecc7d-6e9b-4592-a798-906cf37c7069 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fef074aa2ea4570928109f62ea1aa96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:24:27.879502 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ecc7d-6e9b-4592-a798-906cf37c7069 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:24:27.879939 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ecc7d-6e9b-4592-a798-906cf37c7069 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:24:27.880255 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ecc7d-6e9b-4592-a798-906cf37c7069 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:24:27.882056 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-361ecc7d-6e9b-4592-a798-906cf37c7069 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:24:27.945790 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361ecc7d-6e9b-4592-a798-906cf37c7069 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:24:27.947237 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361ecc7d-6e9b-4592-a798-906cf37c7069 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:24:27.957645 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1446/2910] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:24:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:24:30.988619 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d537d24-67b4-4b9d-b0f7-3112b74810c4 service neutron] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:24:30.990191 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-8d537d24-67b4-4b9d-b0f7-3112b74810c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:24:31.064527 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d537d24-67b4-4b9d-b0f7-3112b74810c4 service neutron] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:24:31.069925 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e149374-653a-4ece-b036-51f5c322f642 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9009560a846414b849d42efa8625ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:24:31.070687 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e149374-653a-4ece-b036-51f5c322f642 service placement] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:24:31.070933 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e149374-653a-4ece-b036-51f5c322f642 service placement] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:24:31.071212 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e149374-653a-4ece-b036-51f5c322f642 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:24:31.073624 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-4e149374-653a-4ece-b036-51f5c322f642 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:24:31.087608 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e149374-653a-4ece-b036-51f5c322f642 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:24:31.089773 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e149374-653a-4ece-b036-51f5c322f642 service placement] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:24:31.101378 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1465/2911] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:24:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:24:34.223179 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ecc7d-6e9b-4592-a798-906cf37c7069 service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:24:34.224828 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-361ecc7d-6e9b-4592-a798-906cf37c7069 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:24:34.241488 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ecc7d-6e9b-4592-a798-906cf37c7069 service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:24:34.246029 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45a3c3-541a-4029-b7c9-3d838fa33d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:24:34.246896 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45a3c3-541a-4029-b7c9-3d838fa33d77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:24:34.247173 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45a3c3-541a-4029-b7c9-3d838fa33d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:24:34.247447 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45a3c3-541a-4029-b7c9-3d838fa33d77 admin admin] PATH_INFO: `/v3/users/59e1dc6887b844b7a28ad331021582c4` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:24:34.248643 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d45a3c3-541a-4029-b7c9-3d838fa33d77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59e1dc6887b844b7a28ad331021582c4)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:24:34.251592 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d45a3c3-541a-4029-b7c9-3d838fa33d77 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:24:34.302013 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3d45a3c3-541a-4029-b7c9-3d838fa33d77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59e1dc6887b844b7a28ad331021582c4'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:24:34.302658 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3d45a3c3-541a-4029-b7c9-3d838fa33d77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59e1dc6887b844b7a28ad331021582c4'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:24:34.303287 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3d45a3c3-541a-4029-b7c9-3d838fa33d77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59e1dc6887b844b7a28ad331021582c4'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:24:34.310204 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3d45a3c3-541a-4029-b7c9-3d838fa33d77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59e1dc6887b844b7a28ad331021582c4'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:24:34.323218 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3d45a3c3-541a-4029-b7c9-3d838fa33d77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59e1dc6887b844b7a28ad331021582c4'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:24:34.338104 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1447/2912] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:24:34 2022] DELETE /identity/v3/users/59e1dc6887b844b7a28ad331021582c4 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:24:34.517055 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e149374-653a-4ece-b036-51f5c322f642 service placement] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:24:34.528422 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e149374-653a-4ece-b036-51f5c322f642 service placement] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:24:34.592389 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34895871-fa88-4c11-8206-24c182fa7eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:24:34.593272 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34895871-fa88-4c11-8206-24c182fa7eb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:24:34.593634 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34895871-fa88-4c11-8206-24c182fa7eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:24:34.594025 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34895871-fa88-4c11-8206-24c182fa7eb8 admin admin] PATH_INFO: `/v3/projects/cc8a0776e7744420b4bc6bcd39b78d77` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:24:34.595827 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34895871-fa88-4c11-8206-24c182fa7eb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc8a0776e7744420b4bc6bcd39b78d77)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:24:34.597302 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34895871-fa88-4c11-8206-24c182fa7eb8 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:24:34.614510 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=100 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:24:34.645916 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-34895871-fa88-4c11-8206-24c182fa7eb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc8a0776e7744420b4bc6bcd39b78d77', 'request_id': 'req-34895871-fa88-4c11-8206-24c182fa7eb8'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:24:34.653158 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-34895871-fa88-4c11-8206-24c182fa7eb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc8a0776e7744420b4bc6bcd39b78d77', 'request_id': 'req-34895871-fa88-4c11-8206-24c182fa7eb8'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:24:34.658743 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-34895871-fa88-4c11-8206-24c182fa7eb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc8a0776e7744420b4bc6bcd39b78d77', 'request_id': 'req-34895871-fa88-4c11-8206-24c182fa7eb8'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:24:34.669382 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-34895871-fa88-4c11-8206-24c182fa7eb8 admin admin] The token cache is being invalidate because project cc8a0776e7744420b4bc6bcd39b78d77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:24:34.669664 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-34895871-fa88-4c11-8206-24c182fa7eb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:24:34.670279 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-34895871-fa88-4c11-8206-24c182fa7eb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:24:34.672329 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1466/2913] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:24:34 2022] DELETE /identity/v3/projects/cc8a0776e7744420b4bc6bcd39b78d77 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:24:34.676299 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45a3c3-541a-4029-b7c9-3d838fa33d77 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:24:34.677773 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-3d45a3c3-541a-4029-b7c9-3d838fa33d77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:24:34.691605 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45a3c3-541a-4029-b7c9-3d838fa33d77 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:24:34.747663 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c0db05-b1d1-4aa2-ac22-dfa42b2e4154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:24:34.748592 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0db05-b1d1-4aa2-ac22-dfa42b2e4154 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:24:34.748892 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0db05-b1d1-4aa2-ac22-dfa42b2e4154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:24:34.749188 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0db05-b1d1-4aa2-ac22-dfa42b2e4154 admin admin] PATH_INFO: `/v3/users/678b544e1ad6406bbe332fb2e5f51792` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:24:34.751259 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c0db05-b1d1-4aa2-ac22-dfa42b2e4154 admin admin] RBAC: Authorizing `identity:delete_user(user_id=678b544e1ad6406bbe332fb2e5f51792)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:24:34.753181 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c0db05-b1d1-4aa2-ac22-dfa42b2e4154 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:24:34.758326 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:24:34.798374 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f8c0db05-b1d1-4aa2-ac22-dfa42b2e4154 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '678b544e1ad6406bbe332fb2e5f51792'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:24:34.798935 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f8c0db05-b1d1-4aa2-ac22-dfa42b2e4154 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '678b544e1ad6406bbe332fb2e5f51792'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:24:34.799528 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f8c0db05-b1d1-4aa2-ac22-dfa42b2e4154 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '678b544e1ad6406bbe332fb2e5f51792'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:24:34.806561 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f8c0db05-b1d1-4aa2-ac22-dfa42b2e4154 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '678b544e1ad6406bbe332fb2e5f51792'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:24:34.819169 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f8c0db05-b1d1-4aa2-ac22-dfa42b2e4154 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '678b544e1ad6406bbe332fb2e5f51792'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:24:34.832699 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1448/2914] 10.222.0.39 () {58 vars in 1223 bytes} [Wed Jun 8 12:24:34 2022] DELETE /identity/v3/users/678b544e1ad6406bbe332fb2e5f51792 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:24:35.004265 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34895871-fa88-4c11-8206-24c182fa7eb8 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:24:35.005764 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-34895871-fa88-4c11-8206-24c182fa7eb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:24:35.019289 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34895871-fa88-4c11-8206-24c182fa7eb8 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:24:35.076518 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e999a4-fbfe-4078-b985-88886cc4cf92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0451f9cd1a224f47a21e570061ffb155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f8cde9fd1b644e687e4b80b620e4c44', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:24:35.077321 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e999a4-fbfe-4078-b985-88886cc4cf92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:24:35.077607 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e999a4-fbfe-4078-b985-88886cc4cf92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:24:35.077920 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e999a4-fbfe-4078-b985-88886cc4cf92 admin admin] PATH_INFO: `/v3/projects/46a749fb9b7b4a9cb1a8011c80b695db` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:24:35.079285 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e999a4-fbfe-4078-b985-88886cc4cf92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46a749fb9b7b4a9cb1a8011c80b695db)` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:24:35.081256 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e999a4-fbfe-4078-b985-88886cc4cf92 admin admin] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:24:35.129152 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-09e999a4-fbfe-4078-b985-88886cc4cf92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46a749fb9b7b4a9cb1a8011c80b695db', 'request_id': 'req-09e999a4-fbfe-4078-b985-88886cc4cf92'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:24:35.136502 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-09e999a4-fbfe-4078-b985-88886cc4cf92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46a749fb9b7b4a9cb1a8011c80b695db', 'request_id': 'req-09e999a4-fbfe-4078-b985-88886cc4cf92'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:24:35.142131 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-09e999a4-fbfe-4078-b985-88886cc4cf92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46a749fb9b7b4a9cb1a8011c80b695db', 'request_id': 'req-09e999a4-fbfe-4078-b985-88886cc4cf92'} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:24:35.152920 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-09e999a4-fbfe-4078-b985-88886cc4cf92 admin admin] The token cache is being invalidate because project 46a749fb9b7b4a9cb1a8011c80b695db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 08 12:24:35.153200 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-09e999a4-fbfe-4078-b985-88886cc4cf92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:24:35.153843 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.notifications [None req-09e999a4-fbfe-4078-b985-88886cc4cf92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 08 12:24:35.155379 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1467/2915] 10.222.0.39 () {58 vars in 1232 bytes} [Wed Jun 8 12:24:35 2022] DELETE /identity/v3/projects/46a749fb9b7b4a9cb1a8011c80b695db => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 08 12:24:44.829265 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:24:45.149880 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG dbcounter [-] [80216] Writing DB stats keystone:SELECT=68,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:24:52.272485 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c0db05-b1d1-4aa2-ac22-dfa42b2e4154 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:24:52.274341 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f8c0db05-b1d1-4aa2-ac22-dfa42b2e4154 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:24:52.342956 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c0db05-b1d1-4aa2-ac22-dfa42b2e4154 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:24:52.405235 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14ece5-be44-4740-9930-c6c35fba5f4c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9009560a846414b849d42efa8625ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:24:52.406599 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14ece5-be44-4740-9930-c6c35fba5f4c service placement] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:24:52.406957 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14ece5-be44-4740-9930-c6c35fba5f4c service placement] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:24:52.407144 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14ece5-be44-4740-9930-c6c35fba5f4c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:24:52.408987 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-7f14ece5-be44-4740-9930-c6c35fba5f4c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:24:52.420213 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f14ece5-be44-4740-9930-c6c35fba5f4c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:24:52.422434 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f14ece5-be44-4740-9930-c6c35fba5f4c service placement] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:24:52.432687 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1449/2916] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:24:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 08 12:25:02.428104 dv-cinder-797608-30-iscsi devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=58 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 12:29:57.286088 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e999a4-fbfe-4078-b985-88886cc4cf92 admin admin] Authenticating user token {{(pid=80216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 08 12:29:57.287488 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.fernet_utils [None req-09e999a4-fbfe-4078-b985-88886cc4cf92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 08 12:29:57.376929 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e999a4-fbfe-4078-b985-88886cc4cf92 admin admin] Validating token access rules against request {{(pid=80216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 08 12:29:57.385110 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf6229d-a91f-4555-9f31-25b05db54a4b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9009560a846414b849d42efa8625ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a7fee684e8b43e199c95aeeb92640d4', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 08 12:29:57.385806 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6229d-a91f-4555-9f31-25b05db54a4b service placement] REQUEST_METHOD: `GET` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 08 12:29:57.386091 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6229d-a91f-4555-9f31-25b05db54a4b service placement] SCRIPT_NAME: `/identity` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 08 12:29:57.386365 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6229d-a91f-4555-9f31-25b05db54a4b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 08 12:29:57.395780 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf6229d-a91f-4555-9f31-25b05db54a4b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 08 12:29:57.397549 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf6229d-a91f-4555-9f31-25b05db54a4b service placement] RBAC: Authorization granted {{(pid=80216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 08 12:29:57.410142 dv-cinder-797608-30-iscsi devstack@keystone.service[80216]: [pid: 80216|app: 0|req: 1468/2917] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Jun 8 12:29:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)